-- Logs begin at Tue 2022-05-10 04:47:09 UTC, end at Tue 2022-05-10 05:55:42 UTC. -- May 10 05:20:52.570532 dv-cinder-836996-16-iscsi systemd[1]: Starting Devstack devstack@keystone.service... May 10 05:20:52.578004 dv-cinder-836996-16-iscsi devstack@keystone.service[79866]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini May 10 05:20:52.582462 dv-cinder-836996-16-iscsi devstack@keystone.service[79866]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue May 10 05:20:52 2022] *** May 10 05:20:52.582462 dv-cinder-836996-16-iscsi devstack@keystone.service[79866]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 10 05:20:52.582462 dv-cinder-836996-16-iscsi devstack@keystone.service[79866]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 10 05:20:52.582462 dv-cinder-836996-16-iscsi devstack@keystone.service[79866]: nodename: dv-cinder-836996-16-iscsi May 10 05:20:52.582462 dv-cinder-836996-16-iscsi devstack@keystone.service[79866]: machine: x86_64 May 10 05:20:52.582462 dv-cinder-836996-16-iscsi devstack@keystone.service[79866]: clock source: unix May 10 05:20:52.582462 dv-cinder-836996-16-iscsi devstack@keystone.service[79866]: pcre jit disabled May 10 05:20:52.582462 dv-cinder-836996-16-iscsi devstack@keystone.service[79866]: detected number of CPU cores: 4 May 10 05:20:52.582462 dv-cinder-836996-16-iscsi devstack@keystone.service[79866]: current working directory: / May 10 05:20:52.582462 dv-cinder-836996-16-iscsi devstack@keystone.service[79866]: detected binary path: /usr/bin/uwsgi-core May 10 05:20:52.582462 dv-cinder-836996-16-iscsi devstack@keystone.service[79866]: your processes number limit is 47680 May 10 05:20:52.582462 dv-cinder-836996-16-iscsi devstack@keystone.service[79866]: your memory page size is 4096 bytes May 10 05:20:52.582462 dv-cinder-836996-16-iscsi devstack@keystone.service[79866]: detected max file descriptor number: 2048 May 10 05:20:52.582462 dv-cinder-836996-16-iscsi devstack@keystone.service[79866]: lock engine: pthread robust mutexes May 10 05:20:52.582462 dv-cinder-836996-16-iscsi devstack@keystone.service[79866]: thunder lock: enabled May 10 05:20:52.582462 dv-cinder-836996-16-iscsi devstack@keystone.service[79866]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 May 10 05:20:52.582462 dv-cinder-836996-16-iscsi devstack@keystone.service[79866]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 10 05:20:52.626209 dv-cinder-836996-16-iscsi devstack@keystone.service[79866]: Python main interpreter initialized at 0x55f25a5e09c0 May 10 05:20:52.626209 dv-cinder-836996-16-iscsi devstack@keystone.service[79866]: python threads support enabled May 10 05:20:52.626209 dv-cinder-836996-16-iscsi devstack@keystone.service[79866]: your server socket listen backlog is limited to 100 connections May 10 05:20:52.626209 dv-cinder-836996-16-iscsi devstack@keystone.service[79866]: your mercy for graceful operations on workers is 90 seconds May 10 05:20:52.626586 dv-cinder-836996-16-iscsi devstack@keystone.service[79866]: mapped 403077 bytes (393 KB) for 2 cores May 10 05:20:52.626665 dv-cinder-836996-16-iscsi devstack@keystone.service[79866]: *** Operational MODE: preforking *** May 10 05:20:52.626919 dv-cinder-836996-16-iscsi devstack@keystone.service[79866]: *** uWSGI is running in multiple interpreter mode *** May 10 05:20:52.626919 dv-cinder-836996-16-iscsi devstack@keystone.service[79866]: spawned uWSGI master process (pid: 79866) May 10 05:20:52.627178 dv-cinder-836996-16-iscsi systemd[1]: Started Devstack devstack@keystone.service. May 10 05:20:52.628163 dv-cinder-836996-16-iscsi devstack@keystone.service[79866]: spawned uWSGI worker 1 (pid: 79879, cores: 1) May 10 05:20:52.628163 dv-cinder-836996-16-iscsi devstack@keystone.service[79866]: spawned uWSGI worker 2 (pid: 79880, cores: 1) May 10 05:20:52.628322 dv-cinder-836996-16-iscsi devstack@keystone.service[79866]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 10 05:20:58.245439 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 10 05:20:58.245439 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: from cryptography.utils import int_from_bytes May 10 05:20:58.246645 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 10 05:20:58.246645 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: from cryptography.utils import int_from_bytes May 10 05:20:58.247075 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 10 05:20:58.247075 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: from cryptography.utils import int_from_bytes May 10 05:20:58.247184 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 10 05:20:58.247184 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: from cryptography.utils import int_from_bytes May 10 05:20:58.294986 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=79879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 10 05:20:58.295159 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 10 05:20:58.295247 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=79879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 10 05:20:58.295326 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 10 05:20:58.295389 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG uwsgi [-] command line args: [] {{(pid=79879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 10 05:20:58.295455 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] command line args: [] {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 10 05:20:58.295743 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=79879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 10 05:20:58.295831 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 10 05:20:58.295904 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG uwsgi [-] ================================================================================ {{(pid=79879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 10 05:20:58.295973 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] ================================================================================ {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 10 05:20:58.296034 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG uwsgi [-] admin_token = **** {{(pid=79879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 05:20:58.296217 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] admin_token = **** {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 05:20:58.296305 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG uwsgi [-] config_dir = [] {{(pid=79879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 05:20:58.296368 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] config_dir = [] {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 05:20:58.296433 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=79879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 05:20:58.296579 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG uwsgi [-] config_source = [] {{(pid=79879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 05:20:58.296658 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 05:20:58.296732 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG uwsgi [-] debug = True {{(pid=79879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 05:20:58.296800 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] config_source = [] {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 05:20:58.296865 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] debug = True {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 05:20:58.296930 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=79879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 05:20:58.299366 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 05:20:58.299465 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=79879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 05:20:58.299537 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 05:20:58.299629 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG uwsgi [-] insecure_debug = False {{(pid=79879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 05:20:58.299692 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] insecure_debug = False {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 05:20:58.299764 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=79879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 05:20:58.299827 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 05:20:58.299886 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=79879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 05:20:58.299951 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 05:20:58.300011 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG uwsgi [-] list_limit = None {{(pid=79879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 05:20:58.300075 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] list_limit = None {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 05:20:58.300145 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG uwsgi [-] log_config_append = None {{(pid=79879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 05:20:58.300212 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] log_config_append = None {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 05:20:58.300276 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=79879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 05:20:58.300349 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 05:20:58.300408 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG uwsgi [-] log_dir = None {{(pid=79879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 05:20:58.300471 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] log_dir = None {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 05:20:58.300540 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG uwsgi [-] log_file = None {{(pid=79879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 05:20:58.300605 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] log_file = None {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 05:20:58.300669 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=79879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 05:20:58.300734 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 05:20:58.300800 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=79879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 05:20:58.300859 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 05:20:58.300928 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=79879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 05:20:58.300995 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 05:20:58.301061 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=79879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 05:20:58.301125 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 05:20:58.301192 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=79879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 05:20:58.301263 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 05:20:58.301325 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=79879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 05:20:58.301392 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 05:20:58.301459 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=79879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 05:20:58.301518 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 05:20:58.301576 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=79879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 05:20:58.301655 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 05:20:58.301717 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=79879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 05:20:58.301775 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 05:20:58.301832 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=79879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 05:20:58.301889 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 05:20:58.301947 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=79879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 05:20:58.302013 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 05:20:58.302078 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=79879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 05:20:58.302148 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 05:20:58.302221 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=79879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 05:20:58.302312 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 05:20:58.302382 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG uwsgi [-] notification_format = cadf {{(pid=79879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 05:20:58.302452 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] notification_format = cadf {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 05:20:58.302513 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=79879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 05:20:58.302573 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 05:20:58.302632 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.23/identity {{(pid=79879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 05:20:58.302691 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.23/identity {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 05:20:58.302761 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG uwsgi [-] publish_errors = False {{(pid=79879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 05:20:58.302824 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] publish_errors = False {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 05:20:58.302882 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=79879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 05:20:58.302950 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 05:20:58.303866 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=79879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 05:20:58.304048 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 05:20:58.304282 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=79879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 05:20:58.304452 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 05:20:58.304644 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=79879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 05:20:58.304965 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 05:20:58.305183 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=79879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 05:20:58.305358 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 05:20:58.305550 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG uwsgi [-] standard_threads = False {{(pid=79879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 05:20:58.305740 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] standard_threads = False {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 05:20:58.305964 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG uwsgi [-] strict_password_check = False {{(pid=79879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 05:20:58.306130 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] strict_password_check = False {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 05:20:58.306320 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=79879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 05:20:58.306515 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 05:20:58.306704 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG uwsgi [-] use_eventlog = False {{(pid=79879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 05:20:58.306892 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] use_eventlog = False {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 05:20:58.307115 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG uwsgi [-] use_journal = False {{(pid=79879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 05:20:58.307279 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] use_journal = False {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 05:20:58.307469 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG uwsgi [-] use_json = False {{(pid=79879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 05:20:58.307700 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] use_json = False {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 05:20:58.307876 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG uwsgi [-] use_stderr = False {{(pid=79879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 05:20:58.308101 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] use_stderr = False {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 05:20:58.308265 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG uwsgi [-] use_syslog = False {{(pid=79879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 05:20:58.308687 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] use_syslog = False {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 05:20:58.308873 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG uwsgi [-] watch_log_file = False {{(pid=79879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 05:20:58.309063 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] watch_log_file = False {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 05:20:58.309201 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=79879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.309395 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.309542 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=79879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.309678 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.309807 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=79879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.309941 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.310076 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=79879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.310224 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.310353 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=79879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.310487 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.310624 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=79879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.310752 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.310879 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=79879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.311086 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.311224 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=79879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.311359 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.311487 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=79879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.311643 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.311777 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=79879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.311919 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.312048 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=79879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.312192 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.312391 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=79879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.312534 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.312666 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=79879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.312807 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.312952 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=79879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.313092 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.313222 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=79879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.313357 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.313486 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=79879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.313624 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.313755 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=79879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.313891 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.314038 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=79879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.314168 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.314296 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=79879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.314296 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=79879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.314549 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.314677 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=79879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.314811 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.314942 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=79879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.315076 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.315212 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=79879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.315341 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.315474 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=79879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.315678 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.315815 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=79879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.315956 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.316093 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=79879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.316224 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.316354 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=79879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.316481 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.316608 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=79879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.316736 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.316876 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=79879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.317005 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.317133 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=79879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.317261 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.317388 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=79879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.317593 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.317740 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=79879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.317871 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.318004 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=79879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.318139 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.318267 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=79879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.318406 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.318534 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=79879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.318662 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.318831 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=79879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.318968 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.319099 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=79879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.319239 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.319367 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=79879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.319495 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.319676 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=79879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.319808 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.319936 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=79879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.320077 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.320207 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=79879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.320341 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.320469 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=79879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.320597 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.320725 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=79879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.320861 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.320990 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=79879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.321119 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.321247 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=79879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.322437 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.322609 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=79879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.322839 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.323004 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=79879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.323197 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.323386 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=79879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.323623 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.323831 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=79879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.324033 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.324200 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=79879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.324389 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.324578 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=79879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.324766 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.324954 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=79879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.325195 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.325357 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=79879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.325616 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.325814 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=79879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.326001 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.326215 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=79879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.326446 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.326609 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=79879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.326801 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.326997 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=79879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.327188 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.327378 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=79879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.327545 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.327746 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=79879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.327879 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.328008 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=79879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.328166 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.328298 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=79879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.328443 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.328582 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=79879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.328719 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.328885 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=79879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.329035 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.329173 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=79879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.329303 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.329441 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=79879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.329593 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.329724 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=79879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.329853 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.329981 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=79879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.330118 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.330276 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=79879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.330419 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.330549 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=79879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.330688 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.330824 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=79879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.330954 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.331082 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=79879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.331219 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.331349 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=79879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.331490 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.331644 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=79879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.331779 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.331916 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=79879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.332045 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.332174 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=79879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.332309 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.332439 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG uwsgi [-] cache.enabled = True {{(pid=79879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.332568 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.332704 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=79879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.332864 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] cache.enabled = True {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.333023 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=79879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.333156 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.333295 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=79879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.333423 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.333628 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=79879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.333763 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.333891 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=79879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.334020 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.334148 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=79879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.334276 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.334505 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=79879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.334640 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.334769 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=79879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.334898 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.335033 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=79879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.335162 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.335309 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=79879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.335439 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.335568 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=79879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.335750 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.335879 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=79879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.336008 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.336148 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=79879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.336279 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.336405 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=79879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.336534 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.336670 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=79879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.336800 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.336938 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=79879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.337076 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.337227 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=79879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.337357 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.337486 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=79879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.337614 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.337748 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=79879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.337879 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.338018 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=79879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.338149 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.338277 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=79879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.338405 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.338533 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=79879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.338662 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.338799 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=79879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.338930 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.339088 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=79879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.339219 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.339347 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=79879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.339475 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.339635 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=79879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.339771 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.339912 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=79879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.340042 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.340171 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=79879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.340299 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.340436 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG uwsgi [-] auth.external = None {{(pid=79879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.340436 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG uwsgi [-] auth.mapped = None {{(pid=79879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.340687 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.340687 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] auth.external = None {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.340941 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=79879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.341080 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] auth.mapped = None {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.341243 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=79879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.341243 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG uwsgi [-] auth.password = None {{(pid=79879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.341513 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.341646 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG uwsgi [-] auth.token = None {{(pid=79879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.341780 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.341910 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=79879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.342039 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] auth.password = None {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.342177 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG uwsgi [-] catalog.caching = True {{(pid=79879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.342308 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] auth.token = None {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.342437 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=79879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.342576 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.342706 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=79879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.342834 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] catalog.caching = True {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.342975 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=79879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.343202 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.343365 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=79879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.343504 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.343690 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=79879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.343822 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.343963 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG uwsgi [-] credential.caching = True {{(pid=79879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.344095 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.344224 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG uwsgi [-] credential.driver = sql {{(pid=79879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.344352 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.344482 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=79879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.344621 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] credential.caching = True {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.344763 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=79879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.344893 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] credential.driver = sql {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.345022 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=79879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.345152 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.345282 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=79879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.345411 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.345549 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=79879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.345678 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.345808 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=79879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.345938 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.346067 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=79879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.346197 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.346337 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=79879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.346479 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.346609 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=79879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.346738 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.346738 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.346983 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=79879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.346983 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=79879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.347236 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.347365 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=79879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.347494 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.347643 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=79879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.347778 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.347923 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=79879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.348054 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.348194 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG uwsgi [-] federation.caching = True {{(pid=79879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.348324 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.348453 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=79879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.348582 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.348720 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG uwsgi [-] federation.driver = sql {{(pid=79879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.348850 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] federation.caching = True {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.348993 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=79879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.349126 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.349256 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=79879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.349386 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] federation.driver = sql {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.349596 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=79879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.349729 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.349859 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=79879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.350018 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.350160 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=79879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.350290 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.350430 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=79879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.350561 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.350690 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=79879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.350832 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.350965 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=79879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.351094 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.351240 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=79879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.351376 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.351513 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG uwsgi [-] identity.caching = True {{(pid=79879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.351665 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.351796 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=79879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.351946 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.352085 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=79879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.352216 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] identity.caching = True {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.352345 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=79879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.352476 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.352604 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=79879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.352742 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.352873 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG uwsgi [-] identity.driver = sql {{(pid=79879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.353002 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.353132 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=79879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.353261 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.353391 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=79879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.353529 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] identity.driver = sql {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.353659 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=79879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.353803 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.353933 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=79879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.354061 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.354190 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=79879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.354328 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.354459 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=79879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.354589 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.354718 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=79879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.354848 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.354978 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=79879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.355115 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.355245 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=79879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.355374 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.355514 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=79879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.355666 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.355798 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=79879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.355939 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.356070 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=79879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.356200 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.356329 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=79879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.356464 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.356602 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=79879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.356742 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.356873 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=79879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.357002 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.357131 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=79879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.357260 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.357400 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=79879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.357538 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.357668 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=79879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.357797 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.357927 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=79879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.358056 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.358185 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=79879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.358322 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.358453 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=79879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.358582 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.358712 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=79879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.358843 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.358972 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=79879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.359131 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.359261 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=79879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.359390 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.359519 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=79879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.359708 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.359841 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=79879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.359982 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.360114 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=79879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.360243 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.360371 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=79879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.360500 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.360628 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=79879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.360628 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=79879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.360921 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.361065 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG uwsgi [-] ldap.password = **** {{(pid=79879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.361195 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.361323 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=79879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.361452 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.361589 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=79879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.361727 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.361858 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=79879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.361988 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] ldap.password = **** {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.362117 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=79879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.362248 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.362385 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=79879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.362552 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.362686 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=79879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.362815 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.362815 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.363108 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=79879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.363108 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=79879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.363361 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.363490 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=79879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.363635 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.363769 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=79879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.363898 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.364043 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=79879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.364181 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.364311 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=79879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.364440 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.364568 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=79879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.364707 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.364845 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=79879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.364975 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.365104 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG uwsgi [-] ldap.user = None {{(pid=79879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.365234 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.365362 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=79879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.365491 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.365681 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=79879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.365818 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.365948 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=79879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.366079 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] ldap.user = None {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.366209 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=79879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.366347 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.366478 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=79879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.366634 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.366830 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=79879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.366998 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.367133 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=79879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.367271 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.367401 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=79879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.367531 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.367761 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=79879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.367895 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.368024 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=79879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.368167 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.368300 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=79879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.368429 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.368568 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=79879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.368698 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.368827 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=79879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.368965 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.369104 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=79879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.369234 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.369363 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=79879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.369492 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.369621 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=79879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.369759 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.369890 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=79879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.370019 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.370148 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=79879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.370278 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.370426 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=79879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.370573 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.370705 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=79879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.371202 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.371333 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=79879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.371461 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.371624 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=79879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.371772 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.371904 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=79879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.372040 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.372169 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=79879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.372299 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.372428 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=79879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.372565 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.372706 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=79879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.372836 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.372964 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG uwsgi [-] policy.driver = sql {{(pid=79879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.373100 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.373230 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=79879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.373367 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.373498 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=79879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.373628 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.373756 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=79879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.373885 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] policy.driver = sql {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.374014 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG uwsgi [-] receipt.caching = True {{(pid=79879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.374151 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.374282 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=79879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.374411 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.374553 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=79879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.374682 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.374811 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=79879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.374949 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] receipt.caching = True {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.375078 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=79879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.375207 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.375335 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=79879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.375465 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.375637 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG uwsgi [-] resource.caching = True {{(pid=79879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.375858 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.375990 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=79879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.376119 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.376248 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG uwsgi [-] resource.driver = sql {{(pid=79879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.376387 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.376516 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=79879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.376656 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] resource.caching = True {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.376787 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=79879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.376917 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.377046 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=79879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.377174 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] resource.driver = sql {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.377303 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG uwsgi [-] revoke.caching = True {{(pid=79879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.377441 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.377572 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=79879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.377703 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.377831 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=79879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.377960 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.378089 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG uwsgi [-] role.cache_time = None {{(pid=79879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.378236 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] revoke.caching = True {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.378367 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG uwsgi [-] role.caching = True {{(pid=79879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.378496 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.378624 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG uwsgi [-] role.driver = sql {{(pid=79879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.378754 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.378883 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG uwsgi [-] role.list_limit = None {{(pid=79879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.379026 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] role.cache_time = None {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.379160 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=79879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.379288 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] role.caching = True {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.379417 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=79879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.379547 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] role.driver = sql {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.379696 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=79879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.379839 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] role.list_limit = None {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.379971 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=79879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.380110 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.380240 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=79879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.380370 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.380500 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=79879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.380637 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.380769 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=79879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.380899 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.381027 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=79879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.381180 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.381325 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=79879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.381457 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.381586 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=79879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.381715 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.381855 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=79879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.381993 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.382131 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=79879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.382262 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.382390 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=79879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.382519 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.382648 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=79879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.382776 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.382915 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=79879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.383046 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.383175 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=79879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.383305 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.383434 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=79879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.383634 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.383784 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=79879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.383917 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.384046 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=79879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.384177 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.384313 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=79879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.384443 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.384581 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=79879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.384581 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=79879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.384827 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.384956 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=79879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.385090 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.385220 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=79879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.385367 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.385498 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=79879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.385627 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.385756 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=79879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.385885 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.386015 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=79879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.386153 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.386283 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=79879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.386413 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.386545 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=79879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.386674 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.386812 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=79879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.386943 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.387087 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=79879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.387235 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.387235 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.387493 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG uwsgi [-] token.cache_time = None {{(pid=79879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.387665 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.387806 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG uwsgi [-] token.caching = True {{(pid=79879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.387942 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.388078 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=79879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.388215 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.388350 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG uwsgi [-] token.provider = fernet {{(pid=79879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.388496 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] token.cache_time = None {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.388632 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=79879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.388774 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] token.caching = True {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.388918 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=79879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.389080 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.389219 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=79879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.389363 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] token.provider = fernet {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.389501 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=79879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.389637 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.389772 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=79879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.389908 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.390043 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=79879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.390187 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.390324 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG uwsgi [-] trust.driver = sql {{(pid=79879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.390324 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=79879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.390588 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.390724 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=79879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.390859 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.391014 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=79879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.391152 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.391288 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=79879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.391424 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] trust.driver = sql {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.391560 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=79879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.391718 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.391866 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=79879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.392003 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.392139 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=79879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.392275 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.392275 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.392533 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=79879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.392676 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.392831 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG uwsgi [-] database.connection = **** {{(pid=79879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.392990 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.393137 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=79879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.393275 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.393411 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=79879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.393411 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=79879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.393668 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.393812 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=79879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.393950 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] database.connection = **** {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.394145 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=79879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.394296 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.394435 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=79879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.394570 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.394706 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=79879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.394861 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.394998 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=79879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.395134 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.395270 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=79879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.395406 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.395542 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=79879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.395794 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.395933 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=79879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.396070 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.396206 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=79879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.396342 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.396479 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=79879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.396625 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.396761 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=79879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.396971 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.397112 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=79879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.397249 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.397386 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=79879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.397605 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.397746 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=79879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.397884 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.398021 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=79879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.398157 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.398294 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=79879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 10 05:20:58.398439 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.398439 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.398439 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.398439 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 05:20:58.398439 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=79880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 10 05:20:58.408167 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=79879) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 05:20:58.408383 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=79880) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 05:20:58.408661 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=79879) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 05:20:58.408822 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=79880) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 05:20:58.408964 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=79879) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 05:20:58.409107 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=79880) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 05:20:58.417418 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=79879) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 05:20:58.417634 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=79880) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 05:20:58.445646 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=79879) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 05:20:58.445890 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=79879) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 05:20:58.446238 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=79880) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 05:20:58.446473 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=79880) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 05:20:58.498963 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=79879) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 05:20:58.499199 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=79880) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 05:20:58.549841 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=79879) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 05:20:58.550159 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=79879) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 05:20:58.550745 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=79880) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 05:20:58.550953 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=79880) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 05:20:58.614760 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79879) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 05:20:58.615073 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=79879) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 05:20:58.615227 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=79879) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 05:20:58.615390 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79880) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 05:20:58.615536 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=79879) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 05:20:58.615709 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=79880) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 05:20:58.615850 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=79879) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 05:20:58.615988 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=79880) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 05:20:58.616140 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=79879) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 05:20:58.616281 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=79880) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 05:20:58.616281 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=79880) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 05:20:58.616544 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=79880) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 05:20:58.639376 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79879) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 05:20:58.639587 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79880) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 05:20:58.639680 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=79879) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 05:20:58.639759 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=79880) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 05:20:58.639900 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=79879) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 05:20:58.639987 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=79880) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 05:20:58.640098 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=79879) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 05:20:58.640195 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=79880) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 05:20:58.640311 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=79879) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 05:20:58.640394 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=79880) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 05:20:58.640520 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=79879) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 05:20:58.640602 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=79880) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 05:20:58.640731 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=79879) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 05:20:58.640816 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=79880) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 05:20:58.652400 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=79879) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 05:20:58.652590 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=79880) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 05:20:58.666892 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79879) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 05:20:58.667225 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=79879) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 05:20:58.667363 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79880) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 05:20:58.667473 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=79879) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 05:20:58.667551 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=79880) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 05:20:58.667658 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=79879) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 05:20:58.667751 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=79880) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 05:20:58.667831 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=79879) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 05:20:58.667894 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=79880) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 05:20:58.667969 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=79879) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 05:20:58.668043 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=79880) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 05:20:58.668156 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=79879) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 05:20:58.668262 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=79880) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 05:20:58.668452 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=79880) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 05:20:58.685315 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=79879) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 05:20:58.685455 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=79880) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 05:20:58.685524 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=79879) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 10 05:20:58.685626 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=79880) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 10 05:20:58.685839 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=79879) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 05:20:58.685965 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=79880) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 05:20:58.686047 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=79879) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 10 05:20:58.686124 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=79880) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 10 05:20:58.686291 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=79879) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 05:20:58.686429 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=79880) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 05:20:58.686514 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=79879) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 05:20:58.686628 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=79880) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 05:20:58.686785 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=79879) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 05:20:58.686910 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=79880) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 05:20:58.687005 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=79879) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 05:20:58.687166 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=79880) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 05:20:58.697966 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=79879) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 05:20:58.698177 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=79880) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 05:20:58.698303 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=79879) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 05:20:58.698428 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=79880) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 05:20:58.698542 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=79879) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 05:20:58.698723 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=79880) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 05:20:58.698849 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=79879) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 05:20:58.699014 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=79880) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 05:20:58.706780 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=79879) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 05:20:58.707067 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=79880) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 05:20:58.710064 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=79879) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 05:20:58.710341 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=79879) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 05:20:58.710465 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=79880) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 05:20:58.710627 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=79879) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 05:20:58.710772 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=79880) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 05:20:58.710900 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=79880) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 05:20:58.710991 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=79879) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 05:20:58.711270 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=79879) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 05:20:58.711393 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=79880) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 05:20:58.711490 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=79879) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 05:20:58.711610 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=79880) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 05:20:58.711813 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=79879) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 05:20:58.711939 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=79880) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 05:20:58.712058 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=79879) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 05:20:58.712151 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=79880) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 05:20:58.712350 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=79879) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 05:20:58.712475 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=79880) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 05:20:58.712583 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=79879) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 05:20:58.712672 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=79880) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 05:20:58.712875 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=79879) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 05:20:58.713015 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=79880) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 05:20:58.713100 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=79880) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 05:20:58.740100 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=79880) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 05:20:58.740306 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=79879) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 05:20:58.741742 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=79880) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 05:20:58.741924 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=79879) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 05:20:58.742081 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=79880) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 05:20:58.742211 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=79879) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 05:20:58.747607 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=79880) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 05:20:58.747790 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=79879) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 05:20:58.747942 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=79880) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 05:20:58.748086 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=79879) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 05:20:58.748346 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=79879) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 05:20:58.748534 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=79880) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 05:20:58.755749 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=79879) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 05:20:58.755940 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=79880) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 05:20:58.756140 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=79879) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 05:20:58.756360 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=79880) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 05:20:58.760595 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=79879) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 05:20:58.760780 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=79880) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 05:20:58.760915 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=79879) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 05:20:58.761071 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=79880) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 05:20:58.761237 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=79879) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 05:20:58.761370 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=79880) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 05:20:58.761495 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=79879) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 05:20:58.761622 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=79880) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 05:20:58.761795 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=79879) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 05:20:58.762008 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=79880) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 05:20:58.762211 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=79879) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 05:20:58.762413 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=79880) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 05:20:58.762622 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=79879) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 05:20:58.762841 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=79880) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 05:20:58.763059 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=79879) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 05:20:58.763264 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=79880) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 05:20:58.781021 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=79879) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 05:20:58.781299 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=79879) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 05:20:58.782038 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=79880) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 05:20:58.782321 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=79880) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 05:20:58.785769 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=79879) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 05:20:58.786822 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=79880) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 05:20:58.789437 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=79879) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 05:20:58.789720 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=79879) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 05:20:58.790547 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=79880) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 05:20:58.790850 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=79880) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 05:20:58.794640 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=79879) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 05:20:58.795813 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=79880) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 05:20:58.798194 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=79879) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 05:20:58.799359 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=79880) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 05:20:58.801891 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=79879) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 05:20:58.802184 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=79879) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 05:20:58.802460 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=79879) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 05:20:58.802739 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=79879) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 05:20:58.803015 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=79879) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 05:20:58.803289 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=79880) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 05:20:58.803431 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=79879) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 05:20:58.803560 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=79880) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 05:20:58.803721 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=79880) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 05:20:58.803961 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=79880) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 05:20:58.804238 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=79880) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 05:20:58.804518 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=79880) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 05:20:58.822370 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=79879) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 05:20:58.822742 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=79879) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 05:20:58.823006 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=79879) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 05:20:58.823275 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=79879) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 05:20:58.823526 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=79880) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 05:20:58.823933 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=79880) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 05:20:58.824204 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=79880) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 05:20:58.824421 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=79880) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 05:20:58.831075 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=79879) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 05:20:58.832285 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=79880) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 05:20:58.832802 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=79879) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 05:20:58.833076 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=79879) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 05:20:58.833993 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=79880) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 05:20:58.834281 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=79880) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 05:20:58.836197 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=79879) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 05:20:58.836464 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=79879) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 05:20:58.836745 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=79879) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 05:20:58.837017 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=79879) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 05:20:58.837286 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=79879) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 05:20:58.837484 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=79880) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 05:20:58.837785 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=79880) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 05:20:58.838071 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=79880) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 05:20:58.838425 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=79880) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 05:20:58.838585 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=79880) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 05:20:58.850629 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=79879) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 05:20:58.850902 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=79879) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 05:20:58.851172 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=79879) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 05:20:58.851459 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=79879) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 05:20:58.851769 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=79879) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 05:20:58.851973 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=79880) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 05:20:58.852112 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=79879) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 05:20:58.852240 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=79880) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 05:20:58.852365 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=79879) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 05:20:58.852488 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=79880) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 05:20:58.852807 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=79880) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 05:20:58.853086 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=79880) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 05:20:58.853386 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=79880) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 05:20:58.853674 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=79880) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 05:20:58.870056 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=79879) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 05:20:58.872009 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=79880) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 05:20:58.873784 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=79879) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 05:20:58.875268 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=79880) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 05:20:58.877074 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=79879) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 05:20:58.878564 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=79880) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 05:20:58.878771 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=79879) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 05:20:58.880168 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=79880) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 05:20:58.880351 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=79879) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 05:20:58.880605 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=79879) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 05:20:58.880890 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=79879) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 05:20:58.881828 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=79880) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 05:20:58.882105 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=79880) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 05:20:58.882397 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=79880) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 05:20:58.888286 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=79879) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 05:20:58.889802 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=79880) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 05:20:58.889983 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=79879) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 05:20:58.891393 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=79880) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 05:20:58.893087 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=79879) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 05:20:58.893367 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=79879) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 05:20:58.893642 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=79879) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 05:20:58.893915 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=79879) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 05:20:58.894617 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=79880) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 05:20:58.894905 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=79880) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 05:20:58.895191 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=79880) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 05:20:58.895467 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=79880) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 05:20:58.903074 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=79879) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 05:20:58.903347 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=79879) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 05:20:58.903629 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=79879) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 05:20:58.904701 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=79880) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 05:20:58.904991 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=79880) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 05:20:58.905270 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=79880) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 05:20:58.911389 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=79879) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 05:20:58.911696 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=79879) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 05:20:58.911967 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=79879) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 05:20:58.912238 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=79879) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 05:20:58.912536 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=79879) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 05:20:58.912818 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=79879) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 05:20:58.913083 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=79879) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 05:20:58.913288 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=79880) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 05:20:58.913494 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=79879) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 05:20:58.913648 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=79880) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 05:20:58.913773 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=79879) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 05:20:58.913909 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=79880) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 05:20:58.914044 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=79879) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 05:20:58.914171 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=79880) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 05:20:58.914294 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=79879) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 05:20:58.914425 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=79880) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 05:20:58.914610 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=79879) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 05:20:58.914736 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=79880) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 05:20:58.914892 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=79879) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 05:20:58.915017 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=79880) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 05:20:58.915140 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=79879) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 05:20:58.915273 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=79880) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 05:20:58.915397 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=79880) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 05:20:58.915604 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=79880) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 05:20:58.915896 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=79880) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 05:20:58.916171 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=79880) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 05:20:58.916435 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=79880) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 05:20:58.916704 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=79880) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 05:20:58.953288 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55f25a5e09c0 pid: 79879 (default app) May 10 05:20:58.955194 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55f25a5e09c0 pid: 79880 (default app) May 10 05:20:58.956799 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d1d50a-663c-4e52-857f-e769447eac8c None None] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:20:58.957089 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d1d50a-663c-4e52-857f-e769447eac8c None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:20:58.957373 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d1d50a-663c-4e52-857f-e769447eac8c None None] PATH_INFO: `/v3` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:20:58.961666 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1/1] 10.222.0.23 () {50 vars in 791 bytes} [Tue May 10 05:20:58 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:21:06.820605 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c49afa3-a99a-4b71-b4de-1934587ba14e None None] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:21:06.821176 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c49afa3-a99a-4b71-b4de-1934587ba14e None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:21:06.821176 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c49afa3-a99a-4b71-b4de-1934587ba14e None None] PATH_INFO: `/` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:21:06.825604 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1/2] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 10 05:21:06 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 05:21:06.831006 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de5bda8-bb80-4e89-8c41-71190bfd55aa None None] REQUEST_METHOD: `POST` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:21:06.831466 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de5bda8-bb80-4e89-8c41-71190bfd55aa None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:21:06.831560 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de5bda8-bb80-4e89-8c41-71190bfd55aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:21:06.863056 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG oslo_db.sqlalchemy.engines [None req-3de5bda8-bb80-4e89-8c41-71190bfd55aa None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=79879) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 10 05:21:07.045017 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG passlib.handlers.bcrypt [None req-3de5bda8-bb80-4e89-8c41-71190bfd55aa None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=79879) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} May 10 05:21:07.045421 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG passlib.handlers.bcrypt [None req-3de5bda8-bb80-4e89-8c41-71190bfd55aa None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=79879) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} May 10 05:21:07.100080 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.auth.core [None req-3de5bda8-bb80-4e89-8c41-71190bfd55aa None None] MFA Rules not processed for user `44883b22532e44049d846938dc2cf423`. Rule list: `[]` (Enabled: `True`). {{(pid=79879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:21:07.101631 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-3de5bda8-bb80-4e89-8c41-71190bfd55aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:21:07.225368 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 2/3] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 10 05:21:06 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 395 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) May 10 05:21:07.381734 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c49afa3-a99a-4b71-b4de-1934587ba14e None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:21:07.420812 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG oslo_db.sqlalchemy.engines [None req-3c49afa3-a99a-4b71-b4de-1934587ba14e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=79880) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 10 05:21:07.546196 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c49afa3-a99a-4b71-b4de-1934587ba14e None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:21:07.550910 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac653a02-c0a3-4a73-92ff-be0aa4faeb68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:21:07.551596 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac653a02-c0a3-4a73-92ff-be0aa4faeb68 admin admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:21:07.551890 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac653a02-c0a3-4a73-92ff-be0aa4faeb68 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:21:07.552168 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac653a02-c0a3-4a73-92ff-be0aa4faeb68 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:21:07.560491 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac653a02-c0a3-4a73-92ff-be0aa4faeb68 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:21:07.611482 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: WARNING keystone.common.rbac_enforcer.enforcer [None req-ac653a02-c0a3-4a73-92ff-be0aa4faeb68 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. May 10 05:21:07.611847 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac653a02-c0a3-4a73-92ff-be0aa4faeb68 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:21:07.622132 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 2/4] 10.222.0.23 () {58 vars in 1324 bytes} [Tue May 10 05:21:07 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 241 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 10 05:21:07.628170 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de5bda8-bb80-4e89-8c41-71190bfd55aa None None] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:21:07.642543 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de5bda8-bb80-4e89-8c41-71190bfd55aa None None] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:21:07.647418 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9ad930-4e07-4a0d-8032-e75aed2cc5f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:21:07.648572 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9ad930-4e07-4a0d-8032-e75aed2cc5f5 admin admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:21:07.648857 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9ad930-4e07-4a0d-8032-e75aed2cc5f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:21:07.649135 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9ad930-4e07-4a0d-8032-e75aed2cc5f5 admin admin] PATH_INFO: `/v3/projects/3a8435696f504d709a504bf384af26ea` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:21:07.650693 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9ad930-4e07-4a0d-8032-e75aed2cc5f5 admin admin] RBAC: Authorizing `identity:get_project(project_id=3a8435696f504d709a504bf384af26ea)` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:21:07.700319 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: WARNING keystone.common.rbac_enforcer.enforcer [None req-bd9ad930-4e07-4a0d-8032-e75aed2cc5f5 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. May 10 05:21:07.700654 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9ad930-4e07-4a0d-8032-e75aed2cc5f5 admin admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:21:07.705222 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 3/5] 10.222.0.23 () {56 vars in 1207 bytes} [Tue May 10 05:21:07 2022] GET /identity/v3/projects/3a8435696f504d709a504bf384af26ea => generated 344 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:21:09.891160 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9510bd-a587-4661-85c5-eb176eb879f5 None None] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:21:09.892098 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9510bd-a587-4661-85c5-eb176eb879f5 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:21:09.892098 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9510bd-a587-4661-85c5-eb176eb879f5 None None] PATH_INFO: `/` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:21:09.898880 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 3/6] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 10 05:21:09 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 05:21:09.904785 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e025bf-ae95-43d6-9ccb-f859d887e4ee None None] REQUEST_METHOD: `POST` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:21:09.905199 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e025bf-ae95-43d6-9ccb-f859d887e4ee None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:21:09.905306 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e025bf-ae95-43d6-9ccb-f859d887e4ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:21:09.926353 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.auth.core [None req-d4e025bf-ae95-43d6-9ccb-f859d887e4ee None None] MFA Rules not processed for user `44883b22532e44049d846938dc2cf423`. Rule list: `[]` (Enabled: `True`). {{(pid=79879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:21:09.927929 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-d4e025bf-ae95-43d6-9ccb-f859d887e4ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:21:09.936355 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 4/7] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 10 05:21:09 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) May 10 05:21:09.959002 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9510bd-a587-4661-85c5-eb176eb879f5 None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:21:09.978582 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9510bd-a587-4661-85c5-eb176eb879f5 None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:21:09.984018 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d71724-2f04-4341-b103-44f3d5e7edfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:21:09.984658 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d71724-2f04-4341-b103-44f3d5e7edfd admin admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:21:09.984943 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d71724-2f04-4341-b103-44f3d5e7edfd admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:21:09.985199 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d71724-2f04-4341-b103-44f3d5e7edfd admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:21:09.992919 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d71724-2f04-4341-b103-44f3d5e7edfd admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:21:09.994713 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d71724-2f04-4341-b103-44f3d5e7edfd admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:21:10.003687 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 4/8] 10.222.0.23 () {58 vars in 1324 bytes} [Tue May 10 05:21:09 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 10 05:21:10.011644 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e025bf-ae95-43d6-9ccb-f859d887e4ee None None] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:21:10.026293 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e025bf-ae95-43d6-9ccb-f859d887e4ee None None] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:21:10.035223 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be6f57a-bbee-4957-b1b3-b3dcbc4a39cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:21:10.036598 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be6f57a-bbee-4957-b1b3-b3dcbc4a39cb admin admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:21:10.036993 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be6f57a-bbee-4957-b1b3-b3dcbc4a39cb admin admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:21:10.037356 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be6f57a-bbee-4957-b1b3-b3dcbc4a39cb admin admin] PATH_INFO: `/v3/users/44883b22532e44049d846938dc2cf423` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:21:10.038906 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be6f57a-bbee-4957-b1b3-b3dcbc4a39cb admin admin] RBAC: Authorizing `identity:get_user(user_id=44883b22532e44049d846938dc2cf423)` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:21:10.040784 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be6f57a-bbee-4957-b1b3-b3dcbc4a39cb admin admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:21:10.042359 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 5/9] 10.222.0.23 () {56 vars in 1198 bytes} [Tue May 10 05:21:10 2022] GET /identity/v3/users/44883b22532e44049d846938dc2cf423 => generated 247 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:21:12.276452 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e050a5-1e99-4222-ba75-0f4b4eed8f7c None None] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:21:12.277052 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e050a5-1e99-4222-ba75-0f4b4eed8f7c None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:21:12.277052 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e050a5-1e99-4222-ba75-0f4b4eed8f7c None None] PATH_INFO: `/` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:21:12.278359 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 5/10] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 10 05:21:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 05:21:12.283606 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03a60d0-fcce-4c96-8c58-7cf1db556c99 None None] REQUEST_METHOD: `POST` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:21:12.284050 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03a60d0-fcce-4c96-8c58-7cf1db556c99 None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:21:12.284175 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03a60d0-fcce-4c96-8c58-7cf1db556c99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:21:12.345963 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d88d61-0f74-4434-ad1c-6e8b1920807c None None] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:21:12.346218 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d88d61-0f74-4434-ad1c-6e8b1920807c None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:21:12.346519 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d88d61-0f74-4434-ad1c-6e8b1920807c None None] PATH_INFO: `/` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:21:12.347924 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 6/11] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 10 05:21:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 05:21:12.354328 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6544e82c-7d18-480d-acfa-1df36496b3d7 None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:21:12.354597 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6544e82c-7d18-480d-acfa-1df36496b3d7 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:21:12.354876 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6544e82c-7d18-480d-acfa-1df36496b3d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:21:12.397063 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG passlib.handlers.bcrypt [None req-6544e82c-7d18-480d-acfa-1df36496b3d7 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=79880) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} May 10 05:21:12.397496 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG passlib.handlers.bcrypt [None req-6544e82c-7d18-480d-acfa-1df36496b3d7 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=79880) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} May 10 05:21:12.415294 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.auth.core [None req-d03a60d0-fcce-4c96-8c58-7cf1db556c99 None None] MFA Rules not processed for user `44883b22532e44049d846938dc2cf423`. Rule list: `[]` (Enabled: `True`). {{(pid=79879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:21:12.416527 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-d03a60d0-fcce-4c96-8c58-7cf1db556c99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:21:12.444278 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-6544e82c-7d18-480d-acfa-1df36496b3d7 None None] MFA Rules not processed for user `44883b22532e44049d846938dc2cf423`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:21:12.445870 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-6544e82c-7d18-480d-acfa-1df36496b3d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:21:12.500632 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 6/12] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 10 05:21:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 05:21:12.523429 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03a60d0-fcce-4c96-8c58-7cf1db556c99 None None] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:21:12.545059 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 7/13] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 10 05:21:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 05:21:12.566776 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6544e82c-7d18-480d-acfa-1df36496b3d7 None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:21:12.624562 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03a60d0-fcce-4c96-8c58-7cf1db556c99 None None] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:21:12.659922 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f62b412-6104-4f57-8f69-fd495f372824 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:21:12.660723 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f62b412-6104-4f57-8f69-fd495f372824 None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:21:12.661003 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f62b412-6104-4f57-8f69-fd495f372824 None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:21:12.661273 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f62b412-6104-4f57-8f69-fd495f372824 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:21:12.670419 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6544e82c-7d18-480d-acfa-1df36496b3d7 None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:21:12.672133 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f62b412-6104-4f57-8f69-fd495f372824 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 05:21:12.683274 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application [None req-2f62b412-6104-4f57-8f69-fd495f372824 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 10 05:21:12.683274 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 05:21:12.683274 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 05:21:12.683274 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 05:21:12.683274 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 05:21:12.683274 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 05:21:12.683274 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 05:21:12.683274 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 05:21:12.683274 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 05:21:12.683274 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 05:21:12.683274 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 05:21:12.683274 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 05:21:12.683274 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 05:21:12.683274 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 05:21:12.683274 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 05:21:12.683274 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 05:21:12.684339 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 05:21:12.684339 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 05:21:12.684339 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 05:21:12.684339 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 05:21:12.684339 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 05:21:12.684339 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 05:21:12.684339 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 05:21:12.684339 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 05:21:12.684339 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 05:21:12.684339 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.get_or_create( May 10 05:21:12.684339 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 05:21:12.684339 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application with Lock( May 10 05:21:12.684339 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 05:21:12.684339 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self._enter() May 10 05:21:12.684339 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 05:21:12.684339 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 05:21:12.685153 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 05:21:12.685153 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.creator() May 10 05:21:12.685153 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 05:21:12.685153 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application created_value = creator( May 10 05:21:12.685153 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 05:21:12.685153 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 05:21:12.685153 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 05:21:12.685153 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 05:21:12.685153 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 05:21:12.685153 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 05:21:12.685153 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 10 05:21:12.685153 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application May 10 05:21:12.687939 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 7/14] 10.222.0.23 () {56 vars in 1096 bytes} [Tue May 10 05:21:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 05:21:12.690270 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f62b412-6104-4f57-8f69-fd495f372824 None admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:21:12.702366 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068ef4d2-57a9-4059-87a1-2ea59abdb255 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:21:12.703289 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068ef4d2-57a9-4059-87a1-2ea59abdb255 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:21:12.703609 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068ef4d2-57a9-4059-87a1-2ea59abdb255 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:21:12.703903 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068ef4d2-57a9-4059-87a1-2ea59abdb255 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:21:12.775326 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068ef4d2-57a9-4059-87a1-2ea59abdb255 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:21:12.776905 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068ef4d2-57a9-4059-87a1-2ea59abdb255 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:21:12.791029 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f62b412-6104-4f57-8f69-fd495f372824 None admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:21:12.823235 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4070f086-87a9-4e56-8e7a-8b8ec66ee057 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:21:12.823890 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4070f086-87a9-4e56-8e7a-8b8ec66ee057 None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:21:12.824169 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4070f086-87a9-4e56-8e7a-8b8ec66ee057 None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:21:12.824458 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4070f086-87a9-4e56-8e7a-8b8ec66ee057 None admin] PATH_INFO: `/v3/roles` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:21:12.825206 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4070f086-87a9-4e56-8e7a-8b8ec66ee057 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:21:12.825518 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4070f086-87a9-4e56-8e7a-8b8ec66ee057 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:21:12.826943 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4070f086-87a9-4e56-8e7a-8b8ec66ee057 None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:21:12.838620 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 8/15] 10.222.0.23 () {56 vars in 1099 bytes} [Tue May 10 05:21:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 05:21:12.844458 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4070f086-87a9-4e56-8e7a-8b8ec66ee057 None admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:21:12.872969 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 8/16] 10.222.0.23 () {58 vars in 1282 bytes} [Tue May 10 05:21:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 10 05:21:12.878567 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068ef4d2-57a9-4059-87a1-2ea59abdb255 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:21:12.941349 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4070f086-87a9-4e56-8e7a-8b8ec66ee057 None admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:21:12.975566 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068ef4d2-57a9-4059-87a1-2ea59abdb255 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:21:12.976389 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f23793-18b9-43a4-9cda-87f1f5aac07c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:21:12.977316 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f23793-18b9-43a4-9cda-87f1f5aac07c None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:21:12.977600 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f23793-18b9-43a4-9cda-87f1f5aac07c None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:21:12.977877 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f23793-18b9-43a4-9cda-87f1f5aac07c None admin] PATH_INFO: `/v3/users/44883b22532e44049d846938dc2cf423` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:21:12.979197 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f23793-18b9-43a4-9cda-87f1f5aac07c None admin] RBAC: Authorizing `identity:get_user(user_id=44883b22532e44049d846938dc2cf423)` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:21:12.980705 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f23793-18b9-43a4-9cda-87f1f5aac07c None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:21:12.982328 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 9/17] 10.222.0.23 () {56 vars in 1177 bytes} [Tue May 10 05:21:12 2022] GET /identity/v3/users/44883b22532e44049d846938dc2cf423 => generated 247 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 05:21:12.987815 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f23793-18b9-43a4-9cda-87f1f5aac07c None admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:21:13.009110 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59524e1-5cad-43a5-9740-513cb12ca516 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:21:13.009917 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59524e1-5cad-43a5-9740-513cb12ca516 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:21:13.010203 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59524e1-5cad-43a5-9740-513cb12ca516 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:21:13.010479 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59524e1-5cad-43a5-9740-513cb12ca516 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:21:13.092344 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f23793-18b9-43a4-9cda-87f1f5aac07c None admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:21:13.131478 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401aaf29-9471-4700-8dd8-e17867dd1289 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:21:13.132315 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401aaf29-9471-4700-8dd8-e17867dd1289 None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:21:13.132598 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401aaf29-9471-4700-8dd8-e17867dd1289 None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:21:13.132873 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401aaf29-9471-4700-8dd8-e17867dd1289 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:21:13.134107 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401aaf29-9471-4700-8dd8-e17867dd1289 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:21:13.135597 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401aaf29-9471-4700-8dd8-e17867dd1289 None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:21:13.137222 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 10/18] 10.222.0.23 () {56 vars in 1108 bytes} [Tue May 10 05:21:12 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 05:21:13.141503 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59524e1-5cad-43a5-9740-513cb12ca516 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:21:13.142944 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59524e1-5cad-43a5-9740-513cb12ca516 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:21:13.143676 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401aaf29-9471-4700-8dd8-e17867dd1289 None admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:21:13.163645 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application [None req-f59524e1-5cad-43a5-9740-513cb12ca516 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 05:21:13.163645 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 05:21:13.163645 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 05:21:13.163645 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 05:21:13.163645 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 05:21:13.163645 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 05:21:13.163645 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 05:21:13.163645 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 05:21:13.163645 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 05:21:13.163645 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 05:21:13.163645 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 05:21:13.163645 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 05:21:13.163645 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 05:21:13.163645 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 05:21:13.163645 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 05:21:13.164530 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 05:21:13.164530 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 05:21:13.164530 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 05:21:13.164530 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 05:21:13.164530 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 05:21:13.164530 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 05:21:13.164530 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.get_or_create( May 10 05:21:13.164530 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 05:21:13.164530 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application with Lock( May 10 05:21:13.164530 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 05:21:13.164530 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._enter() May 10 05:21:13.164530 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 05:21:13.164530 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 05:21:13.164530 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 05:21:13.164530 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.creator() May 10 05:21:13.164530 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 05:21:13.164530 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application created_value = creator( May 10 05:21:13.165333 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 05:21:13.165333 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 05:21:13.165333 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 05:21:13.165333 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application May 10 05:21:13.165333 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 9/19] 10.222.0.23 () {56 vars in 1108 bytes} [Tue May 10 05:21:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 05:21:13.170964 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59524e1-5cad-43a5-9740-513cb12ca516 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:21:13.238719 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401aaf29-9471-4700-8dd8-e17867dd1289 None admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:21:13.266236 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59524e1-5cad-43a5-9740-513cb12ca516 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:21:13.270134 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa7736b-11f6-4f1d-8aed-cea554808953 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:21:13.270789 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa7736b-11f6-4f1d-8aed-cea554808953 None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:21:13.271070 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa7736b-11f6-4f1d-8aed-cea554808953 None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:21:13.271342 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa7736b-11f6-4f1d-8aed-cea554808953 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:21:13.272260 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa7736b-11f6-4f1d-8aed-cea554808953 None admin] RBAC: Adding query filter params (role.id=199ac1dd842441d7913c6ee89d8fbecc, scope.domain.id=default, user.id=44883b22532e44049d846938dc2cf423) {{(pid=79879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:21:13.272574 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa7736b-11f6-4f1d-8aed-cea554808953 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:21:13.274046 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa7736b-11f6-4f1d-8aed-cea554808953 None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:21:13.280577 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 11/20] 10.222.0.23 () {56 vars in 1322 bytes} [Tue May 10 05:21:13 2022] GET /identity/v3/role_assignments?user.id=44883b22532e44049d846938dc2cf423&scope.domain.id=default&role.id=199ac1dd842441d7913c6ee89d8fbecc => generated 233 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:21:13.299903 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8761f090-e389-4d52-bff4-06b01a80de21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:21:13.300573 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8761f090-e389-4d52-bff4-06b01a80de21 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:21:13.300886 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8761f090-e389-4d52-bff4-06b01a80de21 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:21:13.301164 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8761f090-e389-4d52-bff4-06b01a80de21 None admin] PATH_INFO: `/v3/domains` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:21:13.301930 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8761f090-e389-4d52-bff4-06b01a80de21 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:21:13.302233 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8761f090-e389-4d52-bff4-06b01a80de21 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:21:13.303817 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8761f090-e389-4d52-bff4-06b01a80de21 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:21:13.324178 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 10/21] 10.222.0.23 () {56 vars in 1109 bytes} [Tue May 10 05:21:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 05:21:15.785429 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f25ee7-56e1-416a-ae1b-6f9cf8575ead None None] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:21:15.786431 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f25ee7-56e1-416a-ae1b-6f9cf8575ead None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:21:15.786906 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f25ee7-56e1-416a-ae1b-6f9cf8575ead None None] PATH_INFO: `/` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:21:15.788978 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 12/22] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 10 05:21:15 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 05:21:15.795288 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc096b0-56e4-409e-850f-3889ee85c001 None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:21:15.795794 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc096b0-56e4-409e-850f-3889ee85c001 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:21:15.795867 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc096b0-56e4-409e-850f-3889ee85c001 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:21:15.819456 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-5cc096b0-56e4-409e-850f-3889ee85c001 None None] MFA Rules not processed for user `44883b22532e44049d846938dc2cf423`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:21:15.820693 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-5cc096b0-56e4-409e-850f-3889ee85c001 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:21:15.909106 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 11/23] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 10 05:21:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 05:21:15.943658 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f25ee7-56e1-416a-ae1b-6f9cf8575ead None None] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:21:16.082829 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f25ee7-56e1-416a-ae1b-6f9cf8575ead None None] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:21:16.106955 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8f1252-61b4-4b1d-88b7-ee7561c0c164 None None] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:21:16.107411 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8f1252-61b4-4b1d-88b7-ee7561c0c164 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:21:16.107836 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8f1252-61b4-4b1d-88b7-ee7561c0c164 None None] PATH_INFO: `/` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:21:16.109572 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 12/24] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 10 05:21:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 05:21:16.116783 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d78843a-0e11-4eaf-a16f-26bac1cd385c None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:21:16.117203 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d78843a-0e11-4eaf-a16f-26bac1cd385c None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:21:16.117586 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d78843a-0e11-4eaf-a16f-26bac1cd385c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:21:16.128404 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a81786-13ff-4d31-84e6-310981d7817c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:21:16.129430 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a81786-13ff-4d31-84e6-310981d7817c None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:21:16.129865 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a81786-13ff-4d31-84e6-310981d7817c None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:21:16.130304 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a81786-13ff-4d31-84e6-310981d7817c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:21:16.138149 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-5d78843a-0e11-4eaf-a16f-26bac1cd385c None None] MFA Rules not processed for user `44883b22532e44049d846938dc2cf423`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:21:16.139764 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-5d78843a-0e11-4eaf-a16f-26bac1cd385c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:21:16.154772 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a81786-13ff-4d31-84e6-310981d7817c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 05:21:16.169687 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application [None req-14a81786-13ff-4d31-84e6-310981d7817c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 10 05:21:16.169687 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 05:21:16.169687 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 05:21:16.169687 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 05:21:16.169687 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 05:21:16.169687 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 05:21:16.169687 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 05:21:16.169687 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 05:21:16.169687 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 05:21:16.169687 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 05:21:16.169687 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 05:21:16.169687 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 05:21:16.169687 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 05:21:16.169687 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 05:21:16.169687 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 05:21:16.169687 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 05:21:16.170631 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 05:21:16.170631 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 05:21:16.170631 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 05:21:16.170631 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 05:21:16.170631 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 05:21:16.170631 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 05:21:16.170631 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 05:21:16.170631 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 05:21:16.170631 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 05:21:16.170631 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.get_or_create( May 10 05:21:16.170631 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 05:21:16.170631 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application with Lock( May 10 05:21:16.170631 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 05:21:16.170631 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self._enter() May 10 05:21:16.170631 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 05:21:16.170631 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 05:21:16.171375 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 05:21:16.171375 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.creator() May 10 05:21:16.171375 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 05:21:16.171375 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application created_value = creator( May 10 05:21:16.171375 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 05:21:16.171375 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 05:21:16.171375 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 05:21:16.171375 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 05:21:16.171375 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 05:21:16.171375 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 05:21:16.171375 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 10 05:21:16.171375 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application May 10 05:21:16.175656 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 13/25] 10.222.0.23 () {56 vars in 1096 bytes} [Tue May 10 05:21:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 05:21:16.181841 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a81786-13ff-4d31-84e6-310981d7817c None admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:21:16.275705 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 13/26] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 10 05:21:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 10 05:21:16.348763 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a81786-13ff-4d31-84e6-310981d7817c None admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:21:16.380880 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d78843a-0e11-4eaf-a16f-26bac1cd385c None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:21:16.388251 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5f11c7-5fe9-40e3-9307-7b59241cb448 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:21:16.388940 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5f11c7-5fe9-40e3-9307-7b59241cb448 None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:21:16.389224 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5f11c7-5fe9-40e3-9307-7b59241cb448 None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:21:16.389504 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5f11c7-5fe9-40e3-9307-7b59241cb448 None admin] PATH_INFO: `/v3/roles` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:21:16.390266 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5f11c7-5fe9-40e3-9307-7b59241cb448 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:21:16.390582 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5f11c7-5fe9-40e3-9307-7b59241cb448 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:21:16.392019 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5f11c7-5fe9-40e3-9307-7b59241cb448 None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:21:16.401230 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 14/27] 10.222.0.23 () {56 vars in 1099 bytes} [Tue May 10 05:21:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:21:16.407544 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5f11c7-5fe9-40e3-9307-7b59241cb448 None admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:21:16.519028 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5f11c7-5fe9-40e3-9307-7b59241cb448 None admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:21:16.555168 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f01c034-d9f2-4584-a986-761480800ebf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:21:16.556768 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f01c034-d9f2-4584-a986-761480800ebf None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:21:16.557352 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f01c034-d9f2-4584-a986-761480800ebf None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:21:16.557929 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f01c034-d9f2-4584-a986-761480800ebf None admin] PATH_INFO: `/v3/users/44883b22532e44049d846938dc2cf423` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:21:16.559328 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f01c034-d9f2-4584-a986-761480800ebf None admin] RBAC: Authorizing `identity:get_user(user_id=44883b22532e44049d846938dc2cf423)` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:21:16.561198 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f01c034-d9f2-4584-a986-761480800ebf None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:21:16.563532 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 15/28] 10.222.0.23 () {56 vars in 1177 bytes} [Tue May 10 05:21:16 2022] GET /identity/v3/users/44883b22532e44049d846938dc2cf423 => generated 247 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 05:21:16.565118 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611439e8-b173-4e71-bad6-c91c4538f912 None None] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:21:16.565624 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611439e8-b173-4e71-bad6-c91c4538f912 None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:21:16.566113 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611439e8-b173-4e71-bad6-c91c4538f912 None None] PATH_INFO: `/` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:21:16.567993 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 16/29] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 10 05:21:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 05:21:16.576971 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8939b863-00c2-4aeb-b098-c3774568b619 None None] REQUEST_METHOD: `POST` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:21:16.577590 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8939b863-00c2-4aeb-b098-c3774568b619 None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:21:16.578065 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8939b863-00c2-4aeb-b098-c3774568b619 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:21:16.599989 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.auth.core [None req-8939b863-00c2-4aeb-b098-c3774568b619 None None] MFA Rules not processed for user `44883b22532e44049d846938dc2cf423`. Rule list: `[]` (Enabled: `True`). {{(pid=79879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:21:16.600141 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d78843a-0e11-4eaf-a16f-26bac1cd385c None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:21:16.607036 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-8939b863-00c2-4aeb-b098-c3774568b619 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:21:16.635812 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2799e404-9848-4767-9a33-d6c804fa1678 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:21:16.636628 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2799e404-9848-4767-9a33-d6c804fa1678 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:21:16.636901 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2799e404-9848-4767-9a33-d6c804fa1678 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:21:16.637172 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2799e404-9848-4767-9a33-d6c804fa1678 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:21:16.647615 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2799e404-9848-4767-9a33-d6c804fa1678 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:21:16.649195 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2799e404-9848-4767-9a33-d6c804fa1678 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:21:16.666792 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application [None req-2799e404-9848-4767-9a33-d6c804fa1678 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 05:21:16.666792 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 05:21:16.666792 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 05:21:16.666792 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 05:21:16.666792 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 05:21:16.666792 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 05:21:16.666792 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 05:21:16.666792 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 05:21:16.666792 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 05:21:16.666792 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 05:21:16.666792 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 05:21:16.666792 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 05:21:16.666792 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 05:21:16.666792 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 05:21:16.666792 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 05:21:16.667669 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 05:21:16.667669 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 05:21:16.667669 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 05:21:16.667669 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 05:21:16.667669 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 05:21:16.667669 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 05:21:16.667669 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.get_or_create( May 10 05:21:16.667669 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 05:21:16.667669 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application with Lock( May 10 05:21:16.667669 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 05:21:16.667669 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._enter() May 10 05:21:16.667669 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 05:21:16.667669 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 05:21:16.667669 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 05:21:16.667669 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.creator() May 10 05:21:16.667669 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 05:21:16.667669 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application created_value = creator( May 10 05:21:16.668488 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 05:21:16.668488 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 05:21:16.668488 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 05:21:16.668488 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application May 10 05:21:16.668488 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 14/30] 10.222.0.23 () {56 vars in 1108 bytes} [Tue May 10 05:21:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 290 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 05:21:16.669349 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2799e404-9848-4767-9a33-d6c804fa1678 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:21:16.679159 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 17/31] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 10 05:21:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 05:21:16.680814 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea00848-de48-485a-820a-6cf269e26ce5 None None] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:21:16.681304 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea00848-de48-485a-820a-6cf269e26ce5 None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:21:16.681773 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea00848-de48-485a-820a-6cf269e26ce5 None None] PATH_INFO: `/` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:21:16.683557 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 18/32] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 10 05:21:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 05:21:16.684473 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea00848-de48-485a-820a-6cf269e26ce5 None None] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:21:16.767485 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2799e404-9848-4767-9a33-d6c804fa1678 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:21:16.800608 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85692cc6-9af5-4773-a016-27f702e9dec0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:21:16.801434 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85692cc6-9af5-4773-a016-27f702e9dec0 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:21:16.801873 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85692cc6-9af5-4773-a016-27f702e9dec0 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:21:16.802297 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85692cc6-9af5-4773-a016-27f702e9dec0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:21:16.803941 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85692cc6-9af5-4773-a016-27f702e9dec0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:21:16.805525 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85692cc6-9af5-4773-a016-27f702e9dec0 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:21:16.807655 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 15/33] 10.222.0.23 () {56 vars in 1108 bytes} [Tue May 10 05:21:16 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:21:16.808889 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea00848-de48-485a-820a-6cf269e26ce5 None None] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:21:16.809339 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ef2a10-bb24-43d0-ac4f-87e88dc8d2bd None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:21:16.809339 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ef2a10-bb24-43d0-ac4f-87e88dc8d2bd None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:21:16.809515 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ef2a10-bb24-43d0-ac4f-87e88dc8d2bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:21:16.826094 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-86ef2a10-bb24-43d0-ac4f-87e88dc8d2bd None None] MFA Rules not processed for user `44883b22532e44049d846938dc2cf423`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:21:16.827511 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-86ef2a10-bb24-43d0-ac4f-87e88dc8d2bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:21:16.845538 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03d9f37-545d-4ee1-993f-48f570506810 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:21:16.846302 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03d9f37-545d-4ee1-993f-48f570506810 None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:21:16.846653 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03d9f37-545d-4ee1-993f-48f570506810 None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:21:16.846994 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03d9f37-545d-4ee1-993f-48f570506810 None admin] PATH_INFO: `/v3/domains` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:21:16.847843 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03d9f37-545d-4ee1-993f-48f570506810 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:21:16.848618 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03d9f37-545d-4ee1-993f-48f570506810 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:21:16.849893 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03d9f37-545d-4ee1-993f-48f570506810 None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:21:16.868426 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 19/34] 10.222.0.23 () {56 vars in 1109 bytes} [Tue May 10 05:21:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:21:16.869400 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03d9f37-545d-4ee1-993f-48f570506810 None admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:21:16.894900 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 16/35] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 10 05:21:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 05:21:16.896048 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ef2a10-bb24-43d0-ac4f-87e88dc8d2bd None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:21:16.993242 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ef2a10-bb24-43d0-ac4f-87e88dc8d2bd None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:21:16.994146 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03d9f37-545d-4ee1-993f-48f570506810 None admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:21:17.028488 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4badb2d-f34f-43a7-b6ff-692bd4f2e135 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:21:17.029414 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9348c0d-da2b-438d-a96d-6d1cb0186eaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:21:17.029909 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4badb2d-f34f-43a7-b6ff-692bd4f2e135 None admin] REQUEST_METHOD: `PUT` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:21:17.030091 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9348c0d-da2b-438d-a96d-6d1cb0186eaf None admin] REQUEST_METHOD: `POST` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:21:17.030382 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9348c0d-da2b-438d-a96d-6d1cb0186eaf None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:21:17.030660 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9348c0d-da2b-438d-a96d-6d1cb0186eaf None admin] PATH_INFO: `/v3/roles` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:21:17.030846 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4badb2d-f34f-43a7-b6ff-692bd4f2e135 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:21:17.031289 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4badb2d-f34f-43a7-b6ff-692bd4f2e135 None admin] PATH_INFO: `/v3/domains/default/users/44883b22532e44049d846938dc2cf423/roles/199ac1dd842441d7913c6ee89d8fbecc` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:21:17.031424 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9348c0d-da2b-438d-a96d-6d1cb0186eaf None admin] RBAC: Authorizing `identity:create_role()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:21:17.032948 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9348c0d-da2b-438d-a96d-6d1cb0186eaf None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:21:17.034028 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4badb2d-f34f-43a7-b6ff-692bd4f2e135 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=44883b22532e44049d846938dc2cf423, role_id=199ac1dd842441d7913c6ee89d8fbecc)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:21:17.035671 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4badb2d-f34f-43a7-b6ff-692bd4f2e135 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:21:17.156035 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 20/36] 10.222.0.23 () {60 vars in 1131 bytes} [Tue May 10 05:21:16 2022] POST /identity/v3/roles => generated 225 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 05:21:17.157012 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9348c0d-da2b-438d-a96d-6d1cb0186eaf None admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:21:17.160604 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 17/37] 10.222.0.23 () {58 vars in 1361 bytes} [Tue May 10 05:21:16 2022] PUT /identity/v3/domains/default/users/44883b22532e44049d846938dc2cf423/roles/199ac1dd842441d7913c6ee89d8fbecc => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 05:21:17.163184 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4badb2d-f34f-43a7-b6ff-692bd4f2e135 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:21:17.271055 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9348c0d-da2b-438d-a96d-6d1cb0186eaf None admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:21:17.296087 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4badb2d-f34f-43a7-b6ff-692bd4f2e135 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:21:17.305990 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1843ea03-e009-480b-9e38-f0ceccb9074f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:21:17.306781 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1843ea03-e009-480b-9e38-f0ceccb9074f None admin] REQUEST_METHOD: `POST` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:21:17.307133 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1843ea03-e009-480b-9e38-f0ceccb9074f None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:21:17.307485 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1843ea03-e009-480b-9e38-f0ceccb9074f None admin] PATH_INFO: `/v3/projects` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:21:17.308335 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1843ea03-e009-480b-9e38-f0ceccb9074f None admin] RBAC: Authorizing `identity:create_project()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:21:17.310076 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1843ea03-e009-480b-9e38-f0ceccb9074f None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:21:17.352167 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d691a4-ef3d-4baf-9d08-365f3ced0f5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:21:17.353350 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d691a4-ef3d-4baf-9d08-365f3ced0f5c None admin] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:21:17.353810 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d691a4-ef3d-4baf-9d08-365f3ced0f5c None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:21:17.354353 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d691a4-ef3d-4baf-9d08-365f3ced0f5c None admin] PATH_INFO: `/v3/roles` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:21:17.355468 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d691a4-ef3d-4baf-9d08-365f3ced0f5c None admin] RBAC: Authorizing `identity:create_role()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:21:17.357459 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d691a4-ef3d-4baf-9d08-365f3ced0f5c None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:21:17.359758 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 21/38] 10.222.0.23 () {60 vars in 1141 bytes} [Tue May 10 05:21:17 2022] POST /identity/v3/projects => generated 301 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 05:21:17.381966 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 18/39] 10.222.0.23 () {60 vars in 1131 bytes} [Tue May 10 05:21:17 2022] POST /identity/v3/roles => generated 219 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 05:21:17.462069 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151f690f-832f-4be6-9c00-58d250ffffec None None] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:21:17.462315 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151f690f-832f-4be6-9c00-58d250ffffec None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:21:17.462734 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151f690f-832f-4be6-9c00-58d250ffffec None None] PATH_INFO: `/` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:21:17.464308 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 22/40] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 10 05:21:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 05:21:17.470832 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36517aeb-c92b-40d9-9cff-ca2a1972a3f4 None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:21:17.471124 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36517aeb-c92b-40d9-9cff-ca2a1972a3f4 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:21:17.471405 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36517aeb-c92b-40d9-9cff-ca2a1972a3f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:21:17.497672 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-36517aeb-c92b-40d9-9cff-ca2a1972a3f4 None None] MFA Rules not processed for user `44883b22532e44049d846938dc2cf423`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:21:17.499518 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-36517aeb-c92b-40d9-9cff-ca2a1972a3f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:21:17.586102 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 19/41] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 10 05:21:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 05:21:17.616375 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151f690f-832f-4be6-9c00-58d250ffffec None None] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:21:17.662249 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3aa9d0e-8117-4eb3-b2b8-d5b527fc2bfe None None] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:21:17.662900 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3aa9d0e-8117-4eb3-b2b8-d5b527fc2bfe None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:21:17.663366 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3aa9d0e-8117-4eb3-b2b8-d5b527fc2bfe None None] PATH_INFO: `/` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:21:17.665078 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 20/42] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 10 05:21:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 05:21:17.671424 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ee0be2-d17f-42a2-90ff-89ce18185162 None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:21:17.672051 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ee0be2-d17f-42a2-90ff-89ce18185162 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:21:17.672521 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ee0be2-d17f-42a2-90ff-89ce18185162 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:21:17.698381 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-a9ee0be2-d17f-42a2-90ff-89ce18185162 None None] MFA Rules not processed for user `44883b22532e44049d846938dc2cf423`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:21:17.699950 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-a9ee0be2-d17f-42a2-90ff-89ce18185162 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:21:17.753684 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151f690f-832f-4be6-9c00-58d250ffffec None None] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:21:17.792470 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 21/43] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 10 05:21:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 10 05:21:17.794539 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc335fc2-4c31-4936-bd21-4eacddc3029a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:21:17.795363 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc335fc2-4c31-4936-bd21-4eacddc3029a None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:21:17.795697 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc335fc2-4c31-4936-bd21-4eacddc3029a None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:21:17.795973 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc335fc2-4c31-4936-bd21-4eacddc3029a None admin] PATH_INFO: `/v3/domains/default` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:21:17.797163 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc335fc2-4c31-4936-bd21-4eacddc3029a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:21:17.798645 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc335fc2-4c31-4936-bd21-4eacddc3029a None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:21:17.800426 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 23/44] 10.222.0.23 () {56 vars in 1108 bytes} [Tue May 10 05:21:17 2022] GET /identity/v3/domains/default => generated 199 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:21:17.806367 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ee0be2-d17f-42a2-90ff-89ce18185162 None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:21:17.821527 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc335fc2-4c31-4936-bd21-4eacddc3029a None admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:21:17.908546 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ee0be2-d17f-42a2-90ff-89ce18185162 None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:21:17.918981 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc335fc2-4c31-4936-bd21-4eacddc3029a None admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:21:17.941794 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9326a1f8-6707-4334-965f-dc82623ee00b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:21:17.942474 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9326a1f8-6707-4334-965f-dc82623ee00b None admin] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:21:17.942755 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9326a1f8-6707-4334-965f-dc82623ee00b None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:21:17.943029 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9326a1f8-6707-4334-965f-dc82623ee00b None admin] PATH_INFO: `/v3/projects` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:21:17.943822 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9326a1f8-6707-4334-965f-dc82623ee00b None admin] RBAC: Authorizing `identity:create_project()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:21:17.945299 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9326a1f8-6707-4334-965f-dc82623ee00b None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:21:17.952089 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88de086b-2675-4c81-9a55-e0d84d070526 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:21:17.952784 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88de086b-2675-4c81-9a55-e0d84d070526 None admin] REQUEST_METHOD: `POST` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:21:17.953071 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88de086b-2675-4c81-9a55-e0d84d070526 None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:21:17.953765 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88de086b-2675-4c81-9a55-e0d84d070526 None admin] PATH_INFO: `/v3/roles` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:21:17.954597 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88de086b-2675-4c81-9a55-e0d84d070526 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:21:17.956802 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88de086b-2675-4c81-9a55-e0d84d070526 None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:21:17.971744 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 24/45] 10.222.0.23 () {60 vars in 1131 bytes} [Tue May 10 05:21:17 2022] POST /identity/v3/roles => generated 223 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 05:21:17.983900 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 22/46] 10.222.0.23 () {60 vars in 1141 bytes} [Tue May 10 05:21:17 2022] POST /identity/v3/projects => generated 312 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 05:21:19.690714 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298c76a5-ac26-47d4-80ec-4e97f16a7e4d None None] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:21:19.691265 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298c76a5-ac26-47d4-80ec-4e97f16a7e4d None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:21:19.691265 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298c76a5-ac26-47d4-80ec-4e97f16a7e4d None None] PATH_INFO: `/` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:21:19.692727 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 25/47] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 10 05:21:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 05:21:19.698245 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b33d9a-152c-4e36-bb10-a8804320d2a6 None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:21:19.698660 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b33d9a-152c-4e36-bb10-a8804320d2a6 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:21:19.698908 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b33d9a-152c-4e36-bb10-a8804320d2a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:21:19.716096 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-c1b33d9a-152c-4e36-bb10-a8804320d2a6 None None] MFA Rules not processed for user `44883b22532e44049d846938dc2cf423`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:21:19.717348 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-c1b33d9a-152c-4e36-bb10-a8804320d2a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:21:19.783944 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 23/48] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 10 05:21:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 10 05:21:19.806583 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298c76a5-ac26-47d4-80ec-4e97f16a7e4d None None] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:21:19.909557 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298c76a5-ac26-47d4-80ec-4e97f16a7e4d None None] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:21:19.946081 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923c046f-0bf2-4c27-a789-6e3b9259e4a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:21:19.946899 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923c046f-0bf2-4c27-a789-6e3b9259e4a8 None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:21:19.947187 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923c046f-0bf2-4c27-a789-6e3b9259e4a8 None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:21:19.947468 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923c046f-0bf2-4c27-a789-6e3b9259e4a8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:21:19.957867 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923c046f-0bf2-4c27-a789-6e3b9259e4a8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 05:21:19.965472 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application [None req-923c046f-0bf2-4c27-a789-6e3b9259e4a8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 10 05:21:19.965472 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 05:21:19.965472 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 05:21:19.965472 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 05:21:19.965472 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 05:21:19.965472 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 05:21:19.965472 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 05:21:19.965472 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 05:21:19.965472 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 05:21:19.965472 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 05:21:19.965472 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 05:21:19.965472 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 05:21:19.965472 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 05:21:19.965472 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 05:21:19.965472 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 05:21:19.965472 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 05:21:19.966437 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 05:21:19.966437 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 05:21:19.966437 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 05:21:19.966437 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 05:21:19.966437 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 05:21:19.966437 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 05:21:19.966437 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 05:21:19.966437 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 05:21:19.966437 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 05:21:19.966437 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.get_or_create( May 10 05:21:19.966437 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 05:21:19.966437 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application with Lock( May 10 05:21:19.966437 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 05:21:19.966437 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self._enter() May 10 05:21:19.966437 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 05:21:19.966437 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 05:21:19.967202 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 05:21:19.967202 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.creator() May 10 05:21:19.967202 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 05:21:19.967202 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application created_value = creator( May 10 05:21:19.967202 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 05:21:19.967202 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 05:21:19.967202 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 05:21:19.967202 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 05:21:19.967202 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 05:21:19.967202 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 05:21:19.967202 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 10 05:21:19.967202 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application May 10 05:21:19.967202 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 26/49] 10.222.0.23 () {56 vars in 1096 bytes} [Tue May 10 05:21:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 05:21:19.972949 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b33d9a-152c-4e36-bb10-a8804320d2a6 None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:21:20.075537 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b33d9a-152c-4e36-bb10-a8804320d2a6 None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:21:20.109509 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1deba8b-3f00-4f8d-89e1-c4d5d7ab27d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:21:20.110190 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1deba8b-3f00-4f8d-89e1-c4d5d7ab27d5 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:21:20.110476 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1deba8b-3f00-4f8d-89e1-c4d5d7ab27d5 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:21:20.110759 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1deba8b-3f00-4f8d-89e1-c4d5d7ab27d5 None admin] PATH_INFO: `/v3/roles` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:21:20.111530 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1deba8b-3f00-4f8d-89e1-c4d5d7ab27d5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:21:20.111871 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1deba8b-3f00-4f8d-89e1-c4d5d7ab27d5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:21:20.113274 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1deba8b-3f00-4f8d-89e1-c4d5d7ab27d5 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:21:20.125145 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 24/50] 10.222.0.23 () {56 vars in 1099 bytes} [Tue May 10 05:21:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:21:20.130852 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923c046f-0bf2-4c27-a789-6e3b9259e4a8 None admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:21:20.189765 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467f69e4-a141-4856-94dd-65ed736d1b9a None None] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:21:20.190039 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467f69e4-a141-4856-94dd-65ed736d1b9a None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:21:20.190354 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467f69e4-a141-4856-94dd-65ed736d1b9a None None] PATH_INFO: `/` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:21:20.191754 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 25/51] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 10 05:21:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 05:21:20.196817 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6468edf-cc49-41cc-ab47-e07b31363eda None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:21:20.197113 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6468edf-cc49-41cc-ab47-e07b31363eda None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:21:20.197394 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6468edf-cc49-41cc-ab47-e07b31363eda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:21:20.215001 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-b6468edf-cc49-41cc-ab47-e07b31363eda None None] MFA Rules not processed for user `44883b22532e44049d846938dc2cf423`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:21:20.216241 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-b6468edf-cc49-41cc-ab47-e07b31363eda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:21:20.231195 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923c046f-0bf2-4c27-a789-6e3b9259e4a8 None admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:21:20.274444 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b051233-7aa3-40f8-9b58-466ef7d12bf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:21:20.275333 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b051233-7aa3-40f8-9b58-466ef7d12bf1 None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:21:20.275635 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b051233-7aa3-40f8-9b58-466ef7d12bf1 None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:21:20.275927 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b051233-7aa3-40f8-9b58-466ef7d12bf1 None admin] PATH_INFO: `/v3/users/44883b22532e44049d846938dc2cf423` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:21:20.277178 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b051233-7aa3-40f8-9b58-466ef7d12bf1 None admin] RBAC: Authorizing `identity:get_user(user_id=44883b22532e44049d846938dc2cf423)` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:21:20.278669 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b051233-7aa3-40f8-9b58-466ef7d12bf1 None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:21:20.280621 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 27/52] 10.222.0.23 () {56 vars in 1177 bytes} [Tue May 10 05:21:20 2022] GET /identity/v3/users/44883b22532e44049d846938dc2cf423 => generated 247 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:21:20.285941 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b051233-7aa3-40f8-9b58-466ef7d12bf1 None admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:21:20.291863 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 26/53] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 10 05:21:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 05:21:20.313999 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6468edf-cc49-41cc-ab47-e07b31363eda None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:21:20.381666 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b051233-7aa3-40f8-9b58-466ef7d12bf1 None admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:21:20.408987 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6468edf-cc49-41cc-ab47-e07b31363eda None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:21:20.414557 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f322e7-d4a7-4784-84e3-a468c26e6c38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:21:20.415364 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f322e7-d4a7-4784-84e3-a468c26e6c38 None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:21:20.415682 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f322e7-d4a7-4784-84e3-a468c26e6c38 None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:21:20.415993 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f322e7-d4a7-4784-84e3-a468c26e6c38 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:21:20.417167 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f322e7-d4a7-4784-84e3-a468c26e6c38 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:21:20.418636 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f322e7-d4a7-4784-84e3-a468c26e6c38 None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:21:20.420272 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 28/54] 10.222.0.23 () {56 vars in 1108 bytes} [Tue May 10 05:21:20 2022] GET /identity/v3/domains/default => generated 199 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:21:20.426007 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f322e7-d4a7-4784-84e3-a468c26e6c38 None admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:21:20.442173 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21ddf19-f117-44cb-94f2-49c79b6b3d85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:21:20.442978 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21ddf19-f117-44cb-94f2-49c79b6b3d85 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:21:20.443353 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21ddf19-f117-44cb-94f2-49c79b6b3d85 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:21:20.443599 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21ddf19-f117-44cb-94f2-49c79b6b3d85 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:21:20.444826 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21ddf19-f117-44cb-94f2-49c79b6b3d85 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:21:20.446273 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21ddf19-f117-44cb-94f2-49c79b6b3d85 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:21:20.447929 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 27/55] 10.222.0.23 () {56 vars in 1108 bytes} [Tue May 10 05:21:20 2022] GET /identity/v3/domains/default => generated 199 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:21:20.453486 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21ddf19-f117-44cb-94f2-49c79b6b3d85 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:21:20.524749 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f322e7-d4a7-4784-84e3-a468c26e6c38 None admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:21:20.549579 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21ddf19-f117-44cb-94f2-49c79b6b3d85 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:21:20.565924 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7381aae4-9684-4906-9a43-e38c6fc63f82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:21:20.566592 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7381aae4-9684-4906-9a43-e38c6fc63f82 None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:21:20.566857 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7381aae4-9684-4906-9a43-e38c6fc63f82 None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:21:20.567164 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7381aae4-9684-4906-9a43-e38c6fc63f82 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:21:20.568063 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7381aae4-9684-4906-9a43-e38c6fc63f82 None admin] RBAC: Adding query filter params (role.id=199ac1dd842441d7913c6ee89d8fbecc, scope.domain.id=default, user.id=44883b22532e44049d846938dc2cf423) {{(pid=79879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:21:20.568418 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7381aae4-9684-4906-9a43-e38c6fc63f82 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:21:20.569924 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7381aae4-9684-4906-9a43-e38c6fc63f82 None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:21:20.575789 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 29/56] 10.222.0.23 () {56 vars in 1322 bytes} [Tue May 10 05:21:20 2022] GET /identity/v3/role_assignments?user.id=44883b22532e44049d846938dc2cf423&scope.domain.id=default&role.id=199ac1dd842441d7913c6ee89d8fbecc => generated 530 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 05:21:20.582935 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85248257-f764-46bb-b50f-ac150140b3ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:21:20.583663 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85248257-f764-46bb-b50f-ac150140b3ff None admin] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:21:20.584003 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85248257-f764-46bb-b50f-ac150140b3ff None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:21:20.584283 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85248257-f764-46bb-b50f-ac150140b3ff None admin] PATH_INFO: `/v3/projects` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:21:20.585025 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85248257-f764-46bb-b50f-ac150140b3ff None admin] RBAC: Authorizing `identity:create_project()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:21:20.586555 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85248257-f764-46bb-b50f-ac150140b3ff None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:21:20.615336 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 28/57] 10.222.0.23 () {60 vars in 1140 bytes} [Tue May 10 05:21:20 2022] POST /identity/v3/projects => generated 298 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 05:21:22.869176 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a538494f-6329-41b6-b4e8-6cebcf9f4f36 None None] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:21:22.870014 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a538494f-6329-41b6-b4e8-6cebcf9f4f36 None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:21:22.870014 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a538494f-6329-41b6-b4e8-6cebcf9f4f36 None None] PATH_INFO: `/` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:21:22.872664 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 30/58] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 10 05:21:22 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 05:21:22.879075 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411eb4c4-c57a-4ae3-8fe9-a0b287b38779 None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:21:22.879777 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411eb4c4-c57a-4ae3-8fe9-a0b287b38779 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:21:22.880013 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411eb4c4-c57a-4ae3-8fe9-a0b287b38779 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:21:22.898198 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-411eb4c4-c57a-4ae3-8fe9-a0b287b38779 None None] MFA Rules not processed for user `44883b22532e44049d846938dc2cf423`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:21:22.899387 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-411eb4c4-c57a-4ae3-8fe9-a0b287b38779 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:21:22.966059 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 29/59] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 10 05:21:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 05:21:22.990619 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a538494f-6329-41b6-b4e8-6cebcf9f4f36 None None] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:21:23.108053 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a538494f-6329-41b6-b4e8-6cebcf9f4f36 None None] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:21:23.141779 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12eb6ecf-12a2-4b48-8fd1-a24af83a5122 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:21:23.142492 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12eb6ecf-12a2-4b48-8fd1-a24af83a5122 None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:21:23.142771 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12eb6ecf-12a2-4b48-8fd1-a24af83a5122 None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:21:23.143038 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12eb6ecf-12a2-4b48-8fd1-a24af83a5122 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:21:23.144319 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12eb6ecf-12a2-4b48-8fd1-a24af83a5122 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:21:23.145778 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12eb6ecf-12a2-4b48-8fd1-a24af83a5122 None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:21:23.147468 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 31/60] 10.222.0.23 () {56 vars in 1108 bytes} [Tue May 10 05:21:22 2022] GET /identity/v3/domains/default => generated 199 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:21:23.153708 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411eb4c4-c57a-4ae3-8fe9-a0b287b38779 None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:21:23.260009 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411eb4c4-c57a-4ae3-8fe9-a0b287b38779 None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:21:23.293387 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6be968-c4ce-462f-93bc-3743d2d6d738 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:21:23.294047 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6be968-c4ce-462f-93bc-3743d2d6d738 None admin] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:21:23.294326 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6be968-c4ce-462f-93bc-3743d2d6d738 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:21:23.294603 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6be968-c4ce-462f-93bc-3743d2d6d738 None admin] PATH_INFO: `/v3/users` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:21:23.295315 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6be968-c4ce-462f-93bc-3743d2d6d738 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:21:23.296804 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6be968-c4ce-462f-93bc-3743d2d6d738 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:21:23.324572 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 30/61] 10.222.0.23 () {60 vars in 1132 bytes} [Tue May 10 05:21:23 2022] POST /identity/v3/users => generated 275 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 05:21:26.405150 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db774c17-662f-40a8-ab90-65ee082a7436 None None] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:21:26.406007 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db774c17-662f-40a8-ab90-65ee082a7436 None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:21:26.406422 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db774c17-662f-40a8-ab90-65ee082a7436 None None] PATH_INFO: `/` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:21:26.408255 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 32/62] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 10 05:21:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 05:21:26.413302 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf21eb7-cdbc-408e-a9ad-f4e8187e01d4 None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:21:26.414055 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf21eb7-cdbc-408e-a9ad-f4e8187e01d4 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:21:26.414469 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf21eb7-cdbc-408e-a9ad-f4e8187e01d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:21:26.436557 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-3cf21eb7-cdbc-408e-a9ad-f4e8187e01d4 None None] MFA Rules not processed for user `44883b22532e44049d846938dc2cf423`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:21:26.438031 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-3cf21eb7-cdbc-408e-a9ad-f4e8187e01d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:21:26.513892 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 31/63] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 10 05:21:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 05:21:26.536333 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db774c17-662f-40a8-ab90-65ee082a7436 None None] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:21:26.677271 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db774c17-662f-40a8-ab90-65ee082a7436 None None] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:21:26.726894 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de637dc-1561-4392-998d-868e10bc5c20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:21:26.727735 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de637dc-1561-4392-998d-868e10bc5c20 None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:21:26.728016 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de637dc-1561-4392-998d-868e10bc5c20 None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:21:26.728287 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de637dc-1561-4392-998d-868e10bc5c20 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:21:26.744698 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de637dc-1561-4392-998d-868e10bc5c20 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 05:21:26.753083 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application [None req-5de637dc-1561-4392-998d-868e10bc5c20 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 10 05:21:26.753083 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 05:21:26.753083 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 05:21:26.753083 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 05:21:26.753083 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 05:21:26.753083 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 05:21:26.753083 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 05:21:26.753083 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 05:21:26.753083 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 05:21:26.753083 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 05:21:26.753083 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 05:21:26.753083 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 05:21:26.753083 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 05:21:26.753083 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 05:21:26.753083 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 05:21:26.753083 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 05:21:26.754008 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 05:21:26.754008 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 05:21:26.754008 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 05:21:26.754008 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 05:21:26.754008 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 05:21:26.754008 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 05:21:26.754008 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 05:21:26.754008 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 05:21:26.754008 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 05:21:26.754008 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.get_or_create( May 10 05:21:26.754008 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 05:21:26.754008 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application with Lock( May 10 05:21:26.754008 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 05:21:26.754008 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self._enter() May 10 05:21:26.754008 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 05:21:26.754008 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 05:21:26.755272 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 05:21:26.755272 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.creator() May 10 05:21:26.755272 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 05:21:26.755272 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application created_value = creator( May 10 05:21:26.755272 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 05:21:26.755272 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 05:21:26.755272 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 05:21:26.755272 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 05:21:26.755272 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 05:21:26.755272 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 05:21:26.755272 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 10 05:21:26.755272 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application May 10 05:21:26.755272 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 33/64] 10.222.0.23 () {56 vars in 1099 bytes} [Tue May 10 05:21:26 2022] GET /identity/v3/roles/member => generated 84 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 05:21:26.760690 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf21eb7-cdbc-408e-a9ad-f4e8187e01d4 None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:21:26.797157 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaacdb70-370d-4fc0-a568-5e439aee9750 None None] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:21:26.797486 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaacdb70-370d-4fc0-a568-5e439aee9750 None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:21:26.797708 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaacdb70-370d-4fc0-a568-5e439aee9750 None None] PATH_INFO: `/` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:21:26.799270 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 34/65] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 10 05:21:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 05:21:26.804456 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829cfcec-5e99-4791-aacf-202400c3a5d5 None None] REQUEST_METHOD: `POST` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:21:26.804737 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829cfcec-5e99-4791-aacf-202400c3a5d5 None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:21:26.805014 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829cfcec-5e99-4791-aacf-202400c3a5d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:21:26.831158 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.auth.core [None req-829cfcec-5e99-4791-aacf-202400c3a5d5 None None] MFA Rules not processed for user `44883b22532e44049d846938dc2cf423`. Rule list: `[]` (Enabled: `True`). {{(pid=79879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:21:26.832717 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-829cfcec-5e99-4791-aacf-202400c3a5d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:21:26.906489 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf21eb7-cdbc-408e-a9ad-f4e8187e01d4 None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:21:26.939784 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 35/66] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 10 05:21:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 10 05:21:26.949801 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c398ed-3fe4-4b4e-acec-b27ceb8e9d70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:21:26.950789 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c398ed-3fe4-4b4e-acec-b27ceb8e9d70 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:21:26.951278 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c398ed-3fe4-4b4e-acec-b27ceb8e9d70 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:21:26.951775 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c398ed-3fe4-4b4e-acec-b27ceb8e9d70 None admin] PATH_INFO: `/v3/roles` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:21:26.952749 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c398ed-3fe4-4b4e-acec-b27ceb8e9d70 None admin] RBAC: Adding query filter params (name=member) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:21:26.953243 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c398ed-3fe4-4b4e-acec-b27ceb8e9d70 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:21:26.954839 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c398ed-3fe4-4b4e-acec-b27ceb8e9d70 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:21:26.962867 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829cfcec-5e99-4791-aacf-202400c3a5d5 None None] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:21:26.972524 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 32/67] 10.222.0.23 () {56 vars in 1101 bytes} [Tue May 10 05:21:26 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:21:26.980547 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c398ed-3fe4-4b4e-acec-b27ceb8e9d70 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:21:27.073124 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829cfcec-5e99-4791-aacf-202400c3a5d5 None None] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:21:27.107172 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5128bdcf-aa9f-4c96-8b60-612db68744b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:21:27.108336 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5128bdcf-aa9f-4c96-8b60-612db68744b1 None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:21:27.108854 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5128bdcf-aa9f-4c96-8b60-612db68744b1 None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:21:27.109337 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5128bdcf-aa9f-4c96-8b60-612db68744b1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:21:27.111438 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c398ed-3fe4-4b4e-acec-b27ceb8e9d70 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:21:27.122799 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5128bdcf-aa9f-4c96-8b60-612db68744b1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 05:21:27.131690 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application [None req-5128bdcf-aa9f-4c96-8b60-612db68744b1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 10 05:21:27.131690 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 05:21:27.131690 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 05:21:27.131690 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 05:21:27.131690 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 05:21:27.131690 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 05:21:27.131690 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 05:21:27.131690 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 05:21:27.131690 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 05:21:27.131690 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 05:21:27.131690 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 05:21:27.131690 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 05:21:27.131690 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 05:21:27.131690 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 05:21:27.131690 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 05:21:27.131690 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 05:21:27.132632 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 05:21:27.132632 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 05:21:27.132632 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 05:21:27.132632 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 05:21:27.132632 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 05:21:27.132632 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 05:21:27.132632 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 05:21:27.132632 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 05:21:27.132632 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 05:21:27.132632 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.get_or_create( May 10 05:21:27.132632 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 05:21:27.132632 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application with Lock( May 10 05:21:27.132632 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 05:21:27.132632 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self._enter() May 10 05:21:27.132632 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 05:21:27.132632 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 05:21:27.133416 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 05:21:27.133416 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.creator() May 10 05:21:27.133416 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 05:21:27.133416 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application created_value = creator( May 10 05:21:27.133416 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 05:21:27.133416 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 05:21:27.133416 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 05:21:27.133416 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 05:21:27.133416 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 05:21:27.133416 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 05:21:27.133416 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 10 05:21:27.133416 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application May 10 05:21:27.136653 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 36/68] 10.222.0.23 () {56 vars in 1096 bytes} [Tue May 10 05:21:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 05:21:27.142970 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206485c7-faac-4efe-a16e-2152bc666ea1 None None] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:21:27.144069 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206485c7-faac-4efe-a16e-2152bc666ea1 None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:21:27.145483 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206485c7-faac-4efe-a16e-2152bc666ea1 None None] PATH_INFO: `/` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:21:27.147603 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 37/69] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 10 05:21:27 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 05:21:27.149018 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206485c7-faac-4efe-a16e-2152bc666ea1 None None] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:21:27.153024 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855647a6-1ede-4159-88b7-a0c20d8c804c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:21:27.154189 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855647a6-1ede-4159-88b7-a0c20d8c804c None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:21:27.154700 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855647a6-1ede-4159-88b7-a0c20d8c804c None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:21:27.155181 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855647a6-1ede-4159-88b7-a0c20d8c804c None admin] PATH_INFO: `/v3/users/6356a96ee91d4828b89e3791aae2bb59` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:21:27.172869 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855647a6-1ede-4159-88b7-a0c20d8c804c None admin] RBAC: Authorizing `identity:get_user(user_id=6356a96ee91d4828b89e3791aae2bb59)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:21:27.174647 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855647a6-1ede-4159-88b7-a0c20d8c804c None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:21:27.176655 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 33/70] 10.222.0.23 () {56 vars in 1177 bytes} [Tue May 10 05:21:26 2022] GET /identity/v3/users/6356a96ee91d4828b89e3791aae2bb59 => generated 275 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:21:27.178106 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642db07a-1c40-4ac4-b8e2-c705fe0a3020 None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:21:27.178578 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642db07a-1c40-4ac4-b8e2-c705fe0a3020 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:21:27.179037 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642db07a-1c40-4ac4-b8e2-c705fe0a3020 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:21:27.195637 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-642db07a-1c40-4ac4-b8e2-c705fe0a3020 None None] MFA Rules not processed for user `44883b22532e44049d846938dc2cf423`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:21:27.197079 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-642db07a-1c40-4ac4-b8e2-c705fe0a3020 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:21:27.260690 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206485c7-faac-4efe-a16e-2152bc666ea1 None None] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:21:27.275823 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 34/71] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 10 05:21:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 05:21:27.277045 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642db07a-1c40-4ac4-b8e2-c705fe0a3020 None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:21:27.302176 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a58ca0-75c6-4778-be03-f850a5905b4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:21:27.302946 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a58ca0-75c6-4778-be03-f850a5905b4e None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:21:27.303237 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a58ca0-75c6-4778-be03-f850a5905b4e None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:21:27.303514 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a58ca0-75c6-4778-be03-f850a5905b4e None admin] PATH_INFO: `/v3/roles` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:21:27.304372 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a58ca0-75c6-4778-be03-f850a5905b4e None admin] RBAC: Adding query filter params (name=admin) {{(pid=79879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:21:27.304681 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a58ca0-75c6-4778-be03-f850a5905b4e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:21:27.307568 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a58ca0-75c6-4778-be03-f850a5905b4e None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:21:27.318789 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 38/72] 10.222.0.23 () {56 vars in 1099 bytes} [Tue May 10 05:21:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:21:27.319640 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a58ca0-75c6-4778-be03-f850a5905b4e None admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:21:27.403202 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642db07a-1c40-4ac4-b8e2-c705fe0a3020 None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:21:27.428298 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a58ca0-75c6-4778-be03-f850a5905b4e None admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:21:27.436423 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011870b0-a594-4b3e-8293-f203f5b14205 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:21:27.437083 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011870b0-a594-4b3e-8293-f203f5b14205 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:21:27.437370 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011870b0-a594-4b3e-8293-f203f5b14205 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:21:27.437643 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011870b0-a594-4b3e-8293-f203f5b14205 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:21:27.461108 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3957690f-1fd2-4ac7-8bce-612e1a50162b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:21:27.462277 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3957690f-1fd2-4ac7-8bce-612e1a50162b None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:21:27.462565 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3957690f-1fd2-4ac7-8bce-612e1a50162b None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:21:27.462843 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3957690f-1fd2-4ac7-8bce-612e1a50162b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:21:27.477668 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3957690f-1fd2-4ac7-8bce-612e1a50162b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 05:21:27.485777 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application [None req-3957690f-1fd2-4ac7-8bce-612e1a50162b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 10 05:21:27.485777 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 05:21:27.485777 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 05:21:27.485777 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 05:21:27.485777 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 05:21:27.485777 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 05:21:27.485777 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 05:21:27.485777 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 05:21:27.485777 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 05:21:27.485777 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 05:21:27.485777 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 05:21:27.485777 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 05:21:27.485777 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 05:21:27.485777 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 05:21:27.485777 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 05:21:27.485777 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 05:21:27.486615 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 05:21:27.486615 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 05:21:27.486615 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 05:21:27.486615 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 05:21:27.486615 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 05:21:27.486615 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 05:21:27.486615 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 05:21:27.486615 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 05:21:27.486615 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 05:21:27.486615 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.get_or_create( May 10 05:21:27.486615 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 05:21:27.486615 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application with Lock( May 10 05:21:27.486615 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 05:21:27.486615 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self._enter() May 10 05:21:27.486615 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 05:21:27.486615 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 05:21:27.487374 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 05:21:27.487374 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.creator() May 10 05:21:27.487374 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 05:21:27.487374 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application created_value = creator( May 10 05:21:27.487374 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 05:21:27.487374 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 05:21:27.487374 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 05:21:27.487374 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 05:21:27.487374 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 05:21:27.487374 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 05:21:27.487374 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 10 05:21:27.487374 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application May 10 05:21:27.487374 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 39/73] 10.222.0.23 () {56 vars in 1114 bytes} [Tue May 10 05:21:27 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 05:21:27.488644 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cd2277-2c07-4866-822d-cbb93133a430 None None] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:21:27.488935 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cd2277-2c07-4866-822d-cbb93133a430 None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:21:27.489219 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cd2277-2c07-4866-822d-cbb93133a430 None None] PATH_INFO: `/` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:21:27.490744 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 40/74] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 10 05:21:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 05:21:27.491275 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cd2277-2c07-4866-822d-cbb93133a430 None None] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:21:27.508806 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011870b0-a594-4b3e-8293-f203f5b14205 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:21:27.510323 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011870b0-a594-4b3e-8293-f203f5b14205 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:21:27.593086 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cd2277-2c07-4866-822d-cbb93133a430 None None] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:21:27.608574 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 35/75] 10.222.0.23 () {58 vars in 1282 bytes} [Tue May 10 05:21:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 05:21:27.610157 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16efed48-8ecf-4a05-8b35-458ea2eb739e None None] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:21:27.610584 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16efed48-8ecf-4a05-8b35-458ea2eb739e None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:21:27.611007 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16efed48-8ecf-4a05-8b35-458ea2eb739e None None] PATH_INFO: `/` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:21:27.612447 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 36/76] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 10 05:21:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 05:21:27.613453 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16efed48-8ecf-4a05-8b35-458ea2eb739e None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:21:27.627289 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3189e5d-2fca-4656-95d0-a490dc3e1c6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:21:27.628214 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3189e5d-2fca-4656-95d0-a490dc3e1c6c None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:21:27.628504 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3189e5d-2fca-4656-95d0-a490dc3e1c6c None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:21:27.628781 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3189e5d-2fca-4656-95d0-a490dc3e1c6c None admin] PATH_INFO: `/v3/users/44883b22532e44049d846938dc2cf423` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:21:27.629979 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3189e5d-2fca-4656-95d0-a490dc3e1c6c None admin] RBAC: Authorizing `identity:get_user(user_id=44883b22532e44049d846938dc2cf423)` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:21:27.631500 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3189e5d-2fca-4656-95d0-a490dc3e1c6c None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:21:27.633346 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 41/77] 10.222.0.23 () {56 vars in 1177 bytes} [Tue May 10 05:21:27 2022] GET /identity/v3/users/44883b22532e44049d846938dc2cf423 => generated 247 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:21:27.634312 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001a9d23-6f6b-4260-853d-2cd1118fbef7 None None] REQUEST_METHOD: `POST` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:21:27.634600 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001a9d23-6f6b-4260-853d-2cd1118fbef7 None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:21:27.634878 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001a9d23-6f6b-4260-853d-2cd1118fbef7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:21:27.651249 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.auth.core [None req-001a9d23-6f6b-4260-853d-2cd1118fbef7 None None] MFA Rules not processed for user `44883b22532e44049d846938dc2cf423`. Rule list: `[]` (Enabled: `True`). {{(pid=79879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:21:27.652477 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-001a9d23-6f6b-4260-853d-2cd1118fbef7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:21:27.711192 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16efed48-8ecf-4a05-8b35-458ea2eb739e None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:21:27.717287 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 42/78] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 10 05:21:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 05:21:27.731716 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001a9d23-6f6b-4260-853d-2cd1118fbef7 None None] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:21:27.746155 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53817484-e4cf-4226-a4f5-745ea18a20d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:21:27.746838 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53817484-e4cf-4226-a4f5-745ea18a20d3 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:21:27.747127 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53817484-e4cf-4226-a4f5-745ea18a20d3 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:21:27.747404 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53817484-e4cf-4226-a4f5-745ea18a20d3 None admin] PATH_INFO: `/v3/roles` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:21:27.748203 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53817484-e4cf-4226-a4f5-745ea18a20d3 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:21:27.748512 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53817484-e4cf-4226-a4f5-745ea18a20d3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:21:27.749891 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53817484-e4cf-4226-a4f5-745ea18a20d3 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:21:27.758050 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 37/79] 10.222.0.23 () {56 vars in 1111 bytes} [Tue May 10 05:21:27 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:21:27.762630 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed7463e-2154-4722-a769-8a89c05d2121 None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:21:27.762630 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed7463e-2154-4722-a769-8a89c05d2121 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:21:27.762630 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed7463e-2154-4722-a769-8a89c05d2121 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:21:27.775844 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-0ed7463e-2154-4722-a769-8a89c05d2121 None None] MFA Rules not processed for user `44883b22532e44049d846938dc2cf423`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:21:27.777046 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-0ed7463e-2154-4722-a769-8a89c05d2121 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:21:27.815884 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001a9d23-6f6b-4260-853d-2cd1118fbef7 None None] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:21:27.840871 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 38/80] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 10 05:21:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 05:21:27.841499 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed7463e-2154-4722-a769-8a89c05d2121 None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:21:27.849520 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16dae253-76a2-496a-91f8-1c1360ccae6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:21:27.850625 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dae253-76a2-496a-91f8-1c1360ccae6e None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:21:27.850923 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dae253-76a2-496a-91f8-1c1360ccae6e None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:21:27.851207 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dae253-76a2-496a-91f8-1c1360ccae6e None admin] PATH_INFO: `/v3/projects/294a6d4f4d1f45058a0706d961479db2` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:21:27.852429 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16dae253-76a2-496a-91f8-1c1360ccae6e None admin] RBAC: Authorizing `identity:get_project(project_id=294a6d4f4d1f45058a0706d961479db2)` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:21:27.853913 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16dae253-76a2-496a-91f8-1c1360ccae6e None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:21:27.855661 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 43/81] 10.222.0.23 () {56 vars in 1186 bytes} [Tue May 10 05:21:27 2022] GET /identity/v3/projects/294a6d4f4d1f45058a0706d961479db2 => generated 298 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:21:27.856425 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16dae253-76a2-496a-91f8-1c1360ccae6e None admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:21:27.933363 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed7463e-2154-4722-a769-8a89c05d2121 None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:21:27.951225 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16dae253-76a2-496a-91f8-1c1360ccae6e None admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:21:27.966899 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59989edf-9f5c-47ca-9ba5-9fe3ba077ac5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:21:27.967494 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59989edf-9f5c-47ca-9ba5-9fe3ba077ac5 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:21:27.967814 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59989edf-9f5c-47ca-9ba5-9fe3ba077ac5 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:21:27.968096 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59989edf-9f5c-47ca-9ba5-9fe3ba077ac5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:21:27.984954 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2a7495-0ef9-4ea3-935a-cb30e3d15f12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:21:27.985745 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2a7495-0ef9-4ea3-935a-cb30e3d15f12 None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:21:27.986032 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2a7495-0ef9-4ea3-935a-cb30e3d15f12 None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:21:27.986309 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2a7495-0ef9-4ea3-935a-cb30e3d15f12 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:21:27.987486 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2a7495-0ef9-4ea3-935a-cb30e3d15f12 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:21:27.988975 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2a7495-0ef9-4ea3-935a-cb30e3d15f12 None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:21:27.990628 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 44/82] 10.222.0.23 () {56 vars in 1108 bytes} [Tue May 10 05:21:27 2022] GET /identity/v3/domains/default => generated 199 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:21:27.991375 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2a7495-0ef9-4ea3-935a-cb30e3d15f12 None admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:21:28.032152 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59989edf-9f5c-47ca-9ba5-9fe3ba077ac5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:21:28.033633 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59989edf-9f5c-47ca-9ba5-9fe3ba077ac5 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:21:28.081761 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2a7495-0ef9-4ea3-935a-cb30e3d15f12 None admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:21:28.113346 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c31826f-4488-44bb-9f39-0e867eb2f4c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:21:28.114292 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c31826f-4488-44bb-9f39-0e867eb2f4c1 None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:21:28.114576 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c31826f-4488-44bb-9f39-0e867eb2f4c1 None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:21:28.114855 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c31826f-4488-44bb-9f39-0e867eb2f4c1 None admin] PATH_INFO: `/v3/users/6356a96ee91d4828b89e3791aae2bb59` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:21:28.116095 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c31826f-4488-44bb-9f39-0e867eb2f4c1 None admin] RBAC: Authorizing `identity:get_user(user_id=6356a96ee91d4828b89e3791aae2bb59)` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:21:28.117530 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c31826f-4488-44bb-9f39-0e867eb2f4c1 None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:21:28.119136 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 45/83] 10.222.0.23 () {56 vars in 1177 bytes} [Tue May 10 05:21:27 2022] GET /identity/v3/users/6356a96ee91d4828b89e3791aae2bb59 => generated 275 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:21:28.119918 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c31826f-4488-44bb-9f39-0e867eb2f4c1 None admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:21:28.127946 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 39/84] 10.222.0.23 () {58 vars in 1282 bytes} [Tue May 10 05:21:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 05:21:28.128791 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59989edf-9f5c-47ca-9ba5-9fe3ba077ac5 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:21:28.215652 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c31826f-4488-44bb-9f39-0e867eb2f4c1 None admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:21:28.223020 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59989edf-9f5c-47ca-9ba5-9fe3ba077ac5 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:21:28.248002 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de63bcad-db3c-496c-bece-f321b8e39680 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:21:28.248695 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de63bcad-db3c-496c-bece-f321b8e39680 None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:21:28.248988 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de63bcad-db3c-496c-bece-f321b8e39680 None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:21:28.249273 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de63bcad-db3c-496c-bece-f321b8e39680 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:21:28.250119 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de63bcad-db3c-496c-bece-f321b8e39680 None admin] RBAC: Adding query filter params (role.id=382636e67fc142a2b2f486340d959e11, scope.project.id=294a6d4f4d1f45058a0706d961479db2, user.id=6356a96ee91d4828b89e3791aae2bb59) {{(pid=79879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:21:28.250440 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de63bcad-db3c-496c-bece-f321b8e39680 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:21:28.251929 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de63bcad-db3c-496c-bece-f321b8e39680 None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:21:28.257285 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c6ef69-4e1f-4b51-8a12-b63989e05265 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:21:28.257455 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 46/85] 10.222.0.23 () {56 vars in 1374 bytes} [Tue May 10 05:21:28 2022] GET /identity/v3/role_assignments?user.id=6356a96ee91d4828b89e3791aae2bb59&scope.project.id=294a6d4f4d1f45058a0706d961479db2&role.id=382636e67fc142a2b2f486340d959e11 => generated 259 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:21:28.258100 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c6ef69-4e1f-4b51-8a12-b63989e05265 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:21:28.258254 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de63bcad-db3c-496c-bece-f321b8e39680 None admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:21:28.258403 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c6ef69-4e1f-4b51-8a12-b63989e05265 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:21:28.258663 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c6ef69-4e1f-4b51-8a12-b63989e05265 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:21:28.271032 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c6ef69-4e1f-4b51-8a12-b63989e05265 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 05:21:28.280429 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application [None req-a7c6ef69-4e1f-4b51-8a12-b63989e05265 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 10 05:21:28.280429 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 05:21:28.280429 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 05:21:28.280429 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 05:21:28.280429 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 05:21:28.280429 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 05:21:28.280429 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 05:21:28.280429 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 05:21:28.280429 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 05:21:28.280429 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 05:21:28.280429 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 05:21:28.280429 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 05:21:28.280429 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 05:21:28.280429 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 05:21:28.280429 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 05:21:28.280429 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 05:21:28.281387 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 05:21:28.281387 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 05:21:28.281387 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 05:21:28.281387 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 05:21:28.281387 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 05:21:28.281387 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 05:21:28.281387 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 05:21:28.281387 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 05:21:28.281387 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 05:21:28.281387 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.get_or_create( May 10 05:21:28.281387 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 05:21:28.281387 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application with Lock( May 10 05:21:28.281387 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 05:21:28.281387 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._enter() May 10 05:21:28.281387 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 05:21:28.281387 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 05:21:28.282142 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 05:21:28.282142 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.creator() May 10 05:21:28.282142 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 05:21:28.282142 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application created_value = creator( May 10 05:21:28.282142 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 05:21:28.282142 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 05:21:28.282142 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 05:21:28.282142 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 05:21:28.282142 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 05:21:28.282142 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 05:21:28.282142 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 10 05:21:28.282142 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application May 10 05:21:28.282142 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 40/86] 10.222.0.23 () {56 vars in 1099 bytes} [Tue May 10 05:21:28 2022] GET /identity/v3/roles/member => generated 84 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 05:21:28.282762 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c6ef69-4e1f-4b51-8a12-b63989e05265 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:21:28.368158 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de63bcad-db3c-496c-bece-f321b8e39680 None admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:21:28.384179 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c6ef69-4e1f-4b51-8a12-b63989e05265 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:21:28.403108 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2ce556-0a6a-4127-8033-e60c688ea27e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:21:28.403837 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2ce556-0a6a-4127-8033-e60c688ea27e None admin] REQUEST_METHOD: `POST` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:21:28.404140 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2ce556-0a6a-4127-8033-e60c688ea27e None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:21:28.404417 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2ce556-0a6a-4127-8033-e60c688ea27e None admin] PATH_INFO: `/v3/users` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:21:28.405152 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2ce556-0a6a-4127-8033-e60c688ea27e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:21:28.406654 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2ce556-0a6a-4127-8033-e60c688ea27e None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:21:28.418388 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6619e80-a482-451b-9f3f-b785a1a9235e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:21:28.419064 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6619e80-a482-451b-9f3f-b785a1a9235e None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:21:28.419350 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6619e80-a482-451b-9f3f-b785a1a9235e None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:21:28.419654 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6619e80-a482-451b-9f3f-b785a1a9235e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:21:28.434132 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 47/87] 10.222.0.23 () {60 vars in 1132 bytes} [Tue May 10 05:21:28 2022] POST /identity/v3/users => generated 289 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 05:21:28.449177 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2ce556-0a6a-4127-8033-e60c688ea27e None admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:21:28.501293 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6619e80-a482-451b-9f3f-b785a1a9235e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:21:28.502822 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6619e80-a482-451b-9f3f-b785a1a9235e None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:21:28.564282 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2ce556-0a6a-4127-8033-e60c688ea27e None admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:21:28.600953 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7813e0f-8b07-4ea4-abf9-1f4cdfc99c9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:21:28.602153 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7813e0f-8b07-4ea4-abf9-1f4cdfc99c9b None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:21:28.602582 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7813e0f-8b07-4ea4-abf9-1f4cdfc99c9b None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:21:28.603040 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7813e0f-8b07-4ea4-abf9-1f4cdfc99c9b None admin] PATH_INFO: `/v3/projects/294a6d4f4d1f45058a0706d961479db2` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:21:28.604552 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7813e0f-8b07-4ea4-abf9-1f4cdfc99c9b None admin] RBAC: Authorizing `identity:get_project(project_id=294a6d4f4d1f45058a0706d961479db2)` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:21:28.606294 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7813e0f-8b07-4ea4-abf9-1f4cdfc99c9b None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:21:28.608329 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 48/88] 10.222.0.23 () {56 vars in 1186 bytes} [Tue May 10 05:21:28 2022] GET /identity/v3/projects/294a6d4f4d1f45058a0706d961479db2 => generated 298 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:21:28.609288 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7813e0f-8b07-4ea4-abf9-1f4cdfc99c9b None admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:21:28.609399 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 41/89] 10.222.0.23 () {58 vars in 1282 bytes} [Tue May 10 05:21:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 05:21:28.619620 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6619e80-a482-451b-9f3f-b785a1a9235e None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:21:28.739881 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6619e80-a482-451b-9f3f-b785a1a9235e None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:21:28.753711 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7813e0f-8b07-4ea4-abf9-1f4cdfc99c9b None admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:21:28.785144 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fca77d-34e7-4f8f-8fef-c4bc5d3ac01a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:21:28.785834 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fca77d-34e7-4f8f-8fef-c4bc5d3ac01a None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:21:28.786096 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fca77d-34e7-4f8f-8fef-c4bc5d3ac01a None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:21:28.786370 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fca77d-34e7-4f8f-8fef-c4bc5d3ac01a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:21:28.787402 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fca77d-34e7-4f8f-8fef-c4bc5d3ac01a None admin] RBAC: Adding query filter params (role.id=199ac1dd842441d7913c6ee89d8fbecc, scope.project.id=294a6d4f4d1f45058a0706d961479db2, user.id=44883b22532e44049d846938dc2cf423) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:21:28.788326 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fca77d-34e7-4f8f-8fef-c4bc5d3ac01a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:21:28.789792 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fca77d-34e7-4f8f-8fef-c4bc5d3ac01a None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:21:28.794130 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3b68ee-1cf5-4502-ba2c-c6db72fa40ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:21:28.794814 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3b68ee-1cf5-4502-ba2c-c6db72fa40ab None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:21:28.795106 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3b68ee-1cf5-4502-ba2c-c6db72fa40ab None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:21:28.795386 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3b68ee-1cf5-4502-ba2c-c6db72fa40ab None admin] PATH_INFO: `/v3/roles` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:21:28.796205 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3b68ee-1cf5-4502-ba2c-c6db72fa40ab None admin] RBAC: Adding query filter params (name=member) {{(pid=79879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:21:28.796515 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3b68ee-1cf5-4502-ba2c-c6db72fa40ab None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:21:28.797929 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3b68ee-1cf5-4502-ba2c-c6db72fa40ab None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:21:28.799700 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 42/90] 10.222.0.23 () {56 vars in 1374 bytes} [Tue May 10 05:21:28 2022] GET /identity/v3/role_assignments?user.id=44883b22532e44049d846938dc2cf423&scope.project.id=294a6d4f4d1f45058a0706d961479db2&role.id=199ac1dd842441d7913c6ee89d8fbecc => generated 259 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:21:28.800570 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fca77d-34e7-4f8f-8fef-c4bc5d3ac01a None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:21:28.809573 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 49/91] 10.222.0.23 () {56 vars in 1101 bytes} [Tue May 10 05:21:28 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:21:28.815468 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3b68ee-1cf5-4502-ba2c-c6db72fa40ab None admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:21:28.914353 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fca77d-34e7-4f8f-8fef-c4bc5d3ac01a None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:21:28.950047 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3603f5-f6e6-47a0-a26f-23237567490f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:21:28.950943 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3603f5-f6e6-47a0-a26f-23237567490f None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:21:28.951221 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3603f5-f6e6-47a0-a26f-23237567490f None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:21:28.951502 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3603f5-f6e6-47a0-a26f-23237567490f None admin] PATH_INFO: `/v3/projects/294a6d4f4d1f45058a0706d961479db2` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:21:28.952782 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3603f5-f6e6-47a0-a26f-23237567490f None admin] RBAC: Authorizing `identity:get_project(project_id=294a6d4f4d1f45058a0706d961479db2)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:21:28.954277 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3603f5-f6e6-47a0-a26f-23237567490f None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:21:28.956465 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 43/92] 10.222.0.23 () {56 vars in 1186 bytes} [Tue May 10 05:21:28 2022] GET /identity/v3/projects/294a6d4f4d1f45058a0706d961479db2 => generated 298 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:21:28.964669 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3603f5-f6e6-47a0-a26f-23237567490f None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:21:29.086929 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3b68ee-1cf5-4502-ba2c-c6db72fa40ab None admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:21:29.140038 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84e98f1-d7f5-4f49-8d94-09de25baf59b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:21:29.140939 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84e98f1-d7f5-4f49-8d94-09de25baf59b None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:21:29.141227 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84e98f1-d7f5-4f49-8d94-09de25baf59b None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:21:29.141507 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84e98f1-d7f5-4f49-8d94-09de25baf59b None admin] PATH_INFO: `/v3/users/6356a96ee91d4828b89e3791aae2bb59` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:21:29.144428 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84e98f1-d7f5-4f49-8d94-09de25baf59b None admin] RBAC: Authorizing `identity:get_user(user_id=6356a96ee91d4828b89e3791aae2bb59)` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:21:29.146810 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84e98f1-d7f5-4f49-8d94-09de25baf59b None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:21:29.151987 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 50/93] 10.222.0.23 () {56 vars in 1177 bytes} [Tue May 10 05:21:28 2022] GET /identity/v3/users/6356a96ee91d4828b89e3791aae2bb59 => generated 275 bytes in 337 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:21:29.157925 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84e98f1-d7f5-4f49-8d94-09de25baf59b None admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:21:29.185835 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3603f5-f6e6-47a0-a26f-23237567490f None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:21:29.272891 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667ee844-9f0e-4a83-9b30-6712c4ef356c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:21:29.273574 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667ee844-9f0e-4a83-9b30-6712c4ef356c None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:21:29.273863 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667ee844-9f0e-4a83-9b30-6712c4ef356c None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:21:29.274140 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667ee844-9f0e-4a83-9b30-6712c4ef356c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:21:29.274996 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667ee844-9f0e-4a83-9b30-6712c4ef356c None admin] RBAC: Adding query filter params (role.id=b0cb991ebc2d42d5a5de343c57086616, scope.project.id=294a6d4f4d1f45058a0706d961479db2, user.id=6356a96ee91d4828b89e3791aae2bb59) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:21:29.275862 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667ee844-9f0e-4a83-9b30-6712c4ef356c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:21:29.276843 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667ee844-9f0e-4a83-9b30-6712c4ef356c None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:21:29.289737 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 44/94] 10.222.0.23 () {56 vars in 1374 bytes} [Tue May 10 05:21:28 2022] GET /identity/v3/role_assignments?user.id=6356a96ee91d4828b89e3791aae2bb59&scope.project.id=294a6d4f4d1f45058a0706d961479db2&role.id=b0cb991ebc2d42d5a5de343c57086616 => generated 259 bytes in 325 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:21:29.372265 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84e98f1-d7f5-4f49-8d94-09de25baf59b None admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:21:29.448880 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636bdce8-e52f-4b20-acbf-84f77b8e086e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:21:29.449664 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636bdce8-e52f-4b20-acbf-84f77b8e086e None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:21:29.449866 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636bdce8-e52f-4b20-acbf-84f77b8e086e None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:21:29.451607 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636bdce8-e52f-4b20-acbf-84f77b8e086e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:21:29.570593 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636bdce8-e52f-4b20-acbf-84f77b8e086e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:21:29.572649 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636bdce8-e52f-4b20-acbf-84f77b8e086e None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:21:29.686742 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 51/95] 10.222.0.23 () {58 vars in 1282 bytes} [Tue May 10 05:21:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 530 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 05:21:29.693227 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667ee844-9f0e-4a83-9b30-6712c4ef356c None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:21:29.856682 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667ee844-9f0e-4a83-9b30-6712c4ef356c None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:21:29.896931 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e5cf6a-d816-4b00-bb24-6f1c30e995d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:21:29.897830 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e5cf6a-d816-4b00-bb24-6f1c30e995d5 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:21:29.898119 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e5cf6a-d816-4b00-bb24-6f1c30e995d5 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:21:29.898397 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e5cf6a-d816-4b00-bb24-6f1c30e995d5 None admin] PATH_INFO: `/v3/projects/02d16b4bd3b845fcab79fa11b3a3fb3d` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:21:29.899624 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e5cf6a-d816-4b00-bb24-6f1c30e995d5 None admin] RBAC: Authorizing `identity:get_project(project_id=02d16b4bd3b845fcab79fa11b3a3fb3d)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:21:29.901106 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e5cf6a-d816-4b00-bb24-6f1c30e995d5 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:21:29.902902 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 45/96] 10.222.0.23 () {56 vars in 1186 bytes} [Tue May 10 05:21:29 2022] GET /identity/v3/projects/02d16b4bd3b845fcab79fa11b3a3fb3d => generated 312 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:21:29.908928 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636bdce8-e52f-4b20-acbf-84f77b8e086e None admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:21:30.033102 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636bdce8-e52f-4b20-acbf-84f77b8e086e None admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:21:30.071000 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8838eb-b1e9-4107-8c1a-0fdd4242bf18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:21:30.072075 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8838eb-b1e9-4107-8c1a-0fdd4242bf18 None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:21:30.072562 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8838eb-b1e9-4107-8c1a-0fdd4242bf18 None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:21:30.073057 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8838eb-b1e9-4107-8c1a-0fdd4242bf18 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:21:30.074097 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8838eb-b1e9-4107-8c1a-0fdd4242bf18 None admin] RBAC: Adding query filter params (role.id=382636e67fc142a2b2f486340d959e11, scope.project.id=02d16b4bd3b845fcab79fa11b3a3fb3d, user.id=6356a96ee91d4828b89e3791aae2bb59) {{(pid=79879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:21:30.074608 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8838eb-b1e9-4107-8c1a-0fdd4242bf18 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:21:30.076301 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8838eb-b1e9-4107-8c1a-0fdd4242bf18 None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:21:30.082612 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 52/97] 10.222.0.23 () {56 vars in 1374 bytes} [Tue May 10 05:21:29 2022] GET /identity/v3/role_assignments?user.id=6356a96ee91d4828b89e3791aae2bb59&scope.project.id=02d16b4bd3b845fcab79fa11b3a3fb3d&role.id=382636e67fc142a2b2f486340d959e11 => generated 259 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:21:31.193839 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7739b7e9-a1e8-4a1d-81f5-b6fa0017a226 None None] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:21:31.194462 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7739b7e9-a1e8-4a1d-81f5-b6fa0017a226 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:21:31.194462 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7739b7e9-a1e8-4a1d-81f5-b6fa0017a226 None None] PATH_INFO: `/` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:21:31.195974 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 46/98] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 10 05:21:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 05:21:31.201519 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867595ff-7c8e-4b94-a9de-876947d341c1 None None] REQUEST_METHOD: `POST` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:21:31.201943 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867595ff-7c8e-4b94-a9de-876947d341c1 None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:21:31.202111 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867595ff-7c8e-4b94-a9de-876947d341c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:21:31.224131 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.auth.core [None req-867595ff-7c8e-4b94-a9de-876947d341c1 None None] MFA Rules not processed for user `44883b22532e44049d846938dc2cf423`. Rule list: `[]` (Enabled: `True`). {{(pid=79879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:21:31.225445 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-867595ff-7c8e-4b94-a9de-876947d341c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:21:31.310256 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 53/99] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 10 05:21:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 05:21:31.353062 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7739b7e9-a1e8-4a1d-81f5-b6fa0017a226 None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:21:31.480753 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7739b7e9-a1e8-4a1d-81f5-b6fa0017a226 None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:21:31.526762 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59aa52a8-2618-4a62-bd29-0808a402a42b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:21:31.527601 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59aa52a8-2618-4a62-bd29-0808a402a42b None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:21:31.527891 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59aa52a8-2618-4a62-bd29-0808a402a42b None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:21:31.528166 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59aa52a8-2618-4a62-bd29-0808a402a42b None admin] PATH_INFO: `/v3/roles/member` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:21:31.543804 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59aa52a8-2618-4a62-bd29-0808a402a42b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 05:21:31.551979 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application [None req-59aa52a8-2618-4a62-bd29-0808a402a42b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 10 05:21:31.551979 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 05:21:31.551979 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 05:21:31.551979 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 05:21:31.551979 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 05:21:31.551979 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 05:21:31.551979 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 05:21:31.551979 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 05:21:31.551979 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 05:21:31.551979 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 05:21:31.551979 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 05:21:31.551979 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 05:21:31.551979 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 05:21:31.551979 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 05:21:31.551979 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 05:21:31.551979 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 05:21:31.552904 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 05:21:31.552904 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 05:21:31.552904 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 05:21:31.552904 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 05:21:31.552904 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 05:21:31.552904 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 05:21:31.552904 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 05:21:31.552904 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 05:21:31.552904 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 05:21:31.552904 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.get_or_create( May 10 05:21:31.552904 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 05:21:31.552904 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application with Lock( May 10 05:21:31.552904 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 05:21:31.552904 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._enter() May 10 05:21:31.552904 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 05:21:31.552904 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 05:21:31.554408 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 05:21:31.554408 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.creator() May 10 05:21:31.554408 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 05:21:31.554408 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application created_value = creator( May 10 05:21:31.554408 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 05:21:31.554408 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 05:21:31.554408 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 05:21:31.554408 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 05:21:31.554408 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 05:21:31.554408 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 05:21:31.554408 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 10 05:21:31.554408 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application May 10 05:21:31.554408 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 47/100] 10.222.0.23 () {56 vars in 1099 bytes} [Tue May 10 05:21:31 2022] GET /identity/v3/roles/member => generated 84 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 05:21:31.559465 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867595ff-7c8e-4b94-a9de-876947d341c1 None None] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:21:31.685815 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867595ff-7c8e-4b94-a9de-876947d341c1 None None] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:21:31.723035 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1d4295-7883-49f4-9c52-e7a5248f05b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:21:31.723685 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1d4295-7883-49f4-9c52-e7a5248f05b7 None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:21:31.723968 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1d4295-7883-49f4-9c52-e7a5248f05b7 None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:21:31.724328 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1d4295-7883-49f4-9c52-e7a5248f05b7 None admin] PATH_INFO: `/v3/roles` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:21:31.725087 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1d4295-7883-49f4-9c52-e7a5248f05b7 None admin] RBAC: Adding query filter params (name=member) {{(pid=79879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:21:31.725392 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1d4295-7883-49f4-9c52-e7a5248f05b7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:21:31.726804 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1d4295-7883-49f4-9c52-e7a5248f05b7 None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:21:31.735483 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 54/101] 10.222.0.23 () {56 vars in 1101 bytes} [Tue May 10 05:21:31 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:21:31.744674 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59aa52a8-2618-4a62-bd29-0808a402a42b None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:21:31.815023 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41630f3-e904-4a2d-a622-84afc0e5309f None None] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:21:31.815360 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41630f3-e904-4a2d-a622-84afc0e5309f None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:21:31.815585 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41630f3-e904-4a2d-a622-84afc0e5309f None None] PATH_INFO: `/` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:21:31.817133 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 55/102] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 10 05:21:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 05:21:31.833327 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91e4894-9ee6-43f7-928d-7bf5d6a81fad None None] REQUEST_METHOD: `POST` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:21:31.833741 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91e4894-9ee6-43f7-928d-7bf5d6a81fad None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:21:31.833899 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91e4894-9ee6-43f7-928d-7bf5d6a81fad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:21:31.867348 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59aa52a8-2618-4a62-bd29-0808a402a42b None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:21:31.868188 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.auth.core [None req-c91e4894-9ee6-43f7-928d-7bf5d6a81fad None None] MFA Rules not processed for user `44883b22532e44049d846938dc2cf423`. Rule list: `[]` (Enabled: `True`). {{(pid=79879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:21:31.869406 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-c91e4894-9ee6-43f7-928d-7bf5d6a81fad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:21:31.910804 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b671e5e9-05d2-49e2-9572-d50135979149 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:21:31.911783 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b671e5e9-05d2-49e2-9572-d50135979149 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:21:31.912071 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b671e5e9-05d2-49e2-9572-d50135979149 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:21:31.912351 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b671e5e9-05d2-49e2-9572-d50135979149 None admin] PATH_INFO: `/v3/users/6356a96ee91d4828b89e3791aae2bb59` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:21:31.914811 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b671e5e9-05d2-49e2-9572-d50135979149 None admin] RBAC: Authorizing `identity:get_user(user_id=6356a96ee91d4828b89e3791aae2bb59)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:21:31.917016 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b671e5e9-05d2-49e2-9572-d50135979149 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:21:31.918865 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 48/103] 10.222.0.23 () {56 vars in 1177 bytes} [Tue May 10 05:21:31 2022] GET /identity/v3/users/6356a96ee91d4828b89e3791aae2bb59 => generated 275 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:21:31.924522 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b671e5e9-05d2-49e2-9572-d50135979149 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:21:32.017016 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 56/104] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 10 05:21:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 10 05:21:32.028257 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b671e5e9-05d2-49e2-9572-d50135979149 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:21:32.063645 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91e4894-9ee6-43f7-928d-7bf5d6a81fad None None] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:21:32.070547 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61396920-79bc-4015-ba85-f96d0a3af87a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:21:32.071445 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61396920-79bc-4015-ba85-f96d0a3af87a None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:21:32.071767 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61396920-79bc-4015-ba85-f96d0a3af87a None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:21:32.072047 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61396920-79bc-4015-ba85-f96d0a3af87a None admin] PATH_INFO: `/v3/projects/294a6d4f4d1f45058a0706d961479db2` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:21:32.073281 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61396920-79bc-4015-ba85-f96d0a3af87a None admin] RBAC: Authorizing `identity:get_project(project_id=294a6d4f4d1f45058a0706d961479db2)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:21:32.074804 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61396920-79bc-4015-ba85-f96d0a3af87a None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:21:32.079598 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 49/105] 10.222.0.23 () {56 vars in 1186 bytes} [Tue May 10 05:21:31 2022] GET /identity/v3/projects/294a6d4f4d1f45058a0706d961479db2 => generated 298 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:21:32.082438 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61396920-79bc-4015-ba85-f96d0a3af87a None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:21:32.199637 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61396920-79bc-4015-ba85-f96d0a3af87a None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:21:32.238265 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bbd1d4-9cce-454b-bfec-d68d14a9645f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:21:32.239486 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bbd1d4-9cce-454b-bfec-d68d14a9645f None admin] REQUEST_METHOD: `PUT` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:21:32.240049 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bbd1d4-9cce-454b-bfec-d68d14a9645f None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:21:32.240475 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bbd1d4-9cce-454b-bfec-d68d14a9645f None admin] PATH_INFO: `/v3/projects/294a6d4f4d1f45058a0706d961479db2/users/6356a96ee91d4828b89e3791aae2bb59/roles/382636e67fc142a2b2f486340d959e11` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:21:32.245029 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78bbd1d4-9cce-454b-bfec-d68d14a9645f None admin] RBAC: Authorizing `identity:create_grant(project_id=294a6d4f4d1f45058a0706d961479db2, user_id=6356a96ee91d4828b89e3791aae2bb59, role_id=382636e67fc142a2b2f486340d959e11)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:21:32.247838 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78bbd1d4-9cce-454b-bfec-d68d14a9645f None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:21:32.278527 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 50/106] 10.222.0.23 () {58 vars in 1439 bytes} [Tue May 10 05:21:32 2022] PUT /identity/v3/projects/294a6d4f4d1f45058a0706d961479db2/users/6356a96ee91d4828b89e3791aae2bb59/roles/382636e67fc142a2b2f486340d959e11 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 05:21:32.289397 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91e4894-9ee6-43f7-928d-7bf5d6a81fad None None] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:21:32.330088 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8361a4f-3ead-46a3-81c7-656108aad127 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:21:32.331269 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8361a4f-3ead-46a3-81c7-656108aad127 None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:21:32.331754 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8361a4f-3ead-46a3-81c7-656108aad127 None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:21:32.332174 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8361a4f-3ead-46a3-81c7-656108aad127 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:21:32.350252 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8361a4f-3ead-46a3-81c7-656108aad127 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 05:21:32.359143 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application [None req-b8361a4f-3ead-46a3-81c7-656108aad127 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 10 05:21:32.359143 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 05:21:32.359143 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 05:21:32.359143 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 05:21:32.359143 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 05:21:32.359143 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 05:21:32.359143 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 05:21:32.359143 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 05:21:32.359143 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 05:21:32.359143 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 05:21:32.359143 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 05:21:32.359143 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 05:21:32.359143 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 05:21:32.359143 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 05:21:32.359143 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 05:21:32.359143 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 05:21:32.360334 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 05:21:32.360334 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 05:21:32.360334 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 05:21:32.360334 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 05:21:32.360334 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 05:21:32.360334 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 05:21:32.360334 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 05:21:32.360334 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 05:21:32.360334 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 05:21:32.360334 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.get_or_create( May 10 05:21:32.360334 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 05:21:32.360334 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application with Lock( May 10 05:21:32.360334 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 05:21:32.360334 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self._enter() May 10 05:21:32.360334 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 05:21:32.360334 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 05:21:32.361283 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 05:21:32.361283 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.creator() May 10 05:21:32.361283 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 05:21:32.361283 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application created_value = creator( May 10 05:21:32.361283 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 05:21:32.361283 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 05:21:32.361283 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 05:21:32.361283 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 05:21:32.361283 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 05:21:32.361283 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 05:21:32.361283 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 10 05:21:32.361283 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application May 10 05:21:32.367808 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 57/107] 10.222.0.23 () {56 vars in 1099 bytes} [Tue May 10 05:21:32 2022] GET /identity/v3/roles/reader => generated 84 bytes in 305 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 05:21:32.370028 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bbd1d4-9cce-454b-bfec-d68d14a9645f None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:21:32.382360 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a36322-8e5a-4c29-abb8-876afe80097b None None] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:21:32.382904 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a36322-8e5a-4c29-abb8-876afe80097b None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:21:32.383332 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a36322-8e5a-4c29-abb8-876afe80097b None None] PATH_INFO: `/` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:21:32.384968 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 58/108] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 10 05:21:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 05:21:32.390837 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3915a2c-00f6-4506-b644-20a199da06a0 None None] REQUEST_METHOD: `POST` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:21:32.391359 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3915a2c-00f6-4506-b644-20a199da06a0 None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:21:32.391864 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3915a2c-00f6-4506-b644-20a199da06a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:21:32.418013 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.auth.core [None req-b3915a2c-00f6-4506-b644-20a199da06a0 None None] MFA Rules not processed for user `44883b22532e44049d846938dc2cf423`. Rule list: `[]` (Enabled: `True`). {{(pid=79879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:21:32.419536 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-b3915a2c-00f6-4506-b644-20a199da06a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:21:32.542876 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 59/109] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 10 05:21:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 10 05:21:32.578699 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ddf118-ac9d-44fc-93d6-23561dcb09ef None None] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:21:32.578989 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ddf118-ac9d-44fc-93d6-23561dcb09ef None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:21:32.579272 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ddf118-ac9d-44fc-93d6-23561dcb09ef None None] PATH_INFO: `/` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:21:32.581372 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 60/110] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 10 05:21:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 05:21:32.582152 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ddf118-ac9d-44fc-93d6-23561dcb09ef None None] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:21:32.611523 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bbd1d4-9cce-454b-bfec-d68d14a9645f None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:21:32.648068 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51340d95-4ff6-4a84-85f7-4acbd7ee6538 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:21:32.649159 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51340d95-4ff6-4a84-85f7-4acbd7ee6538 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:21:32.649628 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51340d95-4ff6-4a84-85f7-4acbd7ee6538 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:21:32.650057 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51340d95-4ff6-4a84-85f7-4acbd7ee6538 None admin] PATH_INFO: `/v3/roles` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:21:32.650977 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51340d95-4ff6-4a84-85f7-4acbd7ee6538 None admin] RBAC: Adding query filter params (name=reader) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:21:32.651424 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51340d95-4ff6-4a84-85f7-4acbd7ee6538 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:21:32.653187 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51340d95-4ff6-4a84-85f7-4acbd7ee6538 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:21:32.664639 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 51/111] 10.222.0.23 () {56 vars in 1101 bytes} [Tue May 10 05:21:32 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:21:32.666204 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f411f5de-5c34-44c2-9209-91a6b15b41ba None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:21:32.666706 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f411f5de-5c34-44c2-9209-91a6b15b41ba None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:21:32.667653 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f411f5de-5c34-44c2-9209-91a6b15b41ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:21:32.686223 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-f411f5de-5c34-44c2-9209-91a6b15b41ba None None] MFA Rules not processed for user `44883b22532e44049d846938dc2cf423`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:21:32.687561 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-f411f5de-5c34-44c2-9209-91a6b15b41ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:21:32.740608 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ddf118-ac9d-44fc-93d6-23561dcb09ef None None] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:21:32.758487 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 52/112] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 10 05:21:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 05:21:32.759711 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f411f5de-5c34-44c2-9209-91a6b15b41ba None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:21:32.782741 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b22744-9102-4b31-99de-a1b96aa04bae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:21:32.784285 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b22744-9102-4b31-99de-a1b96aa04bae None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:21:32.785000 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b22744-9102-4b31-99de-a1b96aa04bae None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:21:32.785430 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b22744-9102-4b31-99de-a1b96aa04bae None admin] PATH_INFO: `/v3/domains/default` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:21:32.787421 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b22744-9102-4b31-99de-a1b96aa04bae None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:21:32.789518 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b22744-9102-4b31-99de-a1b96aa04bae None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:21:32.792148 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 61/113] 10.222.0.23 () {56 vars in 1108 bytes} [Tue May 10 05:21:32 2022] GET /identity/v3/domains/default => generated 199 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:21:32.793132 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b22744-9102-4b31-99de-a1b96aa04bae None admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:21:32.878931 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f411f5de-5c34-44c2-9209-91a6b15b41ba None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:21:32.906001 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b22744-9102-4b31-99de-a1b96aa04bae None admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:21:32.920732 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd1984b-5963-44be-bb09-bf1e76218270 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:21:32.922343 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd1984b-5963-44be-bb09-bf1e76218270 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:21:32.922906 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd1984b-5963-44be-bb09-bf1e76218270 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:21:32.923332 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd1984b-5963-44be-bb09-bf1e76218270 None admin] PATH_INFO: `/v3/users/bc821ebbf7b44fd9809a440fc070f4ff` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:21:32.940859 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd1984b-5963-44be-bb09-bf1e76218270 None admin] RBAC: Authorizing `identity:get_user(user_id=bc821ebbf7b44fd9809a440fc070f4ff)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:21:32.941419 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ecfde5-f346-439c-94af-e56fad280754 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:21:32.942332 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ecfde5-f346-439c-94af-e56fad280754 None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:21:32.942710 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ecfde5-f346-439c-94af-e56fad280754 None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:21:32.943134 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd1984b-5963-44be-bb09-bf1e76218270 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:21:32.943297 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ecfde5-f346-439c-94af-e56fad280754 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:21:32.945366 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 53/114] 10.222.0.23 () {56 vars in 1177 bytes} [Tue May 10 05:21:32 2022] GET /identity/v3/users/bc821ebbf7b44fd9809a440fc070f4ff => generated 289 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:21:32.946704 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd1984b-5963-44be-bb09-bf1e76218270 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:21:32.960416 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ecfde5-f346-439c-94af-e56fad280754 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 05:21:32.968396 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application [None req-25ecfde5-f346-439c-94af-e56fad280754 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 10 05:21:32.968396 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 05:21:32.968396 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 05:21:32.968396 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 05:21:32.968396 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 05:21:32.968396 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 05:21:32.968396 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 05:21:32.968396 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 05:21:32.968396 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 05:21:32.968396 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 05:21:32.968396 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 05:21:32.968396 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 05:21:32.968396 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 05:21:32.968396 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 05:21:32.968396 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 05:21:32.968396 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 05:21:32.969433 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 05:21:32.969433 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 05:21:32.969433 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 05:21:32.969433 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 05:21:32.969433 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 05:21:32.969433 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 05:21:32.969433 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 05:21:32.969433 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 05:21:32.969433 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 05:21:32.969433 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.get_or_create( May 10 05:21:32.969433 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 05:21:32.969433 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application with Lock( May 10 05:21:32.969433 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 05:21:32.969433 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self._enter() May 10 05:21:32.969433 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 05:21:32.969433 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 05:21:32.970181 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 05:21:32.970181 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.creator() May 10 05:21:32.970181 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 05:21:32.970181 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application created_value = creator( May 10 05:21:32.970181 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 05:21:32.970181 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 05:21:32.970181 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 05:21:32.970181 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 05:21:32.970181 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 05:21:32.970181 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 05:21:32.970181 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 10 05:21:32.970181 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application May 10 05:21:32.971113 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 62/115] 10.222.0.23 () {56 vars in 1096 bytes} [Tue May 10 05:21:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 05:21:32.975387 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed6b0e5-5cfd-47da-ae37-71287c2d1fb8 None None] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:21:32.975387 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed6b0e5-5cfd-47da-ae37-71287c2d1fb8 None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:21:32.975387 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed6b0e5-5cfd-47da-ae37-71287c2d1fb8 None None] PATH_INFO: `/` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:21:32.975387 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 63/116] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 10 05:21:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 05:21:32.975387 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed6b0e5-5cfd-47da-ae37-71287c2d1fb8 None None] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:21:33.045610 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd1984b-5963-44be-bb09-bf1e76218270 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:21:33.079014 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6aff66d-80a1-4730-a4d3-d60ee6a37742 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:21:33.079738 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6aff66d-80a1-4730-a4d3-d60ee6a37742 None admin] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:21:33.080023 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6aff66d-80a1-4730-a4d3-d60ee6a37742 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:21:33.080297 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6aff66d-80a1-4730-a4d3-d60ee6a37742 None admin] PATH_INFO: `/v3/projects` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:21:33.080786 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed6b0e5-5cfd-47da-ae37-71287c2d1fb8 None None] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:21:33.081031 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6aff66d-80a1-4730-a4d3-d60ee6a37742 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:21:33.082558 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6aff66d-80a1-4730-a4d3-d60ee6a37742 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:21:33.114949 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 54/117] 10.222.0.23 () {60 vars in 1141 bytes} [Tue May 10 05:21:32 2022] POST /identity/v3/projects => generated 302 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 05:21:33.116013 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6aff66d-80a1-4730-a4d3-d60ee6a37742 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:21:33.132417 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437ce94f-7d83-4a9e-b5d6-b88798d2aedf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:21:33.133710 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437ce94f-7d83-4a9e-b5d6-b88798d2aedf None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:21:33.134006 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437ce94f-7d83-4a9e-b5d6-b88798d2aedf None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:21:33.134285 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437ce94f-7d83-4a9e-b5d6-b88798d2aedf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:21:33.247084 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6aff66d-80a1-4730-a4d3-d60ee6a37742 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:21:33.285862 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698920d1-aee1-40dd-88d1-1b385edb1f64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:21:33.289180 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698920d1-aee1-40dd-88d1-1b385edb1f64 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:21:33.289180 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698920d1-aee1-40dd-88d1-1b385edb1f64 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:21:33.289180 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698920d1-aee1-40dd-88d1-1b385edb1f64 None admin] PATH_INFO: `/v3/roles` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:21:33.289180 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698920d1-aee1-40dd-88d1-1b385edb1f64 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:21:33.289180 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698920d1-aee1-40dd-88d1-1b385edb1f64 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:21:33.290766 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698920d1-aee1-40dd-88d1-1b385edb1f64 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:21:33.299316 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437ce94f-7d83-4a9e-b5d6-b88798d2aedf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:21:33.301539 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437ce94f-7d83-4a9e-b5d6-b88798d2aedf None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:21:33.302039 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 55/118] 10.222.0.23 () {56 vars in 1099 bytes} [Tue May 10 05:21:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:21:33.303566 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d22d2d6-ca7f-4d11-9e5e-a950ac2bbfa1 None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:21:33.303873 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d22d2d6-ca7f-4d11-9e5e-a950ac2bbfa1 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:21:33.304153 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d22d2d6-ca7f-4d11-9e5e-a950ac2bbfa1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:21:33.325530 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-9d22d2d6-ca7f-4d11-9e5e-a950ac2bbfa1 None None] MFA Rules not processed for user `44883b22532e44049d846938dc2cf423`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:21:33.326849 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-9d22d2d6-ca7f-4d11-9e5e-a950ac2bbfa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:21:33.417812 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 64/119] 10.222.0.23 () {58 vars in 1282 bytes} [Tue May 10 05:21:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 443 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 05:21:33.420214 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618ec3b0-c777-4209-bb22-06760276024d None None] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:21:33.420324 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 56/120] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 10 05:21:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 05:21:33.420817 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618ec3b0-c777-4209-bb22-06760276024d None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:21:33.421114 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d22d2d6-ca7f-4d11-9e5e-a950ac2bbfa1 None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:21:33.421503 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618ec3b0-c777-4209-bb22-06760276024d None None] PATH_INFO: `/` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:21:33.423022 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 65/121] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 10 05:21:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 05:21:33.425639 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618ec3b0-c777-4209-bb22-06760276024d None None] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:21:33.536875 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d22d2d6-ca7f-4d11-9e5e-a950ac2bbfa1 None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:21:33.541973 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618ec3b0-c777-4209-bb22-06760276024d None None] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:21:33.578140 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50056d8-1243-4584-beb0-51df133351d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:21:33.579110 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50056d8-1243-4584-beb0-51df133351d0 None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:21:33.579392 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50056d8-1243-4584-beb0-51df133351d0 None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:21:33.579709 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50056d8-1243-4584-beb0-51df133351d0 None admin] PATH_INFO: `/v3/projects/294a6d4f4d1f45058a0706d961479db2` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:21:33.579828 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ba3e39-2077-4bc0-b356-c863646ec8f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:21:33.580600 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ba3e39-2077-4bc0-b356-c863646ec8f3 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:21:33.580870 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50056d8-1243-4584-beb0-51df133351d0 None admin] RBAC: Authorizing `identity:get_project(project_id=294a6d4f4d1f45058a0706d961479db2)` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:21:33.580968 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ba3e39-2077-4bc0-b356-c863646ec8f3 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:21:33.581151 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ba3e39-2077-4bc0-b356-c863646ec8f3 None admin] PATH_INFO: `/v3/users/44883b22532e44049d846938dc2cf423` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:21:33.582344 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ba3e39-2077-4bc0-b356-c863646ec8f3 None admin] RBAC: Authorizing `identity:get_user(user_id=44883b22532e44049d846938dc2cf423)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:21:33.582445 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50056d8-1243-4584-beb0-51df133351d0 None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:21:33.583889 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ba3e39-2077-4bc0-b356-c863646ec8f3 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:21:33.584341 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 66/122] 10.222.0.23 () {56 vars in 1186 bytes} [Tue May 10 05:21:33 2022] GET /identity/v3/projects/294a6d4f4d1f45058a0706d961479db2 => generated 298 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 05:21:33.585658 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 57/123] 10.222.0.23 () {56 vars in 1177 bytes} [Tue May 10 05:21:33 2022] GET /identity/v3/users/44883b22532e44049d846938dc2cf423 => generated 247 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:21:33.585775 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c861958-e1fb-4461-96bb-35dc26564940 None None] REQUEST_METHOD: `POST` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:21:33.585942 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c861958-e1fb-4461-96bb-35dc26564940 None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:21:33.586165 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c861958-e1fb-4461-96bb-35dc26564940 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:21:33.591010 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ba3e39-2077-4bc0-b356-c863646ec8f3 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:21:33.614557 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.auth.core [None req-5c861958-e1fb-4461-96bb-35dc26564940 None None] MFA Rules not processed for user `44883b22532e44049d846938dc2cf423`. Rule list: `[]` (Enabled: `True`). {{(pid=79879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:21:33.616024 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-5c861958-e1fb-4461-96bb-35dc26564940 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:21:33.687086 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ba3e39-2077-4bc0-b356-c863646ec8f3 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:21:33.698275 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 67/124] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 10 05:21:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 05:21:33.699512 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c861958-e1fb-4461-96bb-35dc26564940 None None] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:21:33.731019 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da45e34c-8707-4559-80e1-01e216a30bf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:21:33.731893 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da45e34c-8707-4559-80e1-01e216a30bf9 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:21:33.732170 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da45e34c-8707-4559-80e1-01e216a30bf9 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:21:33.732440 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da45e34c-8707-4559-80e1-01e216a30bf9 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:21:33.744291 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da45e34c-8707-4559-80e1-01e216a30bf9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 05:21:33.753044 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application [None req-da45e34c-8707-4559-80e1-01e216a30bf9 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 10 05:21:33.753044 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 05:21:33.753044 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 05:21:33.753044 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 05:21:33.753044 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 05:21:33.753044 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 05:21:33.753044 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 05:21:33.753044 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 05:21:33.753044 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 05:21:33.753044 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 05:21:33.753044 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 05:21:33.753044 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 05:21:33.753044 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 05:21:33.753044 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 05:21:33.753044 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 05:21:33.753044 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 05:21:33.755412 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 05:21:33.755412 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 05:21:33.755412 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 05:21:33.755412 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 05:21:33.755412 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 05:21:33.755412 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 05:21:33.755412 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 05:21:33.755412 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 05:21:33.755412 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 05:21:33.755412 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.get_or_create( May 10 05:21:33.755412 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 05:21:33.755412 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application with Lock( May 10 05:21:33.755412 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 05:21:33.755412 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._enter() May 10 05:21:33.755412 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 05:21:33.755412 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 05:21:33.757474 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 05:21:33.757474 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.creator() May 10 05:21:33.757474 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 05:21:33.757474 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application created_value = creator( May 10 05:21:33.757474 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 05:21:33.757474 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 05:21:33.757474 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 05:21:33.757474 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 05:21:33.757474 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 05:21:33.757474 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 05:21:33.757474 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 10 05:21:33.757474 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application May 10 05:21:33.757474 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 58/125] 10.222.0.23 () {56 vars in 1114 bytes} [Tue May 10 05:21:33 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 05:21:33.757474 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da45e34c-8707-4559-80e1-01e216a30bf9 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:21:33.815449 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c861958-e1fb-4461-96bb-35dc26564940 None None] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:21:33.848237 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f8bb6a-4e7c-4f33-8fe6-53b9b7408994 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:21:33.848821 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f8bb6a-4e7c-4f33-8fe6-53b9b7408994 None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:21:33.849227 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f8bb6a-4e7c-4f33-8fe6-53b9b7408994 None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:21:33.849505 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f8bb6a-4e7c-4f33-8fe6-53b9b7408994 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:21:33.850420 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f8bb6a-4e7c-4f33-8fe6-53b9b7408994 None admin] RBAC: Adding query filter params (role.id=8df798e3160347fd84a42d1aedd8ccde, scope.project.id=294a6d4f4d1f45058a0706d961479db2, user.id=bc821ebbf7b44fd9809a440fc070f4ff) {{(pid=79879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:21:33.850725 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f8bb6a-4e7c-4f33-8fe6-53b9b7408994 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:21:33.852262 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f8bb6a-4e7c-4f33-8fe6-53b9b7408994 None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:21:33.857844 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 68/126] 10.222.0.23 () {56 vars in 1374 bytes} [Tue May 10 05:21:33 2022] GET /identity/v3/role_assignments?user.id=bc821ebbf7b44fd9809a440fc070f4ff&scope.project.id=294a6d4f4d1f45058a0706d961479db2&role.id=8df798e3160347fd84a42d1aedd8ccde => generated 259 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:21:33.858723 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f8bb6a-4e7c-4f33-8fe6-53b9b7408994 None admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:21:33.880725 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da45e34c-8707-4559-80e1-01e216a30bf9 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:21:33.917805 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb8566f-5979-4f1b-9a7d-cee9c77ef82d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:21:33.918732 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb8566f-5979-4f1b-9a7d-cee9c77ef82d None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:21:33.919016 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb8566f-5979-4f1b-9a7d-cee9c77ef82d None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:21:33.919292 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb8566f-5979-4f1b-9a7d-cee9c77ef82d None admin] PATH_INFO: `/v3/projects/294a6d4f4d1f45058a0706d961479db2` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:21:33.920534 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb8566f-5979-4f1b-9a7d-cee9c77ef82d None admin] RBAC: Authorizing `identity:get_project(project_id=294a6d4f4d1f45058a0706d961479db2)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:21:33.922001 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb8566f-5979-4f1b-9a7d-cee9c77ef82d None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:21:33.923933 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 59/127] 10.222.0.23 () {56 vars in 1186 bytes} [Tue May 10 05:21:33 2022] GET /identity/v3/projects/294a6d4f4d1f45058a0706d961479db2 => generated 298 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:21:33.929461 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb8566f-5979-4f1b-9a7d-cee9c77ef82d None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:21:33.978400 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f8bb6a-4e7c-4f33-8fe6-53b9b7408994 None admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:21:34.013005 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb97edb0-11e1-4c28-92c8-0f6dc4766fed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:21:34.013821 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb97edb0-11e1-4c28-92c8-0f6dc4766fed None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:21:34.014101 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb97edb0-11e1-4c28-92c8-0f6dc4766fed None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:21:34.014375 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb97edb0-11e1-4c28-92c8-0f6dc4766fed None admin] PATH_INFO: `/v3/roles/member` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:21:34.025758 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb97edb0-11e1-4c28-92c8-0f6dc4766fed None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 05:21:34.033711 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application [None req-eb97edb0-11e1-4c28-92c8-0f6dc4766fed None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 10 05:21:34.033711 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 05:21:34.033711 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 05:21:34.033711 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 05:21:34.033711 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 05:21:34.033711 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 05:21:34.033711 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 05:21:34.033711 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 05:21:34.033711 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 05:21:34.033711 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 05:21:34.033711 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 05:21:34.033711 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 05:21:34.033711 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 05:21:34.033711 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 05:21:34.033711 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 05:21:34.033711 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 05:21:34.035766 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 05:21:34.035766 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 05:21:34.035766 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 05:21:34.035766 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 05:21:34.035766 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 05:21:34.035766 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 05:21:34.035766 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 05:21:34.035766 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 05:21:34.035766 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 05:21:34.035766 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.get_or_create( May 10 05:21:34.035766 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 05:21:34.035766 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application with Lock( May 10 05:21:34.035766 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 05:21:34.035766 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self._enter() May 10 05:21:34.035766 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 05:21:34.035766 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 05:21:34.037711 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 05:21:34.037711 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.creator() May 10 05:21:34.037711 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 05:21:34.037711 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application created_value = creator( May 10 05:21:34.037711 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 05:21:34.037711 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 05:21:34.037711 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 05:21:34.037711 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 05:21:34.037711 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 05:21:34.037711 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 05:21:34.037711 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 10 05:21:34.037711 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application May 10 05:21:34.037711 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 69/128] 10.222.0.23 () {56 vars in 1099 bytes} [Tue May 10 05:21:33 2022] GET /identity/v3/roles/member => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 05:21:34.037711 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb97edb0-11e1-4c28-92c8-0f6dc4766fed None admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:21:34.043885 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb8566f-5979-4f1b-9a7d-cee9c77ef82d None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:21:34.110585 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa25c56a-b88c-4412-9fcf-edfd001e8732 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:21:34.111205 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa25c56a-b88c-4412-9fcf-edfd001e8732 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:21:34.111491 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa25c56a-b88c-4412-9fcf-edfd001e8732 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:21:34.111791 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa25c56a-b88c-4412-9fcf-edfd001e8732 None admin] PATH_INFO: `/v3/roles` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:21:34.112652 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa25c56a-b88c-4412-9fcf-edfd001e8732 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:21:34.112974 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa25c56a-b88c-4412-9fcf-edfd001e8732 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:21:34.116744 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa25c56a-b88c-4412-9fcf-edfd001e8732 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:21:34.136692 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 60/129] 10.222.0.23 () {56 vars in 1111 bytes} [Tue May 10 05:21:33 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:21:34.138512 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa25c56a-b88c-4412-9fcf-edfd001e8732 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:21:34.215328 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb97edb0-11e1-4c28-92c8-0f6dc4766fed None admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:21:34.249376 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c7ab5e-aede-42c3-a2ed-6f54a3746257 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:21:34.250650 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c7ab5e-aede-42c3-a2ed-6f54a3746257 None admin] REQUEST_METHOD: `PUT` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:21:34.251126 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c7ab5e-aede-42c3-a2ed-6f54a3746257 None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:21:34.251643 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c7ab5e-aede-42c3-a2ed-6f54a3746257 None admin] PATH_INFO: `/v3/projects/294a6d4f4d1f45058a0706d961479db2/users/44883b22532e44049d846938dc2cf423/roles/199ac1dd842441d7913c6ee89d8fbecc` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:21:34.253823 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c7ab5e-aede-42c3-a2ed-6f54a3746257 None admin] RBAC: Authorizing `identity:create_grant(project_id=294a6d4f4d1f45058a0706d961479db2, user_id=44883b22532e44049d846938dc2cf423, role_id=199ac1dd842441d7913c6ee89d8fbecc)` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:21:34.255547 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c7ab5e-aede-42c3-a2ed-6f54a3746257 None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:21:34.278651 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 70/130] 10.222.0.23 () {58 vars in 1439 bytes} [Tue May 10 05:21:34 2022] PUT /identity/v3/projects/294a6d4f4d1f45058a0706d961479db2/users/44883b22532e44049d846938dc2cf423/roles/199ac1dd842441d7913c6ee89d8fbecc => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 05:21:34.279879 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c7ab5e-aede-42c3-a2ed-6f54a3746257 None admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:21:34.330418 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa25c56a-b88c-4412-9fcf-edfd001e8732 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:21:34.404648 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59f065a-6d48-4e07-8aa7-f5755d88ff65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:21:34.405714 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59f065a-6d48-4e07-8aa7-f5755d88ff65 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:21:34.406192 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59f065a-6d48-4e07-8aa7-f5755d88ff65 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:21:34.406657 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59f065a-6d48-4e07-8aa7-f5755d88ff65 None admin] PATH_INFO: `/v3/roles` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:21:34.407720 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59f065a-6d48-4e07-8aa7-f5755d88ff65 None admin] RBAC: Adding query filter params (name=member) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:21:34.408269 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59f065a-6d48-4e07-8aa7-f5755d88ff65 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:21:34.409914 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59f065a-6d48-4e07-8aa7-f5755d88ff65 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:21:34.433378 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 61/131] 10.222.0.23 () {56 vars in 1101 bytes} [Tue May 10 05:21:34 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:21:34.438624 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59f065a-6d48-4e07-8aa7-f5755d88ff65 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:21:34.483201 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c7ab5e-aede-42c3-a2ed-6f54a3746257 None admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:21:34.568499 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a4547e-9469-4da4-aac5-9182757a4f15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:21:34.569430 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a4547e-9469-4da4-aac5-9182757a4f15 None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:21:34.569717 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a4547e-9469-4da4-aac5-9182757a4f15 None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:21:34.569999 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a4547e-9469-4da4-aac5-9182757a4f15 None admin] PATH_INFO: `/v3/users/6356a96ee91d4828b89e3791aae2bb59` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:21:34.571345 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a4547e-9469-4da4-aac5-9182757a4f15 None admin] RBAC: Authorizing `identity:get_user(user_id=6356a96ee91d4828b89e3791aae2bb59)` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:21:34.572867 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a4547e-9469-4da4-aac5-9182757a4f15 None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:21:34.574600 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 71/132] 10.222.0.23 () {56 vars in 1177 bytes} [Tue May 10 05:21:34 2022] GET /identity/v3/users/6356a96ee91d4828b89e3791aae2bb59 => generated 275 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:21:34.584880 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a4547e-9469-4da4-aac5-9182757a4f15 None admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:21:34.599685 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59f065a-6d48-4e07-8aa7-f5755d88ff65 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:21:34.643336 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0b124e-b50b-4af4-9a43-4a277399d811 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:21:34.644269 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0b124e-b50b-4af4-9a43-4a277399d811 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:21:34.644549 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0b124e-b50b-4af4-9a43-4a277399d811 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:21:34.644821 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0b124e-b50b-4af4-9a43-4a277399d811 None admin] PATH_INFO: `/v3/users/6356a96ee91d4828b89e3791aae2bb59` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:21:34.646291 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0b124e-b50b-4af4-9a43-4a277399d811 None admin] RBAC: Authorizing `identity:get_user(user_id=6356a96ee91d4828b89e3791aae2bb59)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:21:34.647799 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0b124e-b50b-4af4-9a43-4a277399d811 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:21:34.649476 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 62/133] 10.222.0.23 () {56 vars in 1177 bytes} [Tue May 10 05:21:34 2022] GET /identity/v3/users/6356a96ee91d4828b89e3791aae2bb59 => generated 275 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 05:21:34.656532 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0b124e-b50b-4af4-9a43-4a277399d811 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:21:34.772644 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a4547e-9469-4da4-aac5-9182757a4f15 None admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:21:34.834016 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0b124e-b50b-4af4-9a43-4a277399d811 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:21:34.837670 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2295c49d-f28c-42a1-b077-a0e8cba903c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:21:34.838928 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2295c49d-f28c-42a1-b077-a0e8cba903c4 None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:21:34.839412 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2295c49d-f28c-42a1-b077-a0e8cba903c4 None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:21:34.839929 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2295c49d-f28c-42a1-b077-a0e8cba903c4 None admin] PATH_INFO: `/v3/projects/294a6d4f4d1f45058a0706d961479db2` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:21:34.842483 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2295c49d-f28c-42a1-b077-a0e8cba903c4 None admin] RBAC: Authorizing `identity:get_project(project_id=294a6d4f4d1f45058a0706d961479db2)` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:21:34.844313 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2295c49d-f28c-42a1-b077-a0e8cba903c4 None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:21:34.851164 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 72/134] 10.222.0.23 () {56 vars in 1186 bytes} [Tue May 10 05:21:34 2022] GET /identity/v3/projects/294a6d4f4d1f45058a0706d961479db2 => generated 298 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 05:21:34.858128 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2295c49d-f28c-42a1-b077-a0e8cba903c4 None admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:21:34.928942 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711abc94-ac5c-447b-baca-b480830aabf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:21:34.929747 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711abc94-ac5c-447b-baca-b480830aabf0 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:21:34.930038 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711abc94-ac5c-447b-baca-b480830aabf0 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:21:34.930322 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711abc94-ac5c-447b-baca-b480830aabf0 None admin] PATH_INFO: `/v3/projects/02d16b4bd3b845fcab79fa11b3a3fb3d` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:21:34.936344 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711abc94-ac5c-447b-baca-b480830aabf0 None admin] RBAC: Authorizing `identity:get_project(project_id=02d16b4bd3b845fcab79fa11b3a3fb3d)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:21:34.937838 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711abc94-ac5c-447b-baca-b480830aabf0 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:21:34.939958 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 63/135] 10.222.0.23 () {56 vars in 1186 bytes} [Tue May 10 05:21:34 2022] GET /identity/v3/projects/02d16b4bd3b845fcab79fa11b3a3fb3d => generated 312 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:21:34.947545 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711abc94-ac5c-447b-baca-b480830aabf0 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:21:34.978807 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2295c49d-f28c-42a1-b077-a0e8cba903c4 None admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:21:35.038171 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e78cc3-26e4-4822-b132-611998426553 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:21:35.039530 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e78cc3-26e4-4822-b132-611998426553 None admin] REQUEST_METHOD: `PUT` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:21:35.040072 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e78cc3-26e4-4822-b132-611998426553 None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:21:35.040542 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e78cc3-26e4-4822-b132-611998426553 None admin] PATH_INFO: `/v3/projects/294a6d4f4d1f45058a0706d961479db2/users/6356a96ee91d4828b89e3791aae2bb59/roles/b0cb991ebc2d42d5a5de343c57086616` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:21:35.043377 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e78cc3-26e4-4822-b132-611998426553 None admin] RBAC: Authorizing `identity:create_grant(project_id=294a6d4f4d1f45058a0706d961479db2, user_id=6356a96ee91d4828b89e3791aae2bb59, role_id=b0cb991ebc2d42d5a5de343c57086616)` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:21:35.048854 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e78cc3-26e4-4822-b132-611998426553 None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:21:35.074176 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 73/136] 10.222.0.23 () {58 vars in 1439 bytes} [Tue May 10 05:21:34 2022] PUT /identity/v3/projects/294a6d4f4d1f45058a0706d961479db2/users/6356a96ee91d4828b89e3791aae2bb59/roles/b0cb991ebc2d42d5a5de343c57086616 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 05:21:35.136853 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49efcfc-1ad2-47ae-b8d9-9ecbde20256f None None] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:21:35.137182 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49efcfc-1ad2-47ae-b8d9-9ecbde20256f None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:21:35.137417 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49efcfc-1ad2-47ae-b8d9-9ecbde20256f None None] PATH_INFO: `/` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:21:35.139186 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 74/137] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 10 05:21:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 05:21:35.149785 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2018475d-7738-4b6e-8733-f092527603cb None None] REQUEST_METHOD: `POST` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:21:35.150098 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2018475d-7738-4b6e-8733-f092527603cb None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:21:35.150351 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2018475d-7738-4b6e-8733-f092527603cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:21:35.165280 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711abc94-ac5c-447b-baca-b480830aabf0 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:21:35.184987 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.auth.core [None req-2018475d-7738-4b6e-8733-f092527603cb None None] MFA Rules not processed for user `44883b22532e44049d846938dc2cf423`. Rule list: `[]` (Enabled: `True`). {{(pid=79879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:21:35.186141 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-2018475d-7738-4b6e-8733-f092527603cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:21:35.237891 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcb9aaf-ac1b-45a5-a1c4-f650ca6b3025 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:21:35.238822 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcb9aaf-ac1b-45a5-a1c4-f650ca6b3025 None admin] REQUEST_METHOD: `PUT` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:21:35.239104 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcb9aaf-ac1b-45a5-a1c4-f650ca6b3025 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:21:35.239379 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcb9aaf-ac1b-45a5-a1c4-f650ca6b3025 None admin] PATH_INFO: `/v3/projects/02d16b4bd3b845fcab79fa11b3a3fb3d/users/6356a96ee91d4828b89e3791aae2bb59/roles/382636e67fc142a2b2f486340d959e11` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:21:35.249471 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efcb9aaf-ac1b-45a5-a1c4-f650ca6b3025 None admin] RBAC: Authorizing `identity:create_grant(project_id=02d16b4bd3b845fcab79fa11b3a3fb3d, user_id=6356a96ee91d4828b89e3791aae2bb59, role_id=382636e67fc142a2b2f486340d959e11)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:21:35.251543 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efcb9aaf-ac1b-45a5-a1c4-f650ca6b3025 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:21:35.286903 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 64/138] 10.222.0.23 () {58 vars in 1439 bytes} [Tue May 10 05:21:34 2022] PUT /identity/v3/projects/02d16b4bd3b845fcab79fa11b3a3fb3d/users/6356a96ee91d4828b89e3791aae2bb59/roles/382636e67fc142a2b2f486340d959e11 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 05:21:35.322508 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 75/139] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 10 05:21:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 10 05:21:35.363992 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcb9aaf-ac1b-45a5-a1c4-f650ca6b3025 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:21:35.486639 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcb9aaf-ac1b-45a5-a1c4-f650ca6b3025 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:21:35.531253 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a613055-8670-43d9-a0e3-019ac6cbaf65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:21:35.532228 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a613055-8670-43d9-a0e3-019ac6cbaf65 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:21:35.532516 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a613055-8670-43d9-a0e3-019ac6cbaf65 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:21:35.532797 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a613055-8670-43d9-a0e3-019ac6cbaf65 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:21:35.550014 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a613055-8670-43d9-a0e3-019ac6cbaf65 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 05:21:35.559499 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application [None req-1a613055-8670-43d9-a0e3-019ac6cbaf65 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 10 05:21:35.559499 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 05:21:35.559499 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 05:21:35.559499 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 05:21:35.559499 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 05:21:35.559499 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 05:21:35.559499 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 05:21:35.559499 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 05:21:35.559499 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 05:21:35.559499 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 05:21:35.559499 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 05:21:35.559499 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 05:21:35.559499 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 05:21:35.559499 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 05:21:35.559499 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 05:21:35.559499 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 05:21:35.560509 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 05:21:35.560509 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 05:21:35.560509 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 05:21:35.560509 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 05:21:35.560509 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 05:21:35.560509 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 05:21:35.560509 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 05:21:35.560509 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 05:21:35.560509 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 05:21:35.560509 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.get_or_create( May 10 05:21:35.560509 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 05:21:35.560509 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application with Lock( May 10 05:21:35.560509 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 05:21:35.560509 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._enter() May 10 05:21:35.560509 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 05:21:35.560509 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 05:21:35.561278 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 05:21:35.561278 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.creator() May 10 05:21:35.561278 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 05:21:35.561278 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application created_value = creator( May 10 05:21:35.561278 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 05:21:35.561278 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 05:21:35.561278 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 05:21:35.561278 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 05:21:35.561278 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 05:21:35.561278 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 05:21:35.561278 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 10 05:21:35.561278 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application May 10 05:21:35.564931 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 65/140] 10.222.0.23 () {56 vars in 1099 bytes} [Tue May 10 05:21:35 2022] GET /identity/v3/roles/member => generated 84 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 05:21:35.573504 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2018475d-7738-4b6e-8733-f092527603cb None None] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:21:35.693773 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2018475d-7738-4b6e-8733-f092527603cb None None] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:21:35.752383 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7990727b-44f0-4094-8f0b-8c829e296c18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:21:35.753035 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7990727b-44f0-4094-8f0b-8c829e296c18 None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:21:35.753317 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7990727b-44f0-4094-8f0b-8c829e296c18 None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:21:35.753591 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7990727b-44f0-4094-8f0b-8c829e296c18 None admin] PATH_INFO: `/v3/roles` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:21:35.754361 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7990727b-44f0-4094-8f0b-8c829e296c18 None admin] RBAC: Adding query filter params (name=member) {{(pid=79879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:21:35.754675 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7990727b-44f0-4094-8f0b-8c829e296c18 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:21:35.756314 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7990727b-44f0-4094-8f0b-8c829e296c18 None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:21:35.770932 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 76/141] 10.222.0.23 () {56 vars in 1101 bytes} [Tue May 10 05:21:35 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 05:21:35.776608 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a613055-8670-43d9-a0e3-019ac6cbaf65 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:21:35.931613 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a613055-8670-43d9-a0e3-019ac6cbaf65 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:21:35.990844 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa77c89-3e93-4017-bc9c-ea5085959f9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:21:35.992150 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa77c89-3e93-4017-bc9c-ea5085959f9c None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:21:35.992643 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa77c89-3e93-4017-bc9c-ea5085959f9c None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:21:35.993145 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa77c89-3e93-4017-bc9c-ea5085959f9c None admin] PATH_INFO: `/v3/users/6356a96ee91d4828b89e3791aae2bb59` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:21:35.996680 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa77c89-3e93-4017-bc9c-ea5085959f9c None admin] RBAC: Authorizing `identity:get_user(user_id=6356a96ee91d4828b89e3791aae2bb59)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:21:35.998391 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa77c89-3e93-4017-bc9c-ea5085959f9c None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:21:36.000335 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 66/142] 10.222.0.23 () {56 vars in 1177 bytes} [Tue May 10 05:21:35 2022] GET /identity/v3/users/6356a96ee91d4828b89e3791aae2bb59 => generated 275 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:21:36.007910 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7990727b-44f0-4094-8f0b-8c829e296c18 None admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:21:36.118187 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7990727b-44f0-4094-8f0b-8c829e296c18 None admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:21:36.152867 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1191d307-fb41-4cdf-9445-75a958f2df15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:21:36.153527 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1191d307-fb41-4cdf-9445-75a958f2df15 None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:21:36.153809 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1191d307-fb41-4cdf-9445-75a958f2df15 None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:21:36.154085 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1191d307-fb41-4cdf-9445-75a958f2df15 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:21:36.229843 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1191d307-fb41-4cdf-9445-75a958f2df15 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:21:36.231437 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1191d307-fb41-4cdf-9445-75a958f2df15 None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:21:36.295235 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0325a1-58ad-44ec-b00c-efcc344920e7 None None] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:21:36.295932 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0325a1-58ad-44ec-b00c-efcc344920e7 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:21:36.296485 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0325a1-58ad-44ec-b00c-efcc344920e7 None None] PATH_INFO: `/` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:21:36.298125 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 67/143] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 10 05:21:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 05:21:36.303515 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01349db5-1528-47f5-b0d1-2bf89b7a3cf8 None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:21:36.304112 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01349db5-1528-47f5-b0d1-2bf89b7a3cf8 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:21:36.304602 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01349db5-1528-47f5-b0d1-2bf89b7a3cf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:21:36.331602 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 77/144] 10.222.0.23 () {58 vars in 1282 bytes} [Tue May 10 05:21:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 05:21:36.334203 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1191d307-fb41-4cdf-9445-75a958f2df15 None admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:21:36.336567 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-01349db5-1528-47f5-b0d1-2bf89b7a3cf8 None None] MFA Rules not processed for user `44883b22532e44049d846938dc2cf423`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:21:36.338019 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-01349db5-1528-47f5-b0d1-2bf89b7a3cf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:21:36.430010 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1191d307-fb41-4cdf-9445-75a958f2df15 None admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:21:36.442334 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 68/145] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 10 05:21:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 05:21:36.465226 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceab5039-b086-46d1-b0e5-fa10a168236d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:21:36.465226 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceab5039-b086-46d1-b0e5-fa10a168236d None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:21:36.465226 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceab5039-b086-46d1-b0e5-fa10a168236d None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:21:36.465572 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceab5039-b086-46d1-b0e5-fa10a168236d None admin] PATH_INFO: `/v3/projects/294a6d4f4d1f45058a0706d961479db2` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:21:36.468588 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceab5039-b086-46d1-b0e5-fa10a168236d None admin] RBAC: Authorizing `identity:get_project(project_id=294a6d4f4d1f45058a0706d961479db2)` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:21:36.468588 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceab5039-b086-46d1-b0e5-fa10a168236d None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:21:36.470422 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 78/146] 10.222.0.23 () {56 vars in 1186 bytes} [Tue May 10 05:21:36 2022] GET /identity/v3/projects/294a6d4f4d1f45058a0706d961479db2 => generated 298 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 05:21:36.476781 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01349db5-1528-47f5-b0d1-2bf89b7a3cf8 None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:21:36.478593 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceab5039-b086-46d1-b0e5-fa10a168236d None admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:21:36.650426 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01349db5-1528-47f5-b0d1-2bf89b7a3cf8 None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:21:36.667938 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceab5039-b086-46d1-b0e5-fa10a168236d None admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:21:36.686866 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030bb7e2-90ea-4d96-9e42-37c83d972f59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:21:36.687881 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030bb7e2-90ea-4d96-9e42-37c83d972f59 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:21:36.688303 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030bb7e2-90ea-4d96-9e42-37c83d972f59 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:21:36.688573 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030bb7e2-90ea-4d96-9e42-37c83d972f59 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:21:36.689417 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030bb7e2-90ea-4d96-9e42-37c83d972f59 None admin] RBAC: Adding query filter params (role.id=382636e67fc142a2b2f486340d959e11, scope.project.id=294a6d4f4d1f45058a0706d961479db2, user.id=6356a96ee91d4828b89e3791aae2bb59) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:21:36.689727 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030bb7e2-90ea-4d96-9e42-37c83d972f59 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:21:36.691189 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030bb7e2-90ea-4d96-9e42-37c83d972f59 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:21:36.701484 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 69/147] 10.222.0.23 () {56 vars in 1374 bytes} [Tue May 10 05:21:36 2022] GET /identity/v3/role_assignments?user.id=6356a96ee91d4828b89e3791aae2bb59&scope.project.id=294a6d4f4d1f45058a0706d961479db2&role.id=382636e67fc142a2b2f486340d959e11 => generated 608 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:21:36.742440 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08d3bad-39e5-4d51-b634-389fc281224d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:21:36.743329 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08d3bad-39e5-4d51-b634-389fc281224d None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:21:36.743568 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08d3bad-39e5-4d51-b634-389fc281224d None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:21:36.743864 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08d3bad-39e5-4d51-b634-389fc281224d None admin] PATH_INFO: `/v3/domains/default` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:21:36.748462 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08d3bad-39e5-4d51-b634-389fc281224d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:21:36.750008 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08d3bad-39e5-4d51-b634-389fc281224d None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:21:36.751810 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 79/148] 10.222.0.23 () {56 vars in 1108 bytes} [Tue May 10 05:21:36 2022] GET /identity/v3/domains/default => generated 199 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:21:36.757614 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030bb7e2-90ea-4d96-9e42-37c83d972f59 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:21:36.889382 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030bb7e2-90ea-4d96-9e42-37c83d972f59 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:21:36.935364 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bb643f-67fe-4f08-abc8-04a5c84e6e76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:21:36.936445 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bb643f-67fe-4f08-abc8-04a5c84e6e76 None admin] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:21:36.936937 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bb643f-67fe-4f08-abc8-04a5c84e6e76 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:21:36.937415 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bb643f-67fe-4f08-abc8-04a5c84e6e76 None admin] PATH_INFO: `/v3/users` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:21:36.938383 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39bb643f-67fe-4f08-abc8-04a5c84e6e76 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:21:36.940160 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39bb643f-67fe-4f08-abc8-04a5c84e6e76 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:21:36.976254 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 70/149] 10.222.0.23 () {60 vars in 1132 bytes} [Tue May 10 05:21:36 2022] POST /identity/v3/users => generated 283 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 05:21:37.189071 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60c7e7b-e7a2-4115-ab7c-ca83940b24e8 None None] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:21:37.189421 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60c7e7b-e7a2-4115-ab7c-ca83940b24e8 None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:21:37.189518 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60c7e7b-e7a2-4115-ab7c-ca83940b24e8 None None] PATH_INFO: `/` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:21:37.190931 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 80/150] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 10 05:21:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 05:21:37.205725 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c7e16e-db48-4b35-8964-f2f3e6918cd1 None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:21:37.206360 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c7e16e-db48-4b35-8964-f2f3e6918cd1 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:21:37.206848 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c7e16e-db48-4b35-8964-f2f3e6918cd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:21:37.232868 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-89c7e16e-db48-4b35-8964-f2f3e6918cd1 None None] MFA Rules not processed for user `44883b22532e44049d846938dc2cf423`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:21:37.234455 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-89c7e16e-db48-4b35-8964-f2f3e6918cd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:21:37.310830 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 71/151] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 10 05:21:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 05:21:37.335333 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60c7e7b-e7a2-4115-ab7c-ca83940b24e8 None None] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:21:37.456501 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60c7e7b-e7a2-4115-ab7c-ca83940b24e8 None None] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:21:37.495293 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4944531-e03e-4d45-a37a-4aeb8811b46b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:21:37.496494 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4944531-e03e-4d45-a37a-4aeb8811b46b None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:21:37.496773 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4944531-e03e-4d45-a37a-4aeb8811b46b None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:21:37.497172 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4944531-e03e-4d45-a37a-4aeb8811b46b None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:21:37.510257 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4944531-e03e-4d45-a37a-4aeb8811b46b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 05:21:37.518082 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application [None req-b4944531-e03e-4d45-a37a-4aeb8811b46b None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 10 05:21:37.518082 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 05:21:37.518082 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 05:21:37.518082 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 05:21:37.518082 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 05:21:37.518082 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 05:21:37.518082 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 05:21:37.518082 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 05:21:37.518082 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 05:21:37.518082 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 05:21:37.518082 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 05:21:37.518082 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 05:21:37.518082 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 05:21:37.518082 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 05:21:37.518082 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 05:21:37.518082 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 05:21:37.518943 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 05:21:37.518943 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 05:21:37.518943 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 05:21:37.518943 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 05:21:37.518943 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 05:21:37.518943 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 05:21:37.518943 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 05:21:37.518943 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 05:21:37.518943 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 05:21:37.518943 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.get_or_create( May 10 05:21:37.518943 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 05:21:37.518943 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application with Lock( May 10 05:21:37.518943 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 05:21:37.518943 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self._enter() May 10 05:21:37.518943 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 05:21:37.518943 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 05:21:37.519757 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 05:21:37.519757 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.creator() May 10 05:21:37.519757 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 05:21:37.519757 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application created_value = creator( May 10 05:21:37.519757 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 05:21:37.519757 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 05:21:37.519757 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 05:21:37.519757 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 05:21:37.519757 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 05:21:37.519757 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 05:21:37.519757 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 10 05:21:37.519757 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application May 10 05:21:37.519757 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 81/152] 10.222.0.23 () {56 vars in 1099 bytes} [Tue May 10 05:21:37 2022] GET /identity/v3/roles/reader => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 05:21:37.525438 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c7e16e-db48-4b35-8964-f2f3e6918cd1 None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:21:37.641087 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c7e16e-db48-4b35-8964-f2f3e6918cd1 None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:21:37.683564 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe949dac-aab7-4b26-bffa-5125fe942eeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:21:37.684663 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe949dac-aab7-4b26-bffa-5125fe942eeb None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:21:37.685177 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe949dac-aab7-4b26-bffa-5125fe942eeb None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:21:37.685674 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe949dac-aab7-4b26-bffa-5125fe942eeb None admin] PATH_INFO: `/v3/roles` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:21:37.686669 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe949dac-aab7-4b26-bffa-5125fe942eeb None admin] RBAC: Adding query filter params (name=reader) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:21:37.687183 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe949dac-aab7-4b26-bffa-5125fe942eeb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:21:37.688839 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe949dac-aab7-4b26-bffa-5125fe942eeb None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:21:37.699245 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 72/153] 10.222.0.23 () {56 vars in 1101 bytes} [Tue May 10 05:21:37 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:21:37.705438 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4944531-e03e-4d45-a37a-4aeb8811b46b None admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:21:37.816352 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4944531-e03e-4d45-a37a-4aeb8811b46b None admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:21:37.853245 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333a3f44-ba83-474b-a501-b59449e98e52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:21:37.854216 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333a3f44-ba83-474b-a501-b59449e98e52 None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:21:37.854509 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333a3f44-ba83-474b-a501-b59449e98e52 None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:21:37.854782 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333a3f44-ba83-474b-a501-b59449e98e52 None admin] PATH_INFO: `/v3/users/bc821ebbf7b44fd9809a440fc070f4ff` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:21:37.856043 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333a3f44-ba83-474b-a501-b59449e98e52 None admin] RBAC: Authorizing `identity:get_user(user_id=bc821ebbf7b44fd9809a440fc070f4ff)` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:21:37.857534 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333a3f44-ba83-474b-a501-b59449e98e52 None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:21:37.859558 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 82/154] 10.222.0.23 () {56 vars in 1177 bytes} [Tue May 10 05:21:37 2022] GET /identity/v3/users/bc821ebbf7b44fd9809a440fc070f4ff => generated 289 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:21:37.865265 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe949dac-aab7-4b26-bffa-5125fe942eeb None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:21:37.884653 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d82c0e-8902-44c4-9954-3537add69eda None None] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:21:37.884994 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d82c0e-8902-44c4-9954-3537add69eda None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:21:37.885278 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d82c0e-8902-44c4-9954-3537add69eda None None] PATH_INFO: `/` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:21:37.886671 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 83/155] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 10 05:21:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 05:21:37.893902 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edbcdfb-545b-4745-b67e-be3a9ba6a717 None None] REQUEST_METHOD: `POST` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:21:37.894201 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edbcdfb-545b-4745-b67e-be3a9ba6a717 None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:21:37.894455 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edbcdfb-545b-4745-b67e-be3a9ba6a717 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:21:37.915511 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.auth.core [None req-1edbcdfb-545b-4745-b67e-be3a9ba6a717 None None] MFA Rules not processed for user `44883b22532e44049d846938dc2cf423`. Rule list: `[]` (Enabled: `True`). {{(pid=79879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:21:37.916761 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-1edbcdfb-545b-4745-b67e-be3a9ba6a717 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:21:37.983290 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe949dac-aab7-4b26-bffa-5125fe942eeb None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:21:37.985820 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 84/156] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 10 05:21:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 05:21:38.017371 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e1267f-225c-42e3-95a3-a13493fce812 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:21:38.018252 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e1267f-225c-42e3-95a3-a13493fce812 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:21:38.018538 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e1267f-225c-42e3-95a3-a13493fce812 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:21:38.018815 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e1267f-225c-42e3-95a3-a13493fce812 None admin] PATH_INFO: `/v3/projects/294a6d4f4d1f45058a0706d961479db2` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:21:38.020039 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e1267f-225c-42e3-95a3-a13493fce812 None admin] RBAC: Authorizing `identity:get_project(project_id=294a6d4f4d1f45058a0706d961479db2)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:21:38.021574 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e1267f-225c-42e3-95a3-a13493fce812 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:21:38.023640 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 73/157] 10.222.0.23 () {56 vars in 1186 bytes} [Tue May 10 05:21:37 2022] GET /identity/v3/projects/294a6d4f4d1f45058a0706d961479db2 => generated 298 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:21:38.029410 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edbcdfb-545b-4745-b67e-be3a9ba6a717 None None] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:21:38.030560 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e1267f-225c-42e3-95a3-a13493fce812 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:21:38.131329 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e1267f-225c-42e3-95a3-a13493fce812 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:21:38.166373 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de63de6-4977-4edf-9ad6-f57dd8d03261 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:21:38.167511 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de63de6-4977-4edf-9ad6-f57dd8d03261 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:21:38.168019 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de63de6-4977-4edf-9ad6-f57dd8d03261 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:21:38.168119 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edbcdfb-545b-4745-b67e-be3a9ba6a717 None None] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:21:38.168558 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de63de6-4977-4edf-9ad6-f57dd8d03261 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:21:38.181180 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de63de6-4977-4edf-9ad6-f57dd8d03261 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 05:21:38.189520 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application [None req-8de63de6-4977-4edf-9ad6-f57dd8d03261 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 10 05:21:38.189520 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 05:21:38.189520 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 05:21:38.189520 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 05:21:38.189520 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 05:21:38.189520 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 05:21:38.189520 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 05:21:38.189520 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 05:21:38.189520 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 05:21:38.189520 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 05:21:38.189520 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 05:21:38.189520 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 05:21:38.189520 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 05:21:38.189520 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 05:21:38.189520 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 05:21:38.189520 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 05:21:38.190465 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 05:21:38.190465 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 05:21:38.190465 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 05:21:38.190465 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 05:21:38.190465 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 05:21:38.190465 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 05:21:38.190465 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 05:21:38.190465 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 05:21:38.190465 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 05:21:38.190465 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.get_or_create( May 10 05:21:38.190465 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 05:21:38.190465 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application with Lock( May 10 05:21:38.190465 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 05:21:38.190465 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._enter() May 10 05:21:38.190465 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 05:21:38.190465 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 05:21:38.191226 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 05:21:38.191226 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.creator() May 10 05:21:38.191226 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 05:21:38.191226 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application created_value = creator( May 10 05:21:38.191226 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 05:21:38.191226 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 05:21:38.191226 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 05:21:38.191226 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 05:21:38.191226 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 05:21:38.191226 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 05:21:38.191226 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 10 05:21:38.191226 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application May 10 05:21:38.193620 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 74/158] 10.222.0.23 () {56 vars in 1096 bytes} [Tue May 10 05:21:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 05:21:38.202606 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de63de6-4977-4edf-9ad6-f57dd8d03261 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:21:38.238544 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cf0e67-ea0e-4756-bdea-24db1b4f8eec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:21:38.239473 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cf0e67-ea0e-4756-bdea-24db1b4f8eec None admin] REQUEST_METHOD: `PUT` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:21:38.239930 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cf0e67-ea0e-4756-bdea-24db1b4f8eec None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:21:38.240202 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cf0e67-ea0e-4756-bdea-24db1b4f8eec None admin] PATH_INFO: `/v3/projects/294a6d4f4d1f45058a0706d961479db2/users/bc821ebbf7b44fd9809a440fc070f4ff/roles/8df798e3160347fd84a42d1aedd8ccde` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:21:38.242210 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73cf0e67-ea0e-4756-bdea-24db1b4f8eec None admin] RBAC: Authorizing `identity:create_grant(project_id=294a6d4f4d1f45058a0706d961479db2, user_id=bc821ebbf7b44fd9809a440fc070f4ff, role_id=8df798e3160347fd84a42d1aedd8ccde)` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:21:38.243708 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73cf0e67-ea0e-4756-bdea-24db1b4f8eec None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:21:38.266995 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 85/159] 10.222.0.23 () {58 vars in 1439 bytes} [Tue May 10 05:21:38 2022] PUT /identity/v3/projects/294a6d4f4d1f45058a0706d961479db2/users/bc821ebbf7b44fd9809a440fc070f4ff/roles/8df798e3160347fd84a42d1aedd8ccde => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 05:21:38.388708 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de63de6-4977-4edf-9ad6-f57dd8d03261 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:21:38.412006 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a466ff80-25b9-408b-9675-2ee7755102f8 None None] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:21:38.412328 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a466ff80-25b9-408b-9675-2ee7755102f8 None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:21:38.412567 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a466ff80-25b9-408b-9675-2ee7755102f8 None None] PATH_INFO: `/` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:21:38.414169 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 86/160] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 10 05:21:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 05:21:38.422866 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f532982-ce7d-4aa5-800e-9d1419075faa None None] REQUEST_METHOD: `POST` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:21:38.423155 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f532982-ce7d-4aa5-800e-9d1419075faa None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:21:38.423481 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f532982-ce7d-4aa5-800e-9d1419075faa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:21:38.425315 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf6f937-ae41-439c-8caf-c64cc78afcc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:21:38.426000 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf6f937-ae41-439c-8caf-c64cc78afcc2 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:21:38.426286 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf6f937-ae41-439c-8caf-c64cc78afcc2 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:21:38.426564 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf6f937-ae41-439c-8caf-c64cc78afcc2 None admin] PATH_INFO: `/v3/roles` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:21:38.427387 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf6f937-ae41-439c-8caf-c64cc78afcc2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:21:38.427730 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf6f937-ae41-439c-8caf-c64cc78afcc2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:21:38.429174 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf6f937-ae41-439c-8caf-c64cc78afcc2 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:21:38.439423 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 75/161] 10.222.0.23 () {56 vars in 1099 bytes} [Tue May 10 05:21:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:21:38.446254 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf6f937-ae41-439c-8caf-c64cc78afcc2 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:21:38.456777 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.auth.core [None req-6f532982-ce7d-4aa5-800e-9d1419075faa None None] MFA Rules not processed for user `44883b22532e44049d846938dc2cf423`. Rule list: `[]` (Enabled: `True`). {{(pid=79879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:21:38.457651 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-6f532982-ce7d-4aa5-800e-9d1419075faa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:21:38.554981 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf6f937-ae41-439c-8caf-c64cc78afcc2 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:21:38.578743 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 87/162] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 10 05:21:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 10 05:21:38.595066 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef762ab-a485-4551-b223-bd6aad201e9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:21:38.596438 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef762ab-a485-4551-b223-bd6aad201e9e None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:21:38.596917 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef762ab-a485-4551-b223-bd6aad201e9e None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:21:38.597379 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef762ab-a485-4551-b223-bd6aad201e9e None admin] PATH_INFO: `/v3/users/44883b22532e44049d846938dc2cf423` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:21:38.598774 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef762ab-a485-4551-b223-bd6aad201e9e None admin] RBAC: Authorizing `identity:get_user(user_id=44883b22532e44049d846938dc2cf423)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:21:38.600561 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef762ab-a485-4551-b223-bd6aad201e9e None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:21:38.602744 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 76/163] 10.222.0.23 () {56 vars in 1177 bytes} [Tue May 10 05:21:38 2022] GET /identity/v3/users/44883b22532e44049d846938dc2cf423 => generated 247 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:21:38.608109 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f532982-ce7d-4aa5-800e-9d1419075faa None None] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:21:38.623501 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef762ab-a485-4551-b223-bd6aad201e9e None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:21:38.738795 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f532982-ce7d-4aa5-800e-9d1419075faa None None] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:21:38.781517 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b3b746-5f1f-44f2-b42f-7685dd5ac041 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:21:38.782189 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b3b746-5f1f-44f2-b42f-7685dd5ac041 None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:21:38.782472 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b3b746-5f1f-44f2-b42f-7685dd5ac041 None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:21:38.782748 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b3b746-5f1f-44f2-b42f-7685dd5ac041 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:21:38.820098 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef762ab-a485-4551-b223-bd6aad201e9e None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:21:38.858842 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c94d23-23d8-44b7-812b-111074efd315 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:21:38.859680 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c94d23-23d8-44b7-812b-111074efd315 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:21:38.860198 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c94d23-23d8-44b7-812b-111074efd315 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:21:38.860624 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c94d23-23d8-44b7-812b-111074efd315 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:21:38.872013 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c94d23-23d8-44b7-812b-111074efd315 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 05:21:38.880223 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application [None req-88c94d23-23d8-44b7-812b-111074efd315 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 10 05:21:38.880223 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 05:21:38.880223 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 05:21:38.880223 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 05:21:38.880223 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 05:21:38.880223 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 05:21:38.880223 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 05:21:38.880223 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 05:21:38.880223 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 05:21:38.880223 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 05:21:38.880223 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 05:21:38.880223 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 05:21:38.880223 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 05:21:38.880223 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 05:21:38.880223 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 05:21:38.880223 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 05:21:38.881293 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 05:21:38.881293 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 05:21:38.881293 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 05:21:38.881293 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 05:21:38.881293 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 05:21:38.881293 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 05:21:38.881293 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 05:21:38.881293 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 05:21:38.881293 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 05:21:38.881293 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.get_or_create( May 10 05:21:38.881293 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 05:21:38.881293 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application with Lock( May 10 05:21:38.881293 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 05:21:38.881293 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._enter() May 10 05:21:38.881293 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 05:21:38.881293 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 05:21:38.882314 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 05:21:38.882314 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.creator() May 10 05:21:38.882314 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 05:21:38.882314 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application created_value = creator( May 10 05:21:38.882314 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 05:21:38.882314 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 05:21:38.882314 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 05:21:38.882314 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 05:21:38.882314 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 05:21:38.882314 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 05:21:38.882314 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 10 05:21:38.882314 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application May 10 05:21:38.884393 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 77/164] 10.222.0.23 () {56 vars in 1099 bytes} [Tue May 10 05:21:38 2022] GET /identity/v3/roles/member => generated 84 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 05:21:38.885929 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03969ffa-bc57-47d4-ab23-d83e6b49fbbb None None] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:21:38.886400 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03969ffa-bc57-47d4-ab23-d83e6b49fbbb None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:21:38.886847 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03969ffa-bc57-47d4-ab23-d83e6b49fbbb None None] PATH_INFO: `/` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:21:38.888376 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 78/165] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 10 05:21:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 05:21:38.893347 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03969ffa-bc57-47d4-ab23-d83e6b49fbbb None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:21:38.910168 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b3b746-5f1f-44f2-b42f-7685dd5ac041 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:21:38.911745 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b3b746-5f1f-44f2-b42f-7685dd5ac041 None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:21:38.994970 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03969ffa-bc57-47d4-ab23-d83e6b49fbbb None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:21:39.039759 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e369c69f-772d-4726-b9b4-da79191ee52d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:21:39.040754 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e369c69f-772d-4726-b9b4-da79191ee52d None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:21:39.041260 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e369c69f-772d-4726-b9b4-da79191ee52d None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:21:39.041708 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e369c69f-772d-4726-b9b4-da79191ee52d None admin] PATH_INFO: `/v3/roles` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:21:39.042639 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e369c69f-772d-4726-b9b4-da79191ee52d None admin] RBAC: Adding query filter params (name=member) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:21:39.044015 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e369c69f-772d-4726-b9b4-da79191ee52d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:21:39.045826 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e369c69f-772d-4726-b9b4-da79191ee52d None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:21:39.065613 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 79/166] 10.222.0.23 () {56 vars in 1101 bytes} [Tue May 10 05:21:38 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:21:39.065972 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 88/167] 10.222.0.23 () {58 vars in 1282 bytes} [Tue May 10 05:21:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 458 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 05:21:39.067765 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bfb07a-b825-442f-b2e7-1c3d0468fe6d None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:21:39.068255 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bfb07a-b825-442f-b2e7-1c3d0468fe6d None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:21:39.068705 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bfb07a-b825-442f-b2e7-1c3d0468fe6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:21:39.071524 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b3b746-5f1f-44f2-b42f-7685dd5ac041 None admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:21:39.112689 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-23bfb07a-b825-442f-b2e7-1c3d0468fe6d None None] MFA Rules not processed for user `44883b22532e44049d846938dc2cf423`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:21:39.114206 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-23bfb07a-b825-442f-b2e7-1c3d0468fe6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:21:39.205286 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b3b746-5f1f-44f2-b42f-7685dd5ac041 None admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:21:39.244360 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f8e50d-3e7b-47ca-bf27-c524e739d7dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:21:39.246095 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f8e50d-3e7b-47ca-bf27-c524e739d7dc None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:21:39.246654 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f8e50d-3e7b-47ca-bf27-c524e739d7dc None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:21:39.247075 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f8e50d-3e7b-47ca-bf27-c524e739d7dc None admin] PATH_INFO: `/v3/projects/294a6d4f4d1f45058a0706d961479db2` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:21:39.248819 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f8e50d-3e7b-47ca-bf27-c524e739d7dc None admin] RBAC: Authorizing `identity:get_project(project_id=294a6d4f4d1f45058a0706d961479db2)` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:21:39.251137 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f8e50d-3e7b-47ca-bf27-c524e739d7dc None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:21:39.253469 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 89/168] 10.222.0.23 () {56 vars in 1186 bytes} [Tue May 10 05:21:39 2022] GET /identity/v3/projects/294a6d4f4d1f45058a0706d961479db2 => generated 298 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:21:39.255016 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f8e50d-3e7b-47ca-bf27-c524e739d7dc None admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:21:39.293243 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 80/169] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 10 05:21:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 05:21:39.294402 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bfb07a-b825-442f-b2e7-1c3d0468fe6d None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:21:39.363797 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f8e50d-3e7b-47ca-bf27-c524e739d7dc None admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:21:39.405191 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4f2bb5-5ab6-44c0-81d4-8e83fc37e956 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:21:39.406475 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4f2bb5-5ab6-44c0-81d4-8e83fc37e956 None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:21:39.407905 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4f2bb5-5ab6-44c0-81d4-8e83fc37e956 None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:21:39.408948 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4f2bb5-5ab6-44c0-81d4-8e83fc37e956 None admin] PATH_INFO: `/v3/users/6356a96ee91d4828b89e3791aae2bb59` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:21:39.411082 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4f2bb5-5ab6-44c0-81d4-8e83fc37e956 None admin] RBAC: Authorizing `identity:get_user(user_id=6356a96ee91d4828b89e3791aae2bb59)` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:21:39.415207 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4f2bb5-5ab6-44c0-81d4-8e83fc37e956 None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:21:39.417153 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 90/170] 10.222.0.23 () {56 vars in 1177 bytes} [Tue May 10 05:21:39 2022] GET /identity/v3/users/6356a96ee91d4828b89e3791aae2bb59 => generated 275 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:21:39.418989 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4f2bb5-5ab6-44c0-81d4-8e83fc37e956 None admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:21:39.490551 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bfb07a-b825-442f-b2e7-1c3d0468fe6d None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:21:39.567722 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18838eb-8975-405f-915e-66bd00b0c1bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:21:39.569256 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18838eb-8975-405f-915e-66bd00b0c1bd None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:21:39.569878 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18838eb-8975-405f-915e-66bd00b0c1bd None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:21:39.570327 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18838eb-8975-405f-915e-66bd00b0c1bd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:21:39.571729 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18838eb-8975-405f-915e-66bd00b0c1bd None admin] RBAC: Adding query filter params (role.id=199ac1dd842441d7913c6ee89d8fbecc, scope.project.id=294a6d4f4d1f45058a0706d961479db2, user.id=44883b22532e44049d846938dc2cf423) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:21:39.572188 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18838eb-8975-405f-915e-66bd00b0c1bd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:21:39.574018 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18838eb-8975-405f-915e-66bd00b0c1bd None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:21:39.581279 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 81/171] 10.222.0.23 () {56 vars in 1374 bytes} [Tue May 10 05:21:39 2022] GET /identity/v3/role_assignments?user.id=44883b22532e44049d846938dc2cf423&scope.project.id=294a6d4f4d1f45058a0706d961479db2&role.id=199ac1dd842441d7913c6ee89d8fbecc => generated 608 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:21:39.582518 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18838eb-8975-405f-915e-66bd00b0c1bd None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:21:39.665828 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4f2bb5-5ab6-44c0-81d4-8e83fc37e956 None admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:21:39.698422 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18838eb-8975-405f-915e-66bd00b0c1bd None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:21:39.739034 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4746bfa9-a939-4dba-97a3-1bd4e70743a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:21:39.740082 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4746bfa9-a939-4dba-97a3-1bd4e70743a7 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:21:39.740509 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4746bfa9-a939-4dba-97a3-1bd4e70743a7 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:21:39.741329 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4746bfa9-a939-4dba-97a3-1bd4e70743a7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:21:39.753184 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caea3769-46e6-4028-a49c-bf2355b1ae35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:21:39.754454 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caea3769-46e6-4028-a49c-bf2355b1ae35 None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:21:39.754454 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caea3769-46e6-4028-a49c-bf2355b1ae35 None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:21:39.754845 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caea3769-46e6-4028-a49c-bf2355b1ae35 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:21:39.788528 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caea3769-46e6-4028-a49c-bf2355b1ae35 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 05:21:39.797043 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application [None req-caea3769-46e6-4028-a49c-bf2355b1ae35 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 10 05:21:39.797043 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 05:21:39.797043 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 05:21:39.797043 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 05:21:39.797043 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 05:21:39.797043 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 05:21:39.797043 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 05:21:39.797043 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 05:21:39.797043 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 05:21:39.797043 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 05:21:39.797043 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 05:21:39.797043 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 05:21:39.797043 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 05:21:39.797043 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 05:21:39.797043 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 05:21:39.797043 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 05:21:39.798098 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 05:21:39.798098 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 05:21:39.798098 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 05:21:39.798098 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 05:21:39.798098 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 05:21:39.798098 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 05:21:39.798098 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 05:21:39.798098 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 05:21:39.798098 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 05:21:39.798098 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.get_or_create( May 10 05:21:39.798098 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 05:21:39.798098 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application with Lock( May 10 05:21:39.798098 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 05:21:39.798098 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self._enter() May 10 05:21:39.798098 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 05:21:39.798098 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 05:21:39.799059 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 05:21:39.799059 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.creator() May 10 05:21:39.799059 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 05:21:39.799059 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application created_value = creator( May 10 05:21:39.799059 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 05:21:39.799059 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 05:21:39.799059 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 05:21:39.799059 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 05:21:39.799059 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 05:21:39.799059 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 05:21:39.799059 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 10 05:21:39.799059 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application May 10 05:21:39.805346 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 91/172] 10.222.0.23 () {56 vars in 1114 bytes} [Tue May 10 05:21:39 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 387 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 05:21:39.811342 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caea3769-46e6-4028-a49c-bf2355b1ae35 None admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:21:39.824999 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4746bfa9-a939-4dba-97a3-1bd4e70743a7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:21:39.826802 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4746bfa9-a939-4dba-97a3-1bd4e70743a7 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:21:39.947535 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 82/173] 10.222.0.23 () {58 vars in 1282 bytes} [Tue May 10 05:21:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 05:21:39.958109 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4746bfa9-a939-4dba-97a3-1bd4e70743a7 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:21:40.067189 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caea3769-46e6-4028-a49c-bf2355b1ae35 None admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:21:40.149363 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63e6bbb-4f88-4366-be7a-6e8b58e7f101 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:21:40.149990 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63e6bbb-4f88-4366-be7a-6e8b58e7f101 None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:21:40.150275 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63e6bbb-4f88-4366-be7a-6e8b58e7f101 None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:21:40.150550 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63e6bbb-4f88-4366-be7a-6e8b58e7f101 None admin] PATH_INFO: `/v3/roles` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:21:40.151331 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63e6bbb-4f88-4366-be7a-6e8b58e7f101 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:21:40.151664 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63e6bbb-4f88-4366-be7a-6e8b58e7f101 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:21:40.153063 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63e6bbb-4f88-4366-be7a-6e8b58e7f101 None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:21:40.163480 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4746bfa9-a939-4dba-97a3-1bd4e70743a7 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:21:40.170826 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 92/174] 10.222.0.23 () {56 vars in 1111 bytes} [Tue May 10 05:21:39 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 360 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 05:21:40.176052 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63e6bbb-4f88-4366-be7a-6e8b58e7f101 None admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:21:40.244353 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c7e2d5-a6d0-476b-a56a-725ba55f7409 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:21:40.245283 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c7e2d5-a6d0-476b-a56a-725ba55f7409 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:21:40.245576 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c7e2d5-a6d0-476b-a56a-725ba55f7409 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:21:40.246230 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c7e2d5-a6d0-476b-a56a-725ba55f7409 None admin] PATH_INFO: `/v3/projects/02d16b4bd3b845fcab79fa11b3a3fb3d` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:21:40.247612 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c7e2d5-a6d0-476b-a56a-725ba55f7409 None admin] RBAC: Authorizing `identity:get_project(project_id=02d16b4bd3b845fcab79fa11b3a3fb3d)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:21:40.249108 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c7e2d5-a6d0-476b-a56a-725ba55f7409 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:21:40.250963 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 83/175] 10.222.0.23 () {56 vars in 1186 bytes} [Tue May 10 05:21:39 2022] GET /identity/v3/projects/02d16b4bd3b845fcab79fa11b3a3fb3d => generated 312 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:21:40.257013 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c7e2d5-a6d0-476b-a56a-725ba55f7409 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:21:40.413809 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63e6bbb-4f88-4366-be7a-6e8b58e7f101 None admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:21:40.415838 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c7e2d5-a6d0-476b-a56a-725ba55f7409 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:21:40.458410 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea015d18-a396-4bc6-a47a-f3c7a02311c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:21:40.459097 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea015d18-a396-4bc6-a47a-f3c7a02311c4 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:21:40.459376 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea015d18-a396-4bc6-a47a-f3c7a02311c4 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:21:40.459673 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea015d18-a396-4bc6-a47a-f3c7a02311c4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:21:40.460543 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea015d18-a396-4bc6-a47a-f3c7a02311c4 None admin] RBAC: Adding query filter params (role.id=382636e67fc142a2b2f486340d959e11, scope.project.id=02d16b4bd3b845fcab79fa11b3a3fb3d, user.id=6356a96ee91d4828b89e3791aae2bb59) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:21:40.460845 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea015d18-a396-4bc6-a47a-f3c7a02311c4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:21:40.468307 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea015d18-a396-4bc6-a47a-f3c7a02311c4 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:21:40.471974 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5098f0ed-4041-4630-9113-7a5e33e44daa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:21:40.475374 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5098f0ed-4041-4630-9113-7a5e33e44daa None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:21:40.476001 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5098f0ed-4041-4630-9113-7a5e33e44daa None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:21:40.476521 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5098f0ed-4041-4630-9113-7a5e33e44daa None admin] PATH_INFO: `/v3/users/6356a96ee91d4828b89e3791aae2bb59` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:21:40.478172 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5098f0ed-4041-4630-9113-7a5e33e44daa None admin] RBAC: Authorizing `identity:get_user(user_id=6356a96ee91d4828b89e3791aae2bb59)` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:21:40.480865 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5098f0ed-4041-4630-9113-7a5e33e44daa None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:21:40.483271 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 93/176] 10.222.0.23 () {56 vars in 1177 bytes} [Tue May 10 05:21:40 2022] GET /identity/v3/users/6356a96ee91d4828b89e3791aae2bb59 => generated 275 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 05:21:40.486368 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 84/177] 10.222.0.23 () {56 vars in 1374 bytes} [Tue May 10 05:21:40 2022] GET /identity/v3/role_assignments?user.id=6356a96ee91d4828b89e3791aae2bb59&scope.project.id=02d16b4bd3b845fcab79fa11b3a3fb3d&role.id=382636e67fc142a2b2f486340d959e11 => generated 608 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:21:40.488523 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5098f0ed-4041-4630-9113-7a5e33e44daa None admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:21:40.640514 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5098f0ed-4041-4630-9113-7a5e33e44daa None admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:21:40.687383 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c43e76-eb07-4e7b-a31d-80c211675780 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:21:40.688423 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c43e76-eb07-4e7b-a31d-80c211675780 None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:21:40.688944 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c43e76-eb07-4e7b-a31d-80c211675780 None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:21:40.689414 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c43e76-eb07-4e7b-a31d-80c211675780 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:21:40.779211 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c43e76-eb07-4e7b-a31d-80c211675780 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:21:40.781694 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c43e76-eb07-4e7b-a31d-80c211675780 None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:21:40.891536 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 94/178] 10.222.0.23 () {58 vars in 1282 bytes} [Tue May 10 05:21:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 05:21:40.897622 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea015d18-a396-4bc6-a47a-f3c7a02311c4 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:21:41.000812 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1357fc-439b-4ea5-b751-a4194555043c None None] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:21:41.001479 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1357fc-439b-4ea5-b751-a4194555043c None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:21:41.001953 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1357fc-439b-4ea5-b751-a4194555043c None None] PATH_INFO: `/` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:21:41.003556 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 95/179] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 10 05:21:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 05:21:41.008947 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d9658f-0836-40a1-95d0-6e33e6d368b7 None None] REQUEST_METHOD: `POST` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:21:41.009481 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d9658f-0836-40a1-95d0-6e33e6d368b7 None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:21:41.009959 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d9658f-0836-40a1-95d0-6e33e6d368b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:21:41.033775 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.auth.core [None req-33d9658f-0836-40a1-95d0-6e33e6d368b7 None None] MFA Rules not processed for user `44883b22532e44049d846938dc2cf423`. Rule list: `[]` (Enabled: `True`). {{(pid=79879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:21:41.035310 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-33d9658f-0836-40a1-95d0-6e33e6d368b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:21:41.039314 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea015d18-a396-4bc6-a47a-f3c7a02311c4 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:21:41.076673 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71022bf8-7d8f-4bf5-a012-767afca1a338 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:21:41.077573 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71022bf8-7d8f-4bf5-a012-767afca1a338 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:21:41.077855 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71022bf8-7d8f-4bf5-a012-767afca1a338 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:21:41.078130 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71022bf8-7d8f-4bf5-a012-767afca1a338 None admin] PATH_INFO: `/v3/projects/294a6d4f4d1f45058a0706d961479db2` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:21:41.079344 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71022bf8-7d8f-4bf5-a012-767afca1a338 None admin] RBAC: Authorizing `identity:get_project(project_id=294a6d4f4d1f45058a0706d961479db2)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:21:41.080863 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71022bf8-7d8f-4bf5-a012-767afca1a338 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:21:41.082631 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 85/180] 10.222.0.23 () {56 vars in 1186 bytes} [Tue May 10 05:21:40 2022] GET /identity/v3/projects/294a6d4f4d1f45058a0706d961479db2 => generated 298 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:21:41.088562 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71022bf8-7d8f-4bf5-a012-767afca1a338 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:21:41.162445 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 96/181] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 10 05:21:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 10 05:21:41.229188 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71022bf8-7d8f-4bf5-a012-767afca1a338 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:21:41.242726 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d9658f-0836-40a1-95d0-6e33e6d368b7 None None] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:21:41.291261 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e5abec-a43f-4e1d-8b37-ee83fbf9b4fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:21:41.291973 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e5abec-a43f-4e1d-8b37-ee83fbf9b4fa None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:21:41.292252 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e5abec-a43f-4e1d-8b37-ee83fbf9b4fa None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:21:41.292525 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e5abec-a43f-4e1d-8b37-ee83fbf9b4fa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:21:41.293675 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e5abec-a43f-4e1d-8b37-ee83fbf9b4fa None admin] RBAC: Adding query filter params (role.id=b0cb991ebc2d42d5a5de343c57086616, scope.project.id=294a6d4f4d1f45058a0706d961479db2, user.id=6356a96ee91d4828b89e3791aae2bb59) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:21:41.293982 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e5abec-a43f-4e1d-8b37-ee83fbf9b4fa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:21:41.295453 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e5abec-a43f-4e1d-8b37-ee83fbf9b4fa None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:21:41.316127 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 86/182] 10.222.0.23 () {56 vars in 1374 bytes} [Tue May 10 05:21:41 2022] GET /identity/v3/role_assignments?user.id=6356a96ee91d4828b89e3791aae2bb59&scope.project.id=294a6d4f4d1f45058a0706d961479db2&role.id=b0cb991ebc2d42d5a5de343c57086616 => generated 608 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:21:41.395324 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d9658f-0836-40a1-95d0-6e33e6d368b7 None None] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:21:41.453622 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e76654-09c5-4cd3-8e46-08485cc3dc82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:21:41.454996 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e76654-09c5-4cd3-8e46-08485cc3dc82 None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:21:41.455497 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e76654-09c5-4cd3-8e46-08485cc3dc82 None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:21:41.456025 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e76654-09c5-4cd3-8e46-08485cc3dc82 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:21:41.488477 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e76654-09c5-4cd3-8e46-08485cc3dc82 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 05:21:41.497521 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application [None req-02e76654-09c5-4cd3-8e46-08485cc3dc82 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 10 05:21:41.497521 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 05:21:41.497521 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 05:21:41.497521 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 05:21:41.497521 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 05:21:41.497521 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 05:21:41.497521 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 05:21:41.497521 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 05:21:41.497521 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 05:21:41.497521 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 05:21:41.497521 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 05:21:41.497521 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 05:21:41.497521 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 05:21:41.497521 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 05:21:41.497521 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 05:21:41.497521 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 05:21:41.498495 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 05:21:41.498495 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 05:21:41.498495 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 05:21:41.498495 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 05:21:41.498495 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 05:21:41.498495 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 05:21:41.498495 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 05:21:41.498495 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 05:21:41.498495 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 05:21:41.498495 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.get_or_create( May 10 05:21:41.498495 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 05:21:41.498495 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application with Lock( May 10 05:21:41.498495 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 05:21:41.498495 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self._enter() May 10 05:21:41.498495 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 05:21:41.498495 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 05:21:41.499317 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 05:21:41.499317 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.creator() May 10 05:21:41.499317 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 05:21:41.499317 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application created_value = creator( May 10 05:21:41.499317 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 05:21:41.499317 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 05:21:41.499317 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 05:21:41.499317 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 05:21:41.499317 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 05:21:41.499317 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 05:21:41.499317 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 10 05:21:41.499317 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application May 10 05:21:41.502029 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 97/183] 10.222.0.23 () {56 vars in 1096 bytes} [Tue May 10 05:21:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 05:21:41.512807 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e5abec-a43f-4e1d-8b37-ee83fbf9b4fa None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:21:41.564684 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc377e39-73d5-4640-b0dc-f149afeeb067 None None] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:21:41.565319 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc377e39-73d5-4640-b0dc-f149afeeb067 None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:21:41.565789 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc377e39-73d5-4640-b0dc-f149afeeb067 None None] PATH_INFO: `/` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:21:41.567466 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 98/184] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 10 05:21:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 05:21:41.573424 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bb4561-d047-48f9-9b88-ab82d6215f67 None None] REQUEST_METHOD: `POST` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:21:41.574012 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bb4561-d047-48f9-9b88-ab82d6215f67 None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:21:41.574574 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bb4561-d047-48f9-9b88-ab82d6215f67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:21:41.601715 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.auth.core [None req-93bb4561-d047-48f9-9b88-ab82d6215f67 None None] MFA Rules not processed for user `44883b22532e44049d846938dc2cf423`. Rule list: `[]` (Enabled: `True`). {{(pid=79879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:21:41.602924 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-93bb4561-d047-48f9-9b88-ab82d6215f67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:21:41.629739 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e5abec-a43f-4e1d-8b37-ee83fbf9b4fa None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:21:41.667069 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3289567a-9257-4b97-9606-cc7fab164ee3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:21:41.667807 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3289567a-9257-4b97-9606-cc7fab164ee3 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:21:41.668094 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3289567a-9257-4b97-9606-cc7fab164ee3 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:21:41.668365 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3289567a-9257-4b97-9606-cc7fab164ee3 None admin] PATH_INFO: `/v3/roles` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:21:41.669146 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3289567a-9257-4b97-9606-cc7fab164ee3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:21:41.669448 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3289567a-9257-4b97-9606-cc7fab164ee3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:21:41.670849 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3289567a-9257-4b97-9606-cc7fab164ee3 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:21:41.680252 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 87/185] 10.222.0.23 () {56 vars in 1099 bytes} [Tue May 10 05:21:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:21:41.691675 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3289567a-9257-4b97-9606-cc7fab164ee3 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:21:41.715601 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 99/186] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 10 05:21:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 10 05:21:41.726171 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067f63fb-5795-4283-8460-1dc8e3d537e9 None None] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:21:41.726454 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067f63fb-5795-4283-8460-1dc8e3d537e9 None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:21:41.726735 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067f63fb-5795-4283-8460-1dc8e3d537e9 None None] PATH_INFO: `/` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:21:41.728295 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 100/187] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 10 05:21:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 05:21:41.733662 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb7eea4-2fa0-426c-b2ed-e049eb7d7f39 None None] REQUEST_METHOD: `POST` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:21:41.734178 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb7eea4-2fa0-426c-b2ed-e049eb7d7f39 None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:21:41.734641 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb7eea4-2fa0-426c-b2ed-e049eb7d7f39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:21:41.752463 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.auth.core [None req-fcb7eea4-2fa0-426c-b2ed-e049eb7d7f39 None None] MFA Rules not processed for user `44883b22532e44049d846938dc2cf423`. Rule list: `[]` (Enabled: `True`). {{(pid=79879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:21:41.754028 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-fcb7eea4-2fa0-426c-b2ed-e049eb7d7f39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:21:41.811114 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3289567a-9257-4b97-9606-cc7fab164ee3 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:21:41.835971 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 101/188] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 10 05:21:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 10 05:21:41.836538 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb7eea4-2fa0-426c-b2ed-e049eb7d7f39 None None] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:21:41.846972 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9cee51-f139-4887-bce8-14f7ff1397c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:21:41.848442 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9cee51-f139-4887-bce8-14f7ff1397c8 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:21:41.848913 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9cee51-f139-4887-bce8-14f7ff1397c8 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:21:41.849640 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9cee51-f139-4887-bce8-14f7ff1397c8 None admin] PATH_INFO: `/v3/users/cc50aa11bf2a41638dc00b154aa382b2` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:21:41.865876 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9cee51-f139-4887-bce8-14f7ff1397c8 None admin] RBAC: Authorizing `identity:get_user(user_id=cc50aa11bf2a41638dc00b154aa382b2)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:21:41.867362 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9cee51-f139-4887-bce8-14f7ff1397c8 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:21:41.869156 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 88/189] 10.222.0.23 () {56 vars in 1177 bytes} [Tue May 10 05:21:41 2022] GET /identity/v3/users/cc50aa11bf2a41638dc00b154aa382b2 => generated 283 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 05:21:41.869989 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9cee51-f139-4887-bce8-14f7ff1397c8 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:21:41.941718 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb7eea4-2fa0-426c-b2ed-e049eb7d7f39 None None] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:21:41.964656 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9cee51-f139-4887-bce8-14f7ff1397c8 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:21:41.974351 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5427597b-b49e-4172-a090-9264a138dc96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:21:41.975173 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5427597b-b49e-4172-a090-9264a138dc96 None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:21:41.975455 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5427597b-b49e-4172-a090-9264a138dc96 None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:21:41.975763 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5427597b-b49e-4172-a090-9264a138dc96 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:21:41.985396 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5427597b-b49e-4172-a090-9264a138dc96 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 05:21:41.993480 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application [None req-5427597b-b49e-4172-a090-9264a138dc96 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 10 05:21:41.993480 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 05:21:41.993480 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 05:21:41.993480 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 05:21:41.993480 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 05:21:41.993480 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 05:21:41.993480 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 05:21:41.993480 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 05:21:41.993480 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 05:21:41.993480 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 05:21:41.993480 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 05:21:41.993480 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 05:21:41.993480 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 05:21:41.993480 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 05:21:41.993480 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 05:21:41.993480 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 05:21:41.994339 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 05:21:41.994339 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 05:21:41.994339 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 05:21:41.994339 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 05:21:41.994339 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 05:21:41.994339 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 05:21:41.994339 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 05:21:41.994339 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 05:21:41.994339 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 05:21:41.994339 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.get_or_create( May 10 05:21:41.994339 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 05:21:41.994339 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application with Lock( May 10 05:21:41.994339 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 05:21:41.994339 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self._enter() May 10 05:21:41.994339 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 05:21:41.994339 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 05:21:41.995125 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 05:21:41.995125 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.creator() May 10 05:21:41.995125 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 05:21:41.995125 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application created_value = creator( May 10 05:21:41.995125 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 05:21:41.995125 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 05:21:41.995125 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 05:21:41.995125 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 05:21:41.995125 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 05:21:41.995125 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 05:21:41.995125 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 10 05:21:41.995125 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application May 10 05:21:41.995125 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 102/190] 10.222.0.23 () {56 vars in 1114 bytes} [Tue May 10 05:21:41 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 05:21:41.996190 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5427597b-b49e-4172-a090-9264a138dc96 None admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:21:42.001298 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab8b7fe-1bbe-4780-93f5-9e3cfd6478c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:21:42.002107 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab8b7fe-1bbe-4780-93f5-9e3cfd6478c4 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:21:42.002386 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab8b7fe-1bbe-4780-93f5-9e3cfd6478c4 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:21:42.002654 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab8b7fe-1bbe-4780-93f5-9e3cfd6478c4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:21:42.003837 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab8b7fe-1bbe-4780-93f5-9e3cfd6478c4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:21:42.005339 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab8b7fe-1bbe-4780-93f5-9e3cfd6478c4 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:21:42.006968 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 89/191] 10.222.0.23 () {56 vars in 1108 bytes} [Tue May 10 05:21:41 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:21:42.008206 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a0a687-874e-407d-8ff3-c2aad2dcaa3e None None] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:21:42.008488 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a0a687-874e-407d-8ff3-c2aad2dcaa3e None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:21:42.008758 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a0a687-874e-407d-8ff3-c2aad2dcaa3e None None] PATH_INFO: `/` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:21:42.009961 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 90/192] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 10 05:21:42 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 05:21:42.010649 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a0a687-874e-407d-8ff3-c2aad2dcaa3e None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:21:42.088067 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5427597b-b49e-4172-a090-9264a138dc96 None admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:21:42.108623 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a0a687-874e-407d-8ff3-c2aad2dcaa3e None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:21:42.120443 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054a9016-fb3b-4c9b-98ed-b0e9da889d81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:21:42.121444 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054a9016-fb3b-4c9b-98ed-b0e9da889d81 None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:21:42.121712 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054a9016-fb3b-4c9b-98ed-b0e9da889d81 None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:21:42.121980 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054a9016-fb3b-4c9b-98ed-b0e9da889d81 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:21:42.142086 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d428411-f759-44ef-9286-981b7b158351 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:21:42.142832 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d428411-f759-44ef-9286-981b7b158351 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:21:42.143110 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d428411-f759-44ef-9286-981b7b158351 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:21:42.143387 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d428411-f759-44ef-9286-981b7b158351 None admin] PATH_INFO: `/v3/roles` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:21:42.144259 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d428411-f759-44ef-9286-981b7b158351 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:21:42.144572 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d428411-f759-44ef-9286-981b7b158351 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:21:42.145968 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d428411-f759-44ef-9286-981b7b158351 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:21:42.153850 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 91/193] 10.222.0.23 () {56 vars in 1111 bytes} [Tue May 10 05:21:42 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:21:42.154607 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d428411-f759-44ef-9286-981b7b158351 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:21:42.183847 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054a9016-fb3b-4c9b-98ed-b0e9da889d81 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:21:42.185328 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054a9016-fb3b-4c9b-98ed-b0e9da889d81 None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:21:42.249038 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d428411-f759-44ef-9286-981b7b158351 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:21:42.280874 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 103/194] 10.222.0.23 () {58 vars in 1282 bytes} [Tue May 10 05:21:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 286 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 05:21:42.282337 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cefebd-1397-4ed1-beb6-6dbeada10c34 None None] REQUEST_METHOD: `POST` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:21:42.282628 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cefebd-1397-4ed1-beb6-6dbeada10c34 None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:21:42.282910 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cefebd-1397-4ed1-beb6-6dbeada10c34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:21:42.284968 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d4e5de-dc6d-481f-b7d8-2b3fec9e4456 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:21:42.285927 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d4e5de-dc6d-481f-b7d8-2b3fec9e4456 None admin] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:21:42.286315 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d4e5de-dc6d-481f-b7d8-2b3fec9e4456 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:21:42.286734 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d4e5de-dc6d-481f-b7d8-2b3fec9e4456 None admin] PATH_INFO: `/v3/users` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:21:42.287536 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d4e5de-dc6d-481f-b7d8-2b3fec9e4456 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:21:42.289169 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d4e5de-dc6d-481f-b7d8-2b3fec9e4456 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:21:42.299175 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.auth.core [None req-d3cefebd-1397-4ed1-beb6-6dbeada10c34 None None] MFA Rules not processed for user `44883b22532e44049d846938dc2cf423`. Rule list: `[]` (Enabled: `True`). {{(pid=79879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:21:42.300642 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-d3cefebd-1397-4ed1-beb6-6dbeada10c34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:21:42.323615 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 92/195] 10.222.0.23 () {60 vars in 1132 bytes} [Tue May 10 05:21:42 2022] POST /identity/v3/users => generated 297 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 05:21:42.323615 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d4e5de-dc6d-481f-b7d8-2b3fec9e4456 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:21:42.386559 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 104/196] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 10 05:21:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 05:21:42.387327 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cefebd-1397-4ed1-beb6-6dbeada10c34 None None] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:21:42.435393 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d4e5de-dc6d-481f-b7d8-2b3fec9e4456 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:21:42.475209 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b2dd38-5202-42a1-9e0f-612240003d10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:21:42.475972 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b2dd38-5202-42a1-9e0f-612240003d10 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:21:42.476251 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b2dd38-5202-42a1-9e0f-612240003d10 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:21:42.476519 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b2dd38-5202-42a1-9e0f-612240003d10 None admin] PATH_INFO: `/v3/users/cc50aa11bf2a41638dc00b154aa382b2` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:21:42.477769 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b2dd38-5202-42a1-9e0f-612240003d10 None admin] RBAC: Authorizing `identity:get_user(user_id=cc50aa11bf2a41638dc00b154aa382b2)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:21:42.479349 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b2dd38-5202-42a1-9e0f-612240003d10 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:21:42.485913 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 93/197] 10.222.0.23 () {56 vars in 1177 bytes} [Tue May 10 05:21:42 2022] GET /identity/v3/users/cc50aa11bf2a41638dc00b154aa382b2 => generated 283 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:21:42.485913 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b2dd38-5202-42a1-9e0f-612240003d10 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:21:42.491170 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cefebd-1397-4ed1-beb6-6dbeada10c34 None None] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:21:42.525264 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0eea31-a6ab-4cad-aac4-1deb7f2773a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:21:42.526152 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0eea31-a6ab-4cad-aac4-1deb7f2773a4 None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:21:42.526434 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0eea31-a6ab-4cad-aac4-1deb7f2773a4 None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:21:42.526699 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0eea31-a6ab-4cad-aac4-1deb7f2773a4 None admin] PATH_INFO: `/v3/projects/c00aac4e3d244bf5a26814ed404a08f0` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:21:42.527940 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0eea31-a6ab-4cad-aac4-1deb7f2773a4 None admin] RBAC: Authorizing `identity:get_project(project_id=c00aac4e3d244bf5a26814ed404a08f0)` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:21:42.529391 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0eea31-a6ab-4cad-aac4-1deb7f2773a4 None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:21:42.531118 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 105/198] 10.222.0.23 () {56 vars in 1186 bytes} [Tue May 10 05:21:42 2022] GET /identity/v3/projects/c00aac4e3d244bf5a26814ed404a08f0 => generated 302 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:21:42.532009 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0eea31-a6ab-4cad-aac4-1deb7f2773a4 None admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:21:42.588655 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b2dd38-5202-42a1-9e0f-612240003d10 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:21:42.626491 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee59f54d-27c3-42bd-9487-adf1e21659e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:21:42.627401 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee59f54d-27c3-42bd-9487-adf1e21659e6 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:21:42.627793 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee59f54d-27c3-42bd-9487-adf1e21659e6 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:21:42.628137 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee59f54d-27c3-42bd-9487-adf1e21659e6 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:21:42.639267 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee59f54d-27c3-42bd-9487-adf1e21659e6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 05:21:42.647930 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0eea31-a6ab-4cad-aac4-1deb7f2773a4 None admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:21:42.648074 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application [None req-ee59f54d-27c3-42bd-9487-adf1e21659e6 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 10 05:21:42.648074 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 05:21:42.648074 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 05:21:42.648074 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 05:21:42.648074 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 05:21:42.648074 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 05:21:42.648074 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 05:21:42.648074 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 05:21:42.648074 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 05:21:42.648074 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 05:21:42.648074 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 05:21:42.648074 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 05:21:42.648074 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 05:21:42.648074 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 05:21:42.648074 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 05:21:42.648074 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 05:21:42.649098 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 05:21:42.649098 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 05:21:42.649098 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 05:21:42.649098 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 05:21:42.649098 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 05:21:42.649098 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 05:21:42.649098 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 05:21:42.649098 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 05:21:42.649098 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 05:21:42.649098 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.get_or_create( May 10 05:21:42.649098 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 05:21:42.649098 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application with Lock( May 10 05:21:42.649098 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 05:21:42.649098 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._enter() May 10 05:21:42.649098 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 05:21:42.649098 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 05:21:42.650057 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 05:21:42.650057 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.creator() May 10 05:21:42.650057 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 05:21:42.650057 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application created_value = creator( May 10 05:21:42.650057 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 05:21:42.650057 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 05:21:42.650057 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 05:21:42.650057 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 05:21:42.650057 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 05:21:42.650057 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 05:21:42.650057 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 10 05:21:42.650057 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application May 10 05:21:42.651547 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 94/199] 10.222.0.23 () {56 vars in 1099 bytes} [Tue May 10 05:21:42 2022] GET /identity/v3/roles/reader => generated 84 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 05:21:42.656566 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee59f54d-27c3-42bd-9487-adf1e21659e6 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:21:42.687691 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6231b6-5978-4b79-bbb1-3ddc21132361 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:21:42.688646 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6231b6-5978-4b79-bbb1-3ddc21132361 None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:21:42.689061 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6231b6-5978-4b79-bbb1-3ddc21132361 None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:21:42.689469 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6231b6-5978-4b79-bbb1-3ddc21132361 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:21:42.760825 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee59f54d-27c3-42bd-9487-adf1e21659e6 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:21:42.761810 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6231b6-5978-4b79-bbb1-3ddc21132361 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:21:42.763325 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6231b6-5978-4b79-bbb1-3ddc21132361 None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:21:42.795081 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c289053d-7c8f-459d-b82a-0ff2678c41b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:21:42.795790 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c289053d-7c8f-459d-b82a-0ff2678c41b6 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:21:42.796089 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c289053d-7c8f-459d-b82a-0ff2678c41b6 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:21:42.796357 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c289053d-7c8f-459d-b82a-0ff2678c41b6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:21:42.797199 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c289053d-7c8f-459d-b82a-0ff2678c41b6 None admin] RBAC: Adding query filter params (role.id=199ac1dd842441d7913c6ee89d8fbecc, scope.project.id=c00aac4e3d244bf5a26814ed404a08f0, user.id=cc50aa11bf2a41638dc00b154aa382b2) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:21:42.797507 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c289053d-7c8f-459d-b82a-0ff2678c41b6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:21:42.798967 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c289053d-7c8f-459d-b82a-0ff2678c41b6 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:21:42.804691 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 95/200] 10.222.0.23 () {56 vars in 1374 bytes} [Tue May 10 05:21:42 2022] GET /identity/v3/role_assignments?user.id=cc50aa11bf2a41638dc00b154aa382b2&scope.project.id=c00aac4e3d244bf5a26814ed404a08f0&role.id=199ac1dd842441d7913c6ee89d8fbecc => generated 259 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:21:42.805494 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c289053d-7c8f-459d-b82a-0ff2678c41b6 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:21:42.865994 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 106/201] 10.222.0.23 () {58 vars in 1282 bytes} [Tue May 10 05:21:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 05:21:42.876847 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6231b6-5978-4b79-bbb1-3ddc21132361 None admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:21:42.927735 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c289053d-7c8f-459d-b82a-0ff2678c41b6 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:21:42.963337 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2947d842-9a12-4bf9-afd2-850cd450dfd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:21:42.964089 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2947d842-9a12-4bf9-afd2-850cd450dfd2 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:21:42.964364 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2947d842-9a12-4bf9-afd2-850cd450dfd2 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:21:42.964637 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2947d842-9a12-4bf9-afd2-850cd450dfd2 None admin] PATH_INFO: `/v3/roles` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:21:42.965407 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2947d842-9a12-4bf9-afd2-850cd450dfd2 None admin] RBAC: Adding query filter params (name=reader) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:21:42.965959 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2947d842-9a12-4bf9-afd2-850cd450dfd2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:21:42.967100 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2947d842-9a12-4bf9-afd2-850cd450dfd2 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:21:42.977155 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 96/202] 10.222.0.23 () {56 vars in 1101 bytes} [Tue May 10 05:21:42 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:21:42.987556 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2947d842-9a12-4bf9-afd2-850cd450dfd2 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:21:43.075390 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6231b6-5978-4b79-bbb1-3ddc21132361 None admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:21:43.142657 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5677853a-c873-41c5-9321-895d9443be18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:21:43.143541 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5677853a-c873-41c5-9321-895d9443be18 None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:21:43.143852 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5677853a-c873-41c5-9321-895d9443be18 None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:21:43.144128 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5677853a-c873-41c5-9321-895d9443be18 None admin] PATH_INFO: `/v3/projects/c00aac4e3d244bf5a26814ed404a08f0` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:21:43.145185 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2947d842-9a12-4bf9-afd2-850cd450dfd2 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:21:43.145349 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5677853a-c873-41c5-9321-895d9443be18 None admin] RBAC: Authorizing `identity:get_project(project_id=c00aac4e3d244bf5a26814ed404a08f0)` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:21:43.146897 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5677853a-c873-41c5-9321-895d9443be18 None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:21:43.148706 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 107/203] 10.222.0.23 () {56 vars in 1186 bytes} [Tue May 10 05:21:42 2022] GET /identity/v3/projects/c00aac4e3d244bf5a26814ed404a08f0 => generated 302 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:21:43.158413 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5677853a-c873-41c5-9321-895d9443be18 None admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:21:43.203269 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd517807-dc2c-433a-9bae-58fc60cfea1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:21:43.204562 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd517807-dc2c-433a-9bae-58fc60cfea1c None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:21:43.205161 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd517807-dc2c-433a-9bae-58fc60cfea1c None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:21:43.205626 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd517807-dc2c-433a-9bae-58fc60cfea1c None admin] PATH_INFO: `/v3/users/bc821ebbf7b44fd9809a440fc070f4ff` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:21:43.207021 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd517807-dc2c-433a-9bae-58fc60cfea1c None admin] RBAC: Authorizing `identity:get_user(user_id=bc821ebbf7b44fd9809a440fc070f4ff)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:21:43.210426 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd517807-dc2c-433a-9bae-58fc60cfea1c None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:21:43.215530 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 97/204] 10.222.0.23 () {56 vars in 1177 bytes} [Tue May 10 05:21:42 2022] GET /identity/v3/users/bc821ebbf7b44fd9809a440fc070f4ff => generated 289 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:21:43.218193 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd517807-dc2c-433a-9bae-58fc60cfea1c None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:21:43.286074 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5677853a-c873-41c5-9321-895d9443be18 None admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:21:43.361542 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb70f12-5b1b-43bc-a69a-eaa2797bc3a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:21:43.362228 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb70f12-5b1b-43bc-a69a-eaa2797bc3a6 None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:21:43.362513 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb70f12-5b1b-43bc-a69a-eaa2797bc3a6 None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:21:43.362788 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb70f12-5b1b-43bc-a69a-eaa2797bc3a6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:21:43.363672 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb70f12-5b1b-43bc-a69a-eaa2797bc3a6 None admin] RBAC: Adding query filter params (role.id=b0cb991ebc2d42d5a5de343c57086616, scope.project.id=c00aac4e3d244bf5a26814ed404a08f0, user.id=cc50aa11bf2a41638dc00b154aa382b2) {{(pid=79879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:21:43.363987 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb70f12-5b1b-43bc-a69a-eaa2797bc3a6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:21:43.365545 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb70f12-5b1b-43bc-a69a-eaa2797bc3a6 None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:21:43.371707 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 108/205] 10.222.0.23 () {56 vars in 1374 bytes} [Tue May 10 05:21:43 2022] GET /identity/v3/role_assignments?user.id=cc50aa11bf2a41638dc00b154aa382b2&scope.project.id=c00aac4e3d244bf5a26814ed404a08f0&role.id=b0cb991ebc2d42d5a5de343c57086616 => generated 259 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:21:43.399604 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd517807-dc2c-433a-9bae-58fc60cfea1c None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:21:43.446958 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31edbd55-9ede-43d4-b893-e8e099283ca0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:21:43.448029 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31edbd55-9ede-43d4-b893-e8e099283ca0 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:21:43.448535 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31edbd55-9ede-43d4-b893-e8e099283ca0 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:21:43.449008 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31edbd55-9ede-43d4-b893-e8e099283ca0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:21:43.533820 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31edbd55-9ede-43d4-b893-e8e099283ca0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:21:43.535707 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31edbd55-9ede-43d4-b893-e8e099283ca0 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:21:43.681892 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 98/206] 10.222.0.23 () {58 vars in 1282 bytes} [Tue May 10 05:21:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 464 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 05:21:43.688418 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb70f12-5b1b-43bc-a69a-eaa2797bc3a6 None admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:21:43.810008 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb70f12-5b1b-43bc-a69a-eaa2797bc3a6 None admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:21:43.842808 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf462fbe-6d7d-4456-ad9d-cc34cde0a0e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:21:43.843713 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf462fbe-6d7d-4456-ad9d-cc34cde0a0e7 None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:21:43.843995 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf462fbe-6d7d-4456-ad9d-cc34cde0a0e7 None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:21:43.844267 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf462fbe-6d7d-4456-ad9d-cc34cde0a0e7 None admin] PATH_INFO: `/v3/projects/294a6d4f4d1f45058a0706d961479db2` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:21:43.845459 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf462fbe-6d7d-4456-ad9d-cc34cde0a0e7 None admin] RBAC: Authorizing `identity:get_project(project_id=294a6d4f4d1f45058a0706d961479db2)` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:21:43.846920 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf462fbe-6d7d-4456-ad9d-cc34cde0a0e7 None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:21:43.853558 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 109/207] 10.222.0.23 () {56 vars in 1186 bytes} [Tue May 10 05:21:43 2022] GET /identity/v3/projects/294a6d4f4d1f45058a0706d961479db2 => generated 298 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:21:43.857593 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31edbd55-9ede-43d4-b893-e8e099283ca0 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:21:44.008502 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31edbd55-9ede-43d4-b893-e8e099283ca0 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:21:44.054254 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacec84d-ad48-4dfb-a118-8f2d8380e438 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:21:44.055276 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacec84d-ad48-4dfb-a118-8f2d8380e438 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:21:44.055804 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacec84d-ad48-4dfb-a118-8f2d8380e438 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:21:44.056292 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacec84d-ad48-4dfb-a118-8f2d8380e438 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:21:44.057327 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bacec84d-ad48-4dfb-a118-8f2d8380e438 None admin] RBAC: Adding query filter params (role.id=8df798e3160347fd84a42d1aedd8ccde, scope.project.id=294a6d4f4d1f45058a0706d961479db2, user.id=bc821ebbf7b44fd9809a440fc070f4ff) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:21:44.057832 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bacec84d-ad48-4dfb-a118-8f2d8380e438 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:21:44.059471 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bacec84d-ad48-4dfb-a118-8f2d8380e438 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:21:44.072036 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 99/208] 10.222.0.23 () {56 vars in 1374 bytes} [Tue May 10 05:21:43 2022] GET /identity/v3/role_assignments?user.id=bc821ebbf7b44fd9809a440fc070f4ff&scope.project.id=294a6d4f4d1f45058a0706d961479db2&role.id=8df798e3160347fd84a42d1aedd8ccde => generated 608 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:21:44.759612 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a64e701-f907-4a49-90ba-b957e7938aa9 None None] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:21:44.760114 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a64e701-f907-4a49-90ba-b957e7938aa9 None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:21:44.760114 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a64e701-f907-4a49-90ba-b957e7938aa9 None None] PATH_INFO: `/` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:21:44.761532 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 110/209] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 10 05:21:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 05:21:44.767069 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11696a0f-752e-41c8-8a70-22e46d15eff4 None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:21:44.767592 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11696a0f-752e-41c8-8a70-22e46d15eff4 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:21:44.768067 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11696a0f-752e-41c8-8a70-22e46d15eff4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:21:44.788492 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-11696a0f-752e-41c8-8a70-22e46d15eff4 None None] MFA Rules not processed for user `44883b22532e44049d846938dc2cf423`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:21:44.789984 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-11696a0f-752e-41c8-8a70-22e46d15eff4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:21:44.858621 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 100/210] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 10 05:21:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 05:21:44.881975 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a64e701-f907-4a49-90ba-b957e7938aa9 None None] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:21:44.984674 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a64e701-f907-4a49-90ba-b957e7938aa9 None None] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:21:45.018576 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcdefe0-da94-4c92-a919-663c1fa276f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:21:45.019316 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcdefe0-da94-4c92-a919-663c1fa276f7 None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:21:45.019614 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcdefe0-da94-4c92-a919-663c1fa276f7 None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:21:45.019896 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcdefe0-da94-4c92-a919-663c1fa276f7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:21:45.030213 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bcdefe0-da94-4c92-a919-663c1fa276f7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 05:21:45.037972 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application [None req-5bcdefe0-da94-4c92-a919-663c1fa276f7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 10 05:21:45.037972 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 05:21:45.037972 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 05:21:45.037972 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 05:21:45.037972 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 05:21:45.037972 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 05:21:45.037972 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 05:21:45.037972 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 05:21:45.037972 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 05:21:45.037972 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 05:21:45.037972 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 05:21:45.037972 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 05:21:45.037972 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 05:21:45.037972 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 05:21:45.037972 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 05:21:45.037972 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 05:21:45.038862 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 05:21:45.038862 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 05:21:45.038862 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 05:21:45.038862 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 05:21:45.038862 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 05:21:45.038862 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 05:21:45.038862 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 05:21:45.038862 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 05:21:45.038862 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 05:21:45.038862 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.get_or_create( May 10 05:21:45.038862 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 05:21:45.038862 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application with Lock( May 10 05:21:45.038862 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 05:21:45.038862 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self._enter() May 10 05:21:45.038862 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 05:21:45.038862 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 05:21:45.039670 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 05:21:45.039670 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.creator() May 10 05:21:45.039670 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 05:21:45.039670 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application created_value = creator( May 10 05:21:45.039670 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 05:21:45.039670 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 05:21:45.039670 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 05:21:45.039670 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 05:21:45.039670 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 05:21:45.039670 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 05:21:45.039670 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 10 05:21:45.039670 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application May 10 05:21:45.039670 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 111/211] 10.222.0.23 () {56 vars in 1099 bytes} [Tue May 10 05:21:44 2022] GET /identity/v3/roles/member => generated 84 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 05:21:45.045254 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11696a0f-752e-41c8-8a70-22e46d15eff4 None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:21:45.084091 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ac257f-3932-4c1e-abf3-746e3c92c745 None None] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:21:45.084733 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ac257f-3932-4c1e-abf3-746e3c92c745 None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:21:45.085202 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ac257f-3932-4c1e-abf3-746e3c92c745 None None] PATH_INFO: `/` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:21:45.087293 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 112/212] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 10 05:21:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 05:21:45.093134 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a8e418-5bba-4ad6-8ce5-3f08f626786f None None] REQUEST_METHOD: `POST` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:21:45.093947 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a8e418-5bba-4ad6-8ce5-3f08f626786f None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:21:45.094435 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a8e418-5bba-4ad6-8ce5-3f08f626786f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:21:45.115206 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.auth.core [None req-c3a8e418-5bba-4ad6-8ce5-3f08f626786f None None] MFA Rules not processed for user `44883b22532e44049d846938dc2cf423`. Rule list: `[]` (Enabled: `True`). {{(pid=79879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:21:45.117422 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-c3a8e418-5bba-4ad6-8ce5-3f08f626786f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:21:45.156308 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11696a0f-752e-41c8-8a70-22e46d15eff4 None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:21:45.194830 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1322d8ef-9938-410d-a47b-064b2392821d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:21:45.195548 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1322d8ef-9938-410d-a47b-064b2392821d None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:21:45.195912 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1322d8ef-9938-410d-a47b-064b2392821d None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:21:45.196205 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1322d8ef-9938-410d-a47b-064b2392821d None admin] PATH_INFO: `/v3/roles` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:21:45.196965 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1322d8ef-9938-410d-a47b-064b2392821d None admin] RBAC: Adding query filter params (name=member) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:21:45.197270 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1322d8ef-9938-410d-a47b-064b2392821d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:21:45.198025 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 113/213] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 10 05:21:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 05:21:45.203779 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1322d8ef-9938-410d-a47b-064b2392821d None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:21:45.210754 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 101/214] 10.222.0.23 () {56 vars in 1101 bytes} [Tue May 10 05:21:45 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:21:45.216427 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a8e418-5bba-4ad6-8ce5-3f08f626786f None None] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:21:45.224754 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1322d8ef-9938-410d-a47b-064b2392821d None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:21:45.317131 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a8e418-5bba-4ad6-8ce5-3f08f626786f None None] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:21:45.327717 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1322d8ef-9938-410d-a47b-064b2392821d None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:21:45.350890 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e4049a-d73e-48dc-8ffd-753ee7ae35d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:21:45.351795 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e4049a-d73e-48dc-8ffd-753ee7ae35d1 None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:21:45.352075 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e4049a-d73e-48dc-8ffd-753ee7ae35d1 None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:21:45.352348 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e4049a-d73e-48dc-8ffd-753ee7ae35d1 None admin] PATH_INFO: `/v3/users/72541e1a3f7548e0bd576f054ded0dba` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:21:45.362276 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82276054-f8eb-44e9-9a78-4f3f0635da21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:21:45.363383 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82276054-f8eb-44e9-9a78-4f3f0635da21 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:21:45.363904 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82276054-f8eb-44e9-9a78-4f3f0635da21 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:21:45.364410 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82276054-f8eb-44e9-9a78-4f3f0635da21 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:21:45.365814 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82276054-f8eb-44e9-9a78-4f3f0635da21 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:21:45.366261 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e4049a-d73e-48dc-8ffd-753ee7ae35d1 None admin] RBAC: Authorizing `identity:get_user(user_id=72541e1a3f7548e0bd576f054ded0dba)` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:21:45.367727 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82276054-f8eb-44e9-9a78-4f3f0635da21 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:21:45.367835 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e4049a-d73e-48dc-8ffd-753ee7ae35d1 None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:21:45.369496 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 114/215] 10.222.0.23 () {56 vars in 1177 bytes} [Tue May 10 05:21:45 2022] GET /identity/v3/users/72541e1a3f7548e0bd576f054ded0dba => generated 297 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:21:45.369987 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 102/216] 10.222.0.23 () {56 vars in 1108 bytes} [Tue May 10 05:21:45 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:21:45.375804 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e4049a-d73e-48dc-8ffd-753ee7ae35d1 None admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:21:45.376056 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82276054-f8eb-44e9-9a78-4f3f0635da21 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:21:45.474725 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82276054-f8eb-44e9-9a78-4f3f0635da21 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:21:45.484476 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e4049a-d73e-48dc-8ffd-753ee7ae35d1 None admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:21:45.507177 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54dc5bf5-b9ff-427d-adf1-9fdeea4b2078 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:21:45.507893 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dc5bf5-b9ff-427d-adf1-9fdeea4b2078 None admin] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:21:45.508178 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dc5bf5-b9ff-427d-adf1-9fdeea4b2078 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:21:45.508451 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dc5bf5-b9ff-427d-adf1-9fdeea4b2078 None admin] PATH_INFO: `/v3/users` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:21:45.509170 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54dc5bf5-b9ff-427d-adf1-9fdeea4b2078 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:21:45.510625 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54dc5bf5-b9ff-427d-adf1-9fdeea4b2078 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:21:45.518687 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17015f94-1c17-435b-9610-d11271be89bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:21:45.519344 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17015f94-1c17-435b-9610-d11271be89bf None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:21:45.519667 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17015f94-1c17-435b-9610-d11271be89bf None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:21:45.519946 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17015f94-1c17-435b-9610-d11271be89bf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:21:45.534589 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 103/217] 10.222.0.23 () {60 vars in 1132 bytes} [Tue May 10 05:21:45 2022] POST /identity/v3/users => generated 297 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 05:21:45.534589 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e4174c-d0d9-4b63-b3f7-f8bbe4dc82f8 None None] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:21:45.534589 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e4174c-d0d9-4b63-b3f7-f8bbe4dc82f8 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:21:45.534589 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e4174c-d0d9-4b63-b3f7-f8bbe4dc82f8 None None] PATH_INFO: `/` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:21:45.534589 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 104/218] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 10 05:21:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 05:21:45.544896 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdcef8c-b20d-4585-8aac-892e655aef27 None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:21:45.545229 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdcef8c-b20d-4585-8aac-892e655aef27 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:21:45.545497 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdcef8c-b20d-4585-8aac-892e655aef27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:21:45.565900 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-1cdcef8c-b20d-4585-8aac-892e655aef27 None None] MFA Rules not processed for user `44883b22532e44049d846938dc2cf423`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:21:45.567230 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-1cdcef8c-b20d-4585-8aac-892e655aef27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:21:45.619411 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17015f94-1c17-435b-9610-d11271be89bf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:21:45.621690 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17015f94-1c17-435b-9610-d11271be89bf None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:21:45.640429 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 105/219] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 10 05:21:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 10 05:21:45.662943 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdcef8c-b20d-4585-8aac-892e655aef27 None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:21:45.764204 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 115/220] 10.222.0.23 () {58 vars in 1282 bytes} [Tue May 10 05:21:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 05:21:45.773648 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17015f94-1c17-435b-9610-d11271be89bf None admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:21:45.780062 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdcef8c-b20d-4585-8aac-892e655aef27 None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:21:45.816269 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e07827b-5645-4c92-80da-86896f33dbed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:21:45.816476 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e07827b-5645-4c92-80da-86896f33dbed None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:21:45.816716 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e07827b-5645-4c92-80da-86896f33dbed None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:21:45.818378 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e07827b-5645-4c92-80da-86896f33dbed None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:21:45.827669 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e07827b-5645-4c92-80da-86896f33dbed None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 05:21:45.835561 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application [None req-0e07827b-5645-4c92-80da-86896f33dbed None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 10 05:21:45.835561 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 05:21:45.835561 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 05:21:45.835561 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 05:21:45.835561 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 05:21:45.835561 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 05:21:45.835561 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 05:21:45.835561 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 05:21:45.835561 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 05:21:45.835561 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 05:21:45.835561 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 05:21:45.835561 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 05:21:45.835561 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 05:21:45.835561 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 05:21:45.835561 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 05:21:45.835561 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 05:21:45.836472 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 05:21:45.836472 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 05:21:45.836472 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 05:21:45.836472 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 05:21:45.836472 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 05:21:45.836472 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 05:21:45.836472 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 05:21:45.836472 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 05:21:45.836472 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 05:21:45.836472 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.get_or_create( May 10 05:21:45.836472 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 05:21:45.836472 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application with Lock( May 10 05:21:45.836472 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 05:21:45.836472 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._enter() May 10 05:21:45.836472 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 05:21:45.836472 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 05:21:45.837254 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 05:21:45.837254 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.creator() May 10 05:21:45.837254 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 05:21:45.837254 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application created_value = creator( May 10 05:21:45.837254 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 05:21:45.837254 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 05:21:45.837254 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 05:21:45.837254 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 05:21:45.837254 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 05:21:45.837254 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 05:21:45.837254 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 10 05:21:45.837254 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application May 10 05:21:45.841684 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 106/221] 10.222.0.23 () {56 vars in 1096 bytes} [Tue May 10 05:21:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 05:21:45.843017 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e07827b-5645-4c92-80da-86896f33dbed None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:21:45.875528 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17015f94-1c17-435b-9610-d11271be89bf None admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:21:45.910029 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1f2978-8ed9-4afb-bdcd-5176132bc57d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:21:45.911410 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1f2978-8ed9-4afb-bdcd-5176132bc57d None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:21:45.911728 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1f2978-8ed9-4afb-bdcd-5176132bc57d None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:21:45.911999 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1f2978-8ed9-4afb-bdcd-5176132bc57d None admin] PATH_INFO: `/v3/projects/c00aac4e3d244bf5a26814ed404a08f0` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:21:45.914956 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1f2978-8ed9-4afb-bdcd-5176132bc57d None admin] RBAC: Authorizing `identity:get_project(project_id=c00aac4e3d244bf5a26814ed404a08f0)` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:21:45.916446 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1f2978-8ed9-4afb-bdcd-5176132bc57d None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:21:45.918198 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 116/222] 10.222.0.23 () {56 vars in 1186 bytes} [Tue May 10 05:21:45 2022] GET /identity/v3/projects/c00aac4e3d244bf5a26814ed404a08f0 => generated 302 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:21:45.927376 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1f2978-8ed9-4afb-bdcd-5176132bc57d None admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:21:45.946165 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e07827b-5645-4c92-80da-86896f33dbed None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:21:45.980228 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724375e5-f749-4936-bef5-55bc18b23765 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:21:45.980914 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724375e5-f749-4936-bef5-55bc18b23765 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:21:45.981191 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724375e5-f749-4936-bef5-55bc18b23765 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:21:45.981464 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724375e5-f749-4936-bef5-55bc18b23765 None admin] PATH_INFO: `/v3/roles` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:21:45.982223 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724375e5-f749-4936-bef5-55bc18b23765 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:21:45.982524 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724375e5-f749-4936-bef5-55bc18b23765 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:21:45.983951 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724375e5-f749-4936-bef5-55bc18b23765 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:21:45.996020 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 107/223] 10.222.0.23 () {56 vars in 1099 bytes} [Tue May 10 05:21:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 05:21:45.998230 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f79b883-b748-406c-a654-ff97d7ceaf39 None None] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:21:45.998985 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f79b883-b748-406c-a654-ff97d7ceaf39 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:21:45.999808 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f79b883-b748-406c-a654-ff97d7ceaf39 None None] PATH_INFO: `/` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:21:46.001833 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 108/224] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 10 05:21:45 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 05:21:46.002942 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f79b883-b748-406c-a654-ff97d7ceaf39 None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:21:46.045159 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1f2978-8ed9-4afb-bdcd-5176132bc57d None admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:21:46.085059 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499042c3-cca5-4307-b9ee-b8fa01ef2235 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:21:46.085648 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499042c3-cca5-4307-b9ee-b8fa01ef2235 None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:21:46.085931 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499042c3-cca5-4307-b9ee-b8fa01ef2235 None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:21:46.086204 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499042c3-cca5-4307-b9ee-b8fa01ef2235 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:21:46.087054 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499042c3-cca5-4307-b9ee-b8fa01ef2235 None admin] RBAC: Adding query filter params (role.id=382636e67fc142a2b2f486340d959e11, scope.project.id=c00aac4e3d244bf5a26814ed404a08f0, user.id=72541e1a3f7548e0bd576f054ded0dba) {{(pid=79879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:21:46.087373 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499042c3-cca5-4307-b9ee-b8fa01ef2235 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:21:46.088885 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499042c3-cca5-4307-b9ee-b8fa01ef2235 None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:21:46.094598 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 117/225] 10.222.0.23 () {56 vars in 1374 bytes} [Tue May 10 05:21:45 2022] GET /identity/v3/role_assignments?user.id=72541e1a3f7548e0bd576f054ded0dba&scope.project.id=c00aac4e3d244bf5a26814ed404a08f0&role.id=382636e67fc142a2b2f486340d959e11 => generated 259 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:21:46.095670 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211c3011-ee4b-4560-b02d-4cac01f1055b None None] REQUEST_METHOD: `POST` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:21:46.095958 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211c3011-ee4b-4560-b02d-4cac01f1055b None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:21:46.096245 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211c3011-ee4b-4560-b02d-4cac01f1055b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:21:46.126914 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.auth.core [None req-211c3011-ee4b-4560-b02d-4cac01f1055b None None] MFA Rules not processed for user `44883b22532e44049d846938dc2cf423`. Rule list: `[]` (Enabled: `True`). {{(pid=79879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:21:46.128188 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-211c3011-ee4b-4560-b02d-4cac01f1055b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:21:46.169439 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f79b883-b748-406c-a654-ff97d7ceaf39 None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:21:46.212744 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 118/226] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 10 05:21:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 05:21:46.225180 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0e0aeb-1076-4d3b-a1fd-e4dba2c9ab9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:21:46.226157 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0e0aeb-1076-4d3b-a1fd-e4dba2c9ab9c None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:21:46.226426 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0e0aeb-1076-4d3b-a1fd-e4dba2c9ab9c None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:21:46.226695 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0e0aeb-1076-4d3b-a1fd-e4dba2c9ab9c None admin] PATH_INFO: `/v3/users/cc50aa11bf2a41638dc00b154aa382b2` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:21:46.228125 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0e0aeb-1076-4d3b-a1fd-e4dba2c9ab9c None admin] RBAC: Authorizing `identity:get_user(user_id=cc50aa11bf2a41638dc00b154aa382b2)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:21:46.229645 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0e0aeb-1076-4d3b-a1fd-e4dba2c9ab9c None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:21:46.231471 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 109/227] 10.222.0.23 () {56 vars in 1177 bytes} [Tue May 10 05:21:46 2022] GET /identity/v3/users/cc50aa11bf2a41638dc00b154aa382b2 => generated 283 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:21:46.238690 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211c3011-ee4b-4560-b02d-4cac01f1055b None None] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:21:46.249278 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0e0aeb-1076-4d3b-a1fd-e4dba2c9ab9c None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:21:46.352881 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211c3011-ee4b-4560-b02d-4cac01f1055b None None] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:21:46.389533 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065d314b-6f78-4719-928b-d73e9b5f5c0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:21:46.390406 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065d314b-6f78-4719-928b-d73e9b5f5c0b None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:21:46.390686 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065d314b-6f78-4719-928b-d73e9b5f5c0b None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:21:46.390952 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065d314b-6f78-4719-928b-d73e9b5f5c0b None admin] PATH_INFO: `/v3/projects/c00aac4e3d244bf5a26814ed404a08f0` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:21:46.392185 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065d314b-6f78-4719-928b-d73e9b5f5c0b None admin] RBAC: Authorizing `identity:get_project(project_id=c00aac4e3d244bf5a26814ed404a08f0)` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:21:46.393940 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065d314b-6f78-4719-928b-d73e9b5f5c0b None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:21:46.396905 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 119/228] 10.222.0.23 () {56 vars in 1186 bytes} [Tue May 10 05:21:46 2022] GET /identity/v3/projects/c00aac4e3d244bf5a26814ed404a08f0 => generated 302 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:21:46.402547 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065d314b-6f78-4719-928b-d73e9b5f5c0b None admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:21:46.454447 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0e0aeb-1076-4d3b-a1fd-e4dba2c9ab9c None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:21:46.521598 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d609a6e0-451e-492c-8297-d1c597ee0afb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:21:46.522429 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d609a6e0-451e-492c-8297-d1c597ee0afb None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:21:46.522709 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d609a6e0-451e-492c-8297-d1c597ee0afb None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:21:46.522974 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d609a6e0-451e-492c-8297-d1c597ee0afb None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:21:46.541105 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d609a6e0-451e-492c-8297-d1c597ee0afb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 05:21:46.549126 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application [None req-d609a6e0-451e-492c-8297-d1c597ee0afb None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 10 05:21:46.549126 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 05:21:46.549126 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 05:21:46.549126 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 05:21:46.549126 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 05:21:46.549126 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 05:21:46.549126 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 05:21:46.549126 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 05:21:46.549126 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 05:21:46.549126 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 05:21:46.549126 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 05:21:46.549126 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 05:21:46.549126 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 05:21:46.549126 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 05:21:46.549126 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 05:21:46.549126 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 05:21:46.549989 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 05:21:46.549989 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 05:21:46.549989 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 05:21:46.549989 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 05:21:46.549989 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 05:21:46.549989 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 05:21:46.549989 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 05:21:46.549989 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 05:21:46.549989 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 05:21:46.549989 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.get_or_create( May 10 05:21:46.549989 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 05:21:46.549989 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application with Lock( May 10 05:21:46.549989 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 05:21:46.549989 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._enter() May 10 05:21:46.549989 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 05:21:46.549989 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 05:21:46.550790 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 05:21:46.550790 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.creator() May 10 05:21:46.550790 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 05:21:46.550790 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application created_value = creator( May 10 05:21:46.550790 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 05:21:46.550790 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 05:21:46.550790 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 05:21:46.550790 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 05:21:46.550790 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 05:21:46.550790 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 05:21:46.550790 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 10 05:21:46.550790 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application May 10 05:21:46.550790 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 110/229] 10.222.0.23 () {56 vars in 1114 bytes} [Tue May 10 05:21:46 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 302 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 05:21:46.558415 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d609a6e0-451e-492c-8297-d1c597ee0afb None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:21:46.562476 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065d314b-6f78-4719-928b-d73e9b5f5c0b None admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:21:46.596335 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce7d73f-f616-4207-a8be-478414471ac0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:21:46.597250 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce7d73f-f616-4207-a8be-478414471ac0 None admin] REQUEST_METHOD: `PUT` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:21:46.597527 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce7d73f-f616-4207-a8be-478414471ac0 None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:21:46.597802 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce7d73f-f616-4207-a8be-478414471ac0 None admin] PATH_INFO: `/v3/projects/c00aac4e3d244bf5a26814ed404a08f0/users/cc50aa11bf2a41638dc00b154aa382b2/roles/199ac1dd842441d7913c6ee89d8fbecc` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:21:46.599858 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce7d73f-f616-4207-a8be-478414471ac0 None admin] RBAC: Authorizing `identity:create_grant(project_id=c00aac4e3d244bf5a26814ed404a08f0, user_id=cc50aa11bf2a41638dc00b154aa382b2, role_id=199ac1dd842441d7913c6ee89d8fbecc)` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:21:46.601315 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce7d73f-f616-4207-a8be-478414471ac0 None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:21:46.617245 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 120/230] 10.222.0.23 () {58 vars in 1439 bytes} [Tue May 10 05:21:46 2022] PUT /identity/v3/projects/c00aac4e3d244bf5a26814ed404a08f0/users/cc50aa11bf2a41638dc00b154aa382b2/roles/199ac1dd842441d7913c6ee89d8fbecc => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 05:21:46.731400 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d609a6e0-451e-492c-8297-d1c597ee0afb None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:21:46.766759 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e57769-ecce-4b3d-b700-af47a2b31df5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:21:46.767450 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e57769-ecce-4b3d-b700-af47a2b31df5 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:21:46.767803 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e57769-ecce-4b3d-b700-af47a2b31df5 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:21:46.768074 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e57769-ecce-4b3d-b700-af47a2b31df5 None admin] PATH_INFO: `/v3/roles` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:21:46.768863 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e57769-ecce-4b3d-b700-af47a2b31df5 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:21:46.769214 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e57769-ecce-4b3d-b700-af47a2b31df5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:21:46.770866 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e57769-ecce-4b3d-b700-af47a2b31df5 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:21:46.780465 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 111/231] 10.222.0.23 () {56 vars in 1111 bytes} [Tue May 10 05:21:46 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:21:46.785985 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce7d73f-f616-4207-a8be-478414471ac0 None admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:21:46.893649 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce7d73f-f616-4207-a8be-478414471ac0 None admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:21:46.929365 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588ec00b-dff5-4e69-b5d5-adc031980c9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:21:46.930609 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588ec00b-dff5-4e69-b5d5-adc031980c9b None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:21:46.931089 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588ec00b-dff5-4e69-b5d5-adc031980c9b None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:21:46.931560 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588ec00b-dff5-4e69-b5d5-adc031980c9b None admin] PATH_INFO: `/v3/users/cc50aa11bf2a41638dc00b154aa382b2` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:21:46.933010 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588ec00b-dff5-4e69-b5d5-adc031980c9b None admin] RBAC: Authorizing `identity:get_user(user_id=cc50aa11bf2a41638dc00b154aa382b2)` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:21:46.934724 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588ec00b-dff5-4e69-b5d5-adc031980c9b None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:21:46.937111 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 121/232] 10.222.0.23 () {56 vars in 1177 bytes} [Tue May 10 05:21:46 2022] GET /identity/v3/users/cc50aa11bf2a41638dc00b154aa382b2 => generated 283 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:21:46.942610 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e57769-ecce-4b3d-b700-af47a2b31df5 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:21:47.047306 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e57769-ecce-4b3d-b700-af47a2b31df5 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:21:47.082127 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb661b00-19a2-4b2b-b888-8e2c557cd152 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:21:47.083400 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb661b00-19a2-4b2b-b888-8e2c557cd152 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:21:47.083876 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb661b00-19a2-4b2b-b888-8e2c557cd152 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:21:47.084343 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb661b00-19a2-4b2b-b888-8e2c557cd152 None admin] PATH_INFO: `/v3/projects/c00aac4e3d244bf5a26814ed404a08f0` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:21:47.085760 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb661b00-19a2-4b2b-b888-8e2c557cd152 None admin] RBAC: Authorizing `identity:get_project(project_id=c00aac4e3d244bf5a26814ed404a08f0)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:21:47.087393 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb661b00-19a2-4b2b-b888-8e2c557cd152 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:21:47.089323 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 112/233] 10.222.0.23 () {56 vars in 1186 bytes} [Tue May 10 05:21:46 2022] GET /identity/v3/projects/c00aac4e3d244bf5a26814ed404a08f0 => generated 302 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 05:21:47.095140 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588ec00b-dff5-4e69-b5d5-adc031980c9b None admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:21:47.224834 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588ec00b-dff5-4e69-b5d5-adc031980c9b None admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:21:47.273566 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d458b6a-d90e-47fc-b47b-e4a1f9c94982 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:21:47.274764 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d458b6a-d90e-47fc-b47b-e4a1f9c94982 None admin] REQUEST_METHOD: `PUT` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:21:47.275213 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d458b6a-d90e-47fc-b47b-e4a1f9c94982 None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:21:47.275707 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d458b6a-d90e-47fc-b47b-e4a1f9c94982 None admin] PATH_INFO: `/v3/projects/c00aac4e3d244bf5a26814ed404a08f0/users/cc50aa11bf2a41638dc00b154aa382b2/roles/b0cb991ebc2d42d5a5de343c57086616` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:21:47.278218 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d458b6a-d90e-47fc-b47b-e4a1f9c94982 None admin] RBAC: Authorizing `identity:create_grant(project_id=c00aac4e3d244bf5a26814ed404a08f0, user_id=cc50aa11bf2a41638dc00b154aa382b2, role_id=b0cb991ebc2d42d5a5de343c57086616)` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:21:47.279962 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d458b6a-d90e-47fc-b47b-e4a1f9c94982 None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:21:47.310180 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 122/234] 10.222.0.23 () {58 vars in 1439 bytes} [Tue May 10 05:21:47 2022] PUT /identity/v3/projects/c00aac4e3d244bf5a26814ed404a08f0/users/cc50aa11bf2a41638dc00b154aa382b2/roles/b0cb991ebc2d42d5a5de343c57086616 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 05:21:48.373727 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21eb2fdb-0a5f-46e4-84ac-1087faaa41c1 None None] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:21:48.374290 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21eb2fdb-0a5f-46e4-84ac-1087faaa41c1 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:21:48.374290 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21eb2fdb-0a5f-46e4-84ac-1087faaa41c1 None None] PATH_INFO: `/` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:21:48.375983 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 113/235] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 10 05:21:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 05:21:48.398536 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990369a2-9353-4aa9-93f8-74576fe968d6 None None] REQUEST_METHOD: `POST` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:21:48.399055 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990369a2-9353-4aa9-93f8-74576fe968d6 None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:21:48.399055 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990369a2-9353-4aa9-93f8-74576fe968d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:21:48.419668 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.auth.core [None req-990369a2-9353-4aa9-93f8-74576fe968d6 None None] MFA Rules not processed for user `44883b22532e44049d846938dc2cf423`. Rule list: `[]` (Enabled: `True`). {{(pid=79879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:21:48.420857 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-990369a2-9353-4aa9-93f8-74576fe968d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:21:48.442057 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6439d1-56e0-461d-bccf-fb93613471c5 None None] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:21:48.443008 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6439d1-56e0-461d-bccf-fb93613471c5 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:21:48.443680 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6439d1-56e0-461d-bccf-fb93613471c5 None None] PATH_INFO: `/` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:21:48.445288 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 114/236] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 10 05:21:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 05:21:48.452200 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed94f775-c5ef-426a-9036-3077d10eb95e None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:21:48.452995 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed94f775-c5ef-426a-9036-3077d10eb95e None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:21:48.453465 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed94f775-c5ef-426a-9036-3077d10eb95e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:21:48.482869 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-ed94f775-c5ef-426a-9036-3077d10eb95e None None] MFA Rules not processed for user `44883b22532e44049d846938dc2cf423`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:21:48.482869 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-ed94f775-c5ef-426a-9036-3077d10eb95e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:21:48.530148 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 123/237] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 10 05:21:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 05:21:48.552539 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990369a2-9353-4aa9-93f8-74576fe968d6 None None] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:21:48.587077 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 115/238] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 10 05:21:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 10 05:21:48.630004 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed94f775-c5ef-426a-9036-3077d10eb95e None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:21:48.740307 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990369a2-9353-4aa9-93f8-74576fe968d6 None None] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:21:48.797696 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e3aced-6135-49a2-a960-4d2110cdf117 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:21:48.798207 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed94f775-c5ef-426a-9036-3077d10eb95e None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:21:48.798499 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e3aced-6135-49a2-a960-4d2110cdf117 None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:21:48.798779 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e3aced-6135-49a2-a960-4d2110cdf117 None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:21:48.799049 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e3aced-6135-49a2-a960-4d2110cdf117 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:21:48.817076 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e3aced-6135-49a2-a960-4d2110cdf117 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 05:21:48.826865 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application [None req-21e3aced-6135-49a2-a960-4d2110cdf117 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 10 05:21:48.826865 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 05:21:48.826865 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 05:21:48.826865 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 05:21:48.826865 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 05:21:48.826865 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 05:21:48.826865 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 05:21:48.826865 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 05:21:48.826865 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 05:21:48.826865 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 05:21:48.826865 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 05:21:48.826865 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 05:21:48.826865 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 05:21:48.826865 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 05:21:48.826865 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 05:21:48.826865 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 05:21:48.827808 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 05:21:48.827808 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 05:21:48.827808 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 05:21:48.827808 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 05:21:48.827808 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 05:21:48.827808 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 05:21:48.827808 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 05:21:48.827808 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 05:21:48.827808 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 05:21:48.827808 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.get_or_create( May 10 05:21:48.827808 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 05:21:48.827808 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application with Lock( May 10 05:21:48.827808 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 05:21:48.827808 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self._enter() May 10 05:21:48.827808 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 05:21:48.827808 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 05:21:48.828604 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 05:21:48.828604 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.creator() May 10 05:21:48.828604 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 05:21:48.828604 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application created_value = creator( May 10 05:21:48.828604 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 05:21:48.828604 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 05:21:48.828604 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 05:21:48.828604 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 05:21:48.828604 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 05:21:48.828604 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 05:21:48.828604 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 10 05:21:48.828604 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application May 10 05:21:48.829342 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 124/239] 10.222.0.23 () {56 vars in 1099 bytes} [Tue May 10 05:21:48 2022] GET /identity/v3/roles/reader => generated 84 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 05:21:48.830661 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07fc2f3-d5cb-4c0f-b7e8-19820c7ddf4a None None] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:21:48.830949 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07fc2f3-d5cb-4c0f-b7e8-19820c7ddf4a None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:21:48.831224 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07fc2f3-d5cb-4c0f-b7e8-19820c7ddf4a None None] PATH_INFO: `/` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:21:48.832538 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 125/240] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 10 05:21:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 05:21:48.835797 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07fc2f3-d5cb-4c0f-b7e8-19820c7ddf4a None None] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:21:48.847489 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80705e8-c4b0-4ec9-a835-bbdd6afd13fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:21:48.848336 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80705e8-c4b0-4ec9-a835-bbdd6afd13fa None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:21:48.848648 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80705e8-c4b0-4ec9-a835-bbdd6afd13fa None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:21:48.848981 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80705e8-c4b0-4ec9-a835-bbdd6afd13fa None admin] PATH_INFO: `/v3/domains/default` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:21:48.850543 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80705e8-c4b0-4ec9-a835-bbdd6afd13fa None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:21:48.852666 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80705e8-c4b0-4ec9-a835-bbdd6afd13fa None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:21:48.855304 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 116/241] 10.222.0.23 () {56 vars in 1108 bytes} [Tue May 10 05:21:48 2022] GET /identity/v3/domains/default => generated 199 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:21:48.856902 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4c233b-3523-4e21-8bf6-a01bce4dd02c None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:21:48.857185 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4c233b-3523-4e21-8bf6-a01bce4dd02c None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:21:48.857736 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4c233b-3523-4e21-8bf6-a01bce4dd02c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:21:48.879752 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-ad4c233b-3523-4e21-8bf6-a01bce4dd02c None None] MFA Rules not processed for user `44883b22532e44049d846938dc2cf423`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:21:48.881126 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-ad4c233b-3523-4e21-8bf6-a01bce4dd02c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:21:48.944054 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07fc2f3-d5cb-4c0f-b7e8-19820c7ddf4a None None] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:21:48.958255 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 117/242] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 10 05:21:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 05:21:48.960413 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4c233b-3523-4e21-8bf6-a01bce4dd02c None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:21:48.983094 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebeaa4e8-0d5d-4f2e-ac20-dc71d9715d20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:21:48.983891 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebeaa4e8-0d5d-4f2e-ac20-dc71d9715d20 None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:21:48.984179 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebeaa4e8-0d5d-4f2e-ac20-dc71d9715d20 None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:21:48.984452 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebeaa4e8-0d5d-4f2e-ac20-dc71d9715d20 None admin] PATH_INFO: `/v3/roles` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:21:48.985215 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebeaa4e8-0d5d-4f2e-ac20-dc71d9715d20 None admin] RBAC: Adding query filter params (name=reader) {{(pid=79879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:21:48.985795 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebeaa4e8-0d5d-4f2e-ac20-dc71d9715d20 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:21:48.987359 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebeaa4e8-0d5d-4f2e-ac20-dc71d9715d20 None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:21:48.998414 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 126/243] 10.222.0.23 () {56 vars in 1101 bytes} [Tue May 10 05:21:48 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:21:49.003782 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebeaa4e8-0d5d-4f2e-ac20-dc71d9715d20 None admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:21:49.077579 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4c233b-3523-4e21-8bf6-a01bce4dd02c None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:21:49.110172 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688ea51e-48ac-4774-baca-a9d0bd0d3854 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:21:49.110867 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688ea51e-48ac-4774-baca-a9d0bd0d3854 None admin] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:21:49.111143 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688ea51e-48ac-4774-baca-a9d0bd0d3854 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:21:49.111417 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688ea51e-48ac-4774-baca-a9d0bd0d3854 None admin] PATH_INFO: `/v3/users` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:21:49.112185 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688ea51e-48ac-4774-baca-a9d0bd0d3854 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:21:49.113636 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688ea51e-48ac-4774-baca-a9d0bd0d3854 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:21:49.120036 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebeaa4e8-0d5d-4f2e-ac20-dc71d9715d20 None admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:21:49.139028 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 118/244] 10.222.0.23 () {60 vars in 1132 bytes} [Tue May 10 05:21:48 2022] POST /identity/v3/users => generated 293 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 05:21:49.140402 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688ea51e-48ac-4774-baca-a9d0bd0d3854 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:21:49.157220 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052c884f-98b3-405b-bc3e-160b12599da0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:21:49.158309 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052c884f-98b3-405b-bc3e-160b12599da0 None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:21:49.158682 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052c884f-98b3-405b-bc3e-160b12599da0 None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:21:49.159055 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052c884f-98b3-405b-bc3e-160b12599da0 None admin] PATH_INFO: `/v3/users/d7b3cdc04b8a448a8f780d17d0658c58` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:21:49.176797 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052c884f-98b3-405b-bc3e-160b12599da0 None admin] RBAC: Authorizing `identity:get_user(user_id=d7b3cdc04b8a448a8f780d17d0658c58)` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:21:49.178543 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052c884f-98b3-405b-bc3e-160b12599da0 None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:21:49.180823 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 127/245] 10.222.0.23 () {56 vars in 1177 bytes} [Tue May 10 05:21:49 2022] GET /identity/v3/users/d7b3cdc04b8a448a8f780d17d0658c58 => generated 297 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:21:49.188622 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052c884f-98b3-405b-bc3e-160b12599da0 None admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:21:49.270545 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688ea51e-48ac-4774-baca-a9d0bd0d3854 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:21:49.310622 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79adbb4-2571-47c9-bda3-6a2bfe64bd61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:21:49.311528 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79adbb4-2571-47c9-bda3-6a2bfe64bd61 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:21:49.311835 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79adbb4-2571-47c9-bda3-6a2bfe64bd61 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:21:49.312105 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79adbb4-2571-47c9-bda3-6a2bfe64bd61 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:21:49.326309 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79adbb4-2571-47c9-bda3-6a2bfe64bd61 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 05:21:49.335964 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application [None req-f79adbb4-2571-47c9-bda3-6a2bfe64bd61 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 10 05:21:49.335964 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 05:21:49.335964 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 05:21:49.335964 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 05:21:49.335964 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 05:21:49.335964 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 05:21:49.335964 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 05:21:49.335964 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 05:21:49.335964 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 05:21:49.335964 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 05:21:49.335964 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 05:21:49.335964 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 05:21:49.335964 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 05:21:49.335964 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 05:21:49.335964 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 05:21:49.335964 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 05:21:49.338073 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 05:21:49.338073 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 05:21:49.338073 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 05:21:49.338073 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 05:21:49.338073 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 05:21:49.338073 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 05:21:49.338073 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 05:21:49.338073 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 05:21:49.338073 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 05:21:49.338073 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.get_or_create( May 10 05:21:49.338073 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 05:21:49.338073 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application with Lock( May 10 05:21:49.338073 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 05:21:49.338073 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._enter() May 10 05:21:49.338073 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 05:21:49.338073 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 05:21:49.340069 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 05:21:49.340069 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.creator() May 10 05:21:49.340069 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 05:21:49.340069 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application created_value = creator( May 10 05:21:49.340069 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 05:21:49.340069 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 05:21:49.340069 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 05:21:49.340069 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 05:21:49.340069 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 05:21:49.340069 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 05:21:49.340069 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 10 05:21:49.340069 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application May 10 05:21:49.340069 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 119/246] 10.222.0.23 () {56 vars in 1099 bytes} [Tue May 10 05:21:49 2022] GET /identity/v3/roles/member => generated 84 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 05:21:49.346097 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79adbb4-2571-47c9-bda3-6a2bfe64bd61 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:21:49.406320 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052c884f-98b3-405b-bc3e-160b12599da0 None admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:21:49.441053 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2935811-08b5-4198-9dee-daabb64763da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:21:49.442053 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2935811-08b5-4198-9dee-daabb64763da None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:21:49.442612 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2935811-08b5-4198-9dee-daabb64763da None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:21:49.443072 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2935811-08b5-4198-9dee-daabb64763da None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:21:49.452268 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79adbb4-2571-47c9-bda3-6a2bfe64bd61 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:21:49.498726 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506c240d-5a1f-44cd-b09b-4e7ae995f8f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:21:49.499690 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506c240d-5a1f-44cd-b09b-4e7ae995f8f2 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:21:49.500112 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506c240d-5a1f-44cd-b09b-4e7ae995f8f2 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:21:49.500524 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506c240d-5a1f-44cd-b09b-4e7ae995f8f2 None admin] PATH_INFO: `/v3/roles` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:21:49.501452 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506c240d-5a1f-44cd-b09b-4e7ae995f8f2 None admin] RBAC: Adding query filter params (name=member) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:21:49.502022 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506c240d-5a1f-44cd-b09b-4e7ae995f8f2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:21:49.503707 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506c240d-5a1f-44cd-b09b-4e7ae995f8f2 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:21:49.512553 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 120/247] 10.222.0.23 () {56 vars in 1101 bytes} [Tue May 10 05:21:49 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 05:21:49.513887 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2935811-08b5-4198-9dee-daabb64763da None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:21:49.515592 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2935811-08b5-4198-9dee-daabb64763da None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:21:49.518656 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506c240d-5a1f-44cd-b09b-4e7ae995f8f2 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:21:49.630952 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 128/248] 10.222.0.23 () {58 vars in 1282 bytes} [Tue May 10 05:21:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 443 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 05:21:49.631216 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506c240d-5a1f-44cd-b09b-4e7ae995f8f2 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:21:49.632956 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a452c76-8132-4915-83dd-5eea68ddcfb2 None None] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:21:49.634238 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a452c76-8132-4915-83dd-5eea68ddcfb2 None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:21:49.634666 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a452c76-8132-4915-83dd-5eea68ddcfb2 None None] PATH_INFO: `/` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:21:49.636468 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 129/249] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 10 05:21:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 05:21:49.637722 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a452c76-8132-4915-83dd-5eea68ddcfb2 None None] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:21:49.670918 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a298173-b088-42b5-bd69-7cba8d53f654 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:21:49.673498 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a298173-b088-42b5-bd69-7cba8d53f654 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:21:49.673925 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a298173-b088-42b5-bd69-7cba8d53f654 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:21:49.674384 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a298173-b088-42b5-bd69-7cba8d53f654 None admin] PATH_INFO: `/v3/users/72541e1a3f7548e0bd576f054ded0dba` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:21:49.675934 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a298173-b088-42b5-bd69-7cba8d53f654 None admin] RBAC: Authorizing `identity:get_user(user_id=72541e1a3f7548e0bd576f054ded0dba)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:21:49.677815 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a298173-b088-42b5-bd69-7cba8d53f654 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:21:49.679874 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 121/250] 10.222.0.23 () {56 vars in 1177 bytes} [Tue May 10 05:21:49 2022] GET /identity/v3/users/72541e1a3f7548e0bd576f054ded0dba => generated 297 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 05:21:49.681338 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dcf832-f1fc-4233-955c-31d8a8e7ef6e None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:21:49.681630 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dcf832-f1fc-4233-955c-31d8a8e7ef6e None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:21:49.681896 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dcf832-f1fc-4233-955c-31d8a8e7ef6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:21:49.704028 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-93dcf832-f1fc-4233-955c-31d8a8e7ef6e None None] MFA Rules not processed for user `44883b22532e44049d846938dc2cf423`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:21:49.705225 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-93dcf832-f1fc-4233-955c-31d8a8e7ef6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:21:49.765501 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a452c76-8132-4915-83dd-5eea68ddcfb2 None None] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:21:49.780299 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 122/251] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 10 05:21:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 05:21:49.781387 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93dcf832-f1fc-4233-955c-31d8a8e7ef6e None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:21:49.828026 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0076eb-65e6-47c5-8577-65cc53ae57bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:21:49.829181 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0076eb-65e6-47c5-8577-65cc53ae57bd None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:21:49.830253 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0076eb-65e6-47c5-8577-65cc53ae57bd None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:21:49.830665 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0076eb-65e6-47c5-8577-65cc53ae57bd None admin] PATH_INFO: `/v3/projects/c00aac4e3d244bf5a26814ed404a08f0` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:21:49.836569 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0076eb-65e6-47c5-8577-65cc53ae57bd None admin] RBAC: Authorizing `identity:get_project(project_id=c00aac4e3d244bf5a26814ed404a08f0)` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:21:49.838292 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0076eb-65e6-47c5-8577-65cc53ae57bd None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:21:49.842259 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 130/252] 10.222.0.23 () {56 vars in 1186 bytes} [Tue May 10 05:21:49 2022] GET /identity/v3/projects/c00aac4e3d244bf5a26814ed404a08f0 => generated 302 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 05:21:49.843189 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0076eb-65e6-47c5-8577-65cc53ae57bd None admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:21:49.932509 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93dcf832-f1fc-4233-955c-31d8a8e7ef6e None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:21:50.005698 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2da381-0df3-481c-b3c2-71e930b6b480 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:21:50.006595 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2da381-0df3-481c-b3c2-71e930b6b480 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:21:50.006875 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2da381-0df3-481c-b3c2-71e930b6b480 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:21:50.007147 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2da381-0df3-481c-b3c2-71e930b6b480 None admin] PATH_INFO: `/v3/projects/c00aac4e3d244bf5a26814ed404a08f0` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:21:50.009452 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0076eb-65e6-47c5-8577-65cc53ae57bd None admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:21:50.012342 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2da381-0df3-481c-b3c2-71e930b6b480 None admin] RBAC: Authorizing `identity:get_project(project_id=c00aac4e3d244bf5a26814ed404a08f0)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:21:50.013744 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2da381-0df3-481c-b3c2-71e930b6b480 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:21:50.015488 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 123/253] 10.222.0.23 () {56 vars in 1186 bytes} [Tue May 10 05:21:49 2022] GET /identity/v3/projects/c00aac4e3d244bf5a26814ed404a08f0 => generated 302 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:21:50.016280 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2da381-0df3-481c-b3c2-71e930b6b480 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:21:50.043470 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e4a188-c811-4eb0-b884-f7ee341140b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:21:50.044549 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e4a188-c811-4eb0-b884-f7ee341140b6 None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:21:50.044968 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e4a188-c811-4eb0-b884-f7ee341140b6 None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:21:50.045396 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e4a188-c811-4eb0-b884-f7ee341140b6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:21:50.055831 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e4a188-c811-4eb0-b884-f7ee341140b6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 05:21:50.063600 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application [None req-12e4a188-c811-4eb0-b884-f7ee341140b6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 10 05:21:50.063600 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 05:21:50.063600 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 05:21:50.063600 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 05:21:50.063600 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 05:21:50.063600 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 05:21:50.063600 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 05:21:50.063600 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 05:21:50.063600 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 05:21:50.063600 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 05:21:50.063600 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 05:21:50.063600 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 05:21:50.063600 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 05:21:50.063600 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 05:21:50.063600 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 05:21:50.063600 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 05:21:50.064659 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 05:21:50.064659 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 05:21:50.064659 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 05:21:50.064659 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 05:21:50.064659 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 05:21:50.064659 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 05:21:50.064659 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 05:21:50.064659 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 05:21:50.064659 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 05:21:50.064659 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.get_or_create( May 10 05:21:50.064659 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 05:21:50.064659 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application with Lock( May 10 05:21:50.064659 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 05:21:50.064659 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self._enter() May 10 05:21:50.064659 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 05:21:50.064659 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 05:21:50.065625 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 05:21:50.065625 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.creator() May 10 05:21:50.065625 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 05:21:50.065625 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application created_value = creator( May 10 05:21:50.065625 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 05:21:50.065625 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 05:21:50.065625 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 05:21:50.065625 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 05:21:50.065625 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 05:21:50.065625 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 05:21:50.065625 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 10 05:21:50.065625 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application May 10 05:21:50.067673 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 131/254] 10.222.0.23 () {56 vars in 1096 bytes} [Tue May 10 05:21:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 05:21:50.068581 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e4a188-c811-4eb0-b884-f7ee341140b6 None admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:21:50.172247 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e4a188-c811-4eb0-b884-f7ee341140b6 None admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:21:50.207510 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2da381-0df3-481c-b3c2-71e930b6b480 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:21:50.214008 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07704113-d682-4461-887c-516dea13bfaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:21:50.215070 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07704113-d682-4461-887c-516dea13bfaf None admin] REQUEST_METHOD: `PUT` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:21:50.215454 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07704113-d682-4461-887c-516dea13bfaf None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:21:50.215856 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07704113-d682-4461-887c-516dea13bfaf None admin] PATH_INFO: `/v3/projects/c00aac4e3d244bf5a26814ed404a08f0/users/72541e1a3f7548e0bd576f054ded0dba/roles/382636e67fc142a2b2f486340d959e11` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:21:50.218501 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07704113-d682-4461-887c-516dea13bfaf None admin] RBAC: Authorizing `identity:create_grant(project_id=c00aac4e3d244bf5a26814ed404a08f0, user_id=72541e1a3f7548e0bd576f054ded0dba, role_id=382636e67fc142a2b2f486340d959e11)` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:21:50.220182 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07704113-d682-4461-887c-516dea13bfaf None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:21:50.240548 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 132/255] 10.222.0.23 () {58 vars in 1439 bytes} [Tue May 10 05:21:50 2022] PUT /identity/v3/projects/c00aac4e3d244bf5a26814ed404a08f0/users/72541e1a3f7548e0bd576f054ded0dba/roles/382636e67fc142a2b2f486340d959e11 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 05:21:50.241932 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07704113-d682-4461-887c-516dea13bfaf None admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:21:50.245571 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647c68ec-b0e6-4a8b-826c-9381f77da371 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:21:50.246805 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647c68ec-b0e6-4a8b-826c-9381f77da371 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:21:50.247241 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647c68ec-b0e6-4a8b-826c-9381f77da371 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:21:50.247784 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647c68ec-b0e6-4a8b-826c-9381f77da371 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:21:50.248896 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647c68ec-b0e6-4a8b-826c-9381f77da371 None admin] RBAC: Adding query filter params (role.id=8df798e3160347fd84a42d1aedd8ccde, scope.project.id=c00aac4e3d244bf5a26814ed404a08f0, user.id=d7b3cdc04b8a448a8f780d17d0658c58) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:21:50.249454 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647c68ec-b0e6-4a8b-826c-9381f77da371 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:21:50.251145 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647c68ec-b0e6-4a8b-826c-9381f77da371 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:21:50.259105 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 124/256] 10.222.0.23 () {56 vars in 1374 bytes} [Tue May 10 05:21:50 2022] GET /identity/v3/role_assignments?user.id=d7b3cdc04b8a448a8f780d17d0658c58&scope.project.id=c00aac4e3d244bf5a26814ed404a08f0&role.id=8df798e3160347fd84a42d1aedd8ccde => generated 259 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:21:50.260866 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba8243a-36ef-4881-8fc7-57b7ec7b1882 None None] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:21:50.261341 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba8243a-36ef-4881-8fc7-57b7ec7b1882 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:21:50.261822 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba8243a-36ef-4881-8fc7-57b7ec7b1882 None None] PATH_INFO: `/` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:21:50.263554 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 125/257] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 10 05:21:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 05:21:50.269517 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d501cc0e-462e-481b-91eb-c0456acf52e5 None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:21:50.271477 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d501cc0e-462e-481b-91eb-c0456acf52e5 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:21:50.271795 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d501cc0e-462e-481b-91eb-c0456acf52e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:21:50.296146 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-d501cc0e-462e-481b-91eb-c0456acf52e5 None None] MFA Rules not processed for user `44883b22532e44049d846938dc2cf423`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:21:50.297806 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-d501cc0e-462e-481b-91eb-c0456acf52e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:21:50.365459 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07704113-d682-4461-887c-516dea13bfaf None admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:21:50.386844 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 126/258] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 10 05:21:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 10 05:21:50.404558 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb4cd13-be46-474f-bc0f-cf8d58f3f1a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:21:50.405257 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb4cd13-be46-474f-bc0f-cf8d58f3f1a9 None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:21:50.405597 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb4cd13-be46-474f-bc0f-cf8d58f3f1a9 None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:21:50.405878 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb4cd13-be46-474f-bc0f-cf8d58f3f1a9 None admin] PATH_INFO: `/v3/roles` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:21:50.407049 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb4cd13-be46-474f-bc0f-cf8d58f3f1a9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:21:50.407622 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb4cd13-be46-474f-bc0f-cf8d58f3f1a9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:21:50.408855 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb4cd13-be46-474f-bc0f-cf8d58f3f1a9 None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:21:50.419272 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 133/259] 10.222.0.23 () {56 vars in 1099 bytes} [Tue May 10 05:21:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:21:50.425329 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d501cc0e-462e-481b-91eb-c0456acf52e5 None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:21:50.434788 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb4cd13-be46-474f-bc0f-cf8d58f3f1a9 None admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:21:50.639472 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d501cc0e-462e-481b-91eb-c0456acf52e5 None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:21:50.647554 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb4cd13-be46-474f-bc0f-cf8d58f3f1a9 None admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:21:50.712962 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21779170-b224-46e7-8898-a8a7f98a06b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:21:50.715083 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21779170-b224-46e7-8898-a8a7f98a06b6 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:21:50.716542 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21779170-b224-46e7-8898-a8a7f98a06b6 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:21:50.717014 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21779170-b224-46e7-8898-a8a7f98a06b6 None admin] PATH_INFO: `/v3/users/cc50aa11bf2a41638dc00b154aa382b2` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:21:50.719210 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505f4414-89b1-4197-a9ce-bd92c97206f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:21:50.720103 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21779170-b224-46e7-8898-a8a7f98a06b6 None admin] RBAC: Authorizing `identity:get_user(user_id=cc50aa11bf2a41638dc00b154aa382b2)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:21:50.721122 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505f4414-89b1-4197-a9ce-bd92c97206f8 None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:21:50.722778 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21779170-b224-46e7-8898-a8a7f98a06b6 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:21:50.723256 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505f4414-89b1-4197-a9ce-bd92c97206f8 None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:21:50.723846 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505f4414-89b1-4197-a9ce-bd92c97206f8 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:21:50.733311 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 127/260] 10.222.0.23 () {56 vars in 1177 bytes} [Tue May 10 05:21:50 2022] GET /identity/v3/users/cc50aa11bf2a41638dc00b154aa382b2 => generated 283 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:21:50.741859 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505f4414-89b1-4197-a9ce-bd92c97206f8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 05:21:50.749137 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21779170-b224-46e7-8898-a8a7f98a06b6 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:21:50.763264 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application [None req-505f4414-89b1-4197-a9ce-bd92c97206f8 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 10 05:21:50.763264 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 05:21:50.763264 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 05:21:50.763264 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 05:21:50.763264 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 05:21:50.763264 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 05:21:50.763264 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 05:21:50.763264 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 05:21:50.763264 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 05:21:50.763264 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 05:21:50.763264 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 05:21:50.763264 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 05:21:50.763264 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 05:21:50.763264 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 05:21:50.763264 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 05:21:50.763264 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 05:21:50.764245 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 05:21:50.764245 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 05:21:50.764245 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 05:21:50.764245 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 05:21:50.764245 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 05:21:50.764245 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 05:21:50.764245 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 05:21:50.764245 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 05:21:50.764245 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 05:21:50.764245 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.get_or_create( May 10 05:21:50.764245 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 05:21:50.764245 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application with Lock( May 10 05:21:50.764245 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 05:21:50.764245 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self._enter() May 10 05:21:50.764245 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 05:21:50.764245 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 05:21:50.765052 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 05:21:50.765052 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.creator() May 10 05:21:50.765052 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 05:21:50.765052 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application created_value = creator( May 10 05:21:50.765052 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 05:21:50.765052 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 05:21:50.765052 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 05:21:50.765052 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 05:21:50.765052 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 05:21:50.765052 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 05:21:50.765052 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 10 05:21:50.765052 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application May 10 05:21:50.771803 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 134/261] 10.222.0.23 () {56 vars in 1114 bytes} [Tue May 10 05:21:50 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 343 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 05:21:50.809743 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505f4414-89b1-4197-a9ce-bd92c97206f8 None admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:21:50.892856 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21779170-b224-46e7-8898-a8a7f98a06b6 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:21:50.930122 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3208fc8d-c778-41da-951a-9641f30fbc64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:21:50.931383 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3208fc8d-c778-41da-951a-9641f30fbc64 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:21:50.931888 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3208fc8d-c778-41da-951a-9641f30fbc64 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:21:50.932379 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3208fc8d-c778-41da-951a-9641f30fbc64 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:21:51.009601 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505f4414-89b1-4197-a9ce-bd92c97206f8 None admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:21:51.009956 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3208fc8d-c778-41da-951a-9641f30fbc64 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:21:51.011856 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3208fc8d-c778-41da-951a-9641f30fbc64 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:21:51.091765 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9879d5be-729c-41c6-b466-2c7cb2448146 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:21:51.092559 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9879d5be-729c-41c6-b466-2c7cb2448146 None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:21:51.092732 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9879d5be-729c-41c6-b466-2c7cb2448146 None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:21:51.092974 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9879d5be-729c-41c6-b466-2c7cb2448146 None admin] PATH_INFO: `/v3/roles` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:21:51.093737 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9879d5be-729c-41c6-b466-2c7cb2448146 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:21:51.094045 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9879d5be-729c-41c6-b466-2c7cb2448146 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:21:51.095471 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9879d5be-729c-41c6-b466-2c7cb2448146 None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:21:51.116255 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 135/262] 10.222.0.23 () {56 vars in 1111 bytes} [Tue May 10 05:21:50 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 05:21:51.124233 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 128/263] 10.222.0.23 () {58 vars in 1282 bytes} [Tue May 10 05:21:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 10 05:21:51.126207 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9879d5be-729c-41c6-b466-2c7cb2448146 None admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:21:51.129695 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3208fc8d-c778-41da-951a-9641f30fbc64 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:21:51.235269 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3208fc8d-c778-41da-951a-9641f30fbc64 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:21:51.272707 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d327866-1be3-420c-b6a5-4c329d0f3f6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:21:51.274044 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d327866-1be3-420c-b6a5-4c329d0f3f6f None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:21:51.274523 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d327866-1be3-420c-b6a5-4c329d0f3f6f None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:21:51.274993 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d327866-1be3-420c-b6a5-4c329d0f3f6f None admin] PATH_INFO: `/v3/projects/c00aac4e3d244bf5a26814ed404a08f0` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:21:51.276574 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d327866-1be3-420c-b6a5-4c329d0f3f6f None admin] RBAC: Authorizing `identity:get_project(project_id=c00aac4e3d244bf5a26814ed404a08f0)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:21:51.278365 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d327866-1be3-420c-b6a5-4c329d0f3f6f None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:21:51.280987 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 129/264] 10.222.0.23 () {56 vars in 1186 bytes} [Tue May 10 05:21:51 2022] GET /identity/v3/projects/c00aac4e3d244bf5a26814ed404a08f0 => generated 302 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:21:51.287370 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d327866-1be3-420c-b6a5-4c329d0f3f6f None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:21:51.342308 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9879d5be-729c-41c6-b466-2c7cb2448146 None admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:21:51.420317 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f924bd4-9e2a-4e95-8948-a74e3d6ca965 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:21:51.421228 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f924bd4-9e2a-4e95-8948-a74e3d6ca965 None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:21:51.421507 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f924bd4-9e2a-4e95-8948-a74e3d6ca965 None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:21:51.421778 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f924bd4-9e2a-4e95-8948-a74e3d6ca965 None admin] PATH_INFO: `/v3/users/cc50aa11bf2a41638dc00b154aa382b2` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:21:51.428345 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f924bd4-9e2a-4e95-8948-a74e3d6ca965 None admin] RBAC: Authorizing `identity:get_user(user_id=cc50aa11bf2a41638dc00b154aa382b2)` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:21:51.429840 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f924bd4-9e2a-4e95-8948-a74e3d6ca965 None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:21:51.431540 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 136/265] 10.222.0.23 () {56 vars in 1177 bytes} [Tue May 10 05:21:51 2022] GET /identity/v3/users/cc50aa11bf2a41638dc00b154aa382b2 => generated 283 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:21:51.432450 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d327866-1be3-420c-b6a5-4c329d0f3f6f None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:21:51.455054 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f924bd4-9e2a-4e95-8948-a74e3d6ca965 None admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:21:51.477116 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947c8dae-d255-4b20-990b-9daeeef0b047 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:21:51.477812 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947c8dae-d255-4b20-990b-9daeeef0b047 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:21:51.478090 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947c8dae-d255-4b20-990b-9daeeef0b047 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:21:51.478364 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947c8dae-d255-4b20-990b-9daeeef0b047 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:21:51.479218 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947c8dae-d255-4b20-990b-9daeeef0b047 None admin] RBAC: Adding query filter params (role.id=199ac1dd842441d7913c6ee89d8fbecc, scope.project.id=c00aac4e3d244bf5a26814ed404a08f0, user.id=cc50aa11bf2a41638dc00b154aa382b2) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:21:51.479520 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947c8dae-d255-4b20-990b-9daeeef0b047 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:21:51.480995 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947c8dae-d255-4b20-990b-9daeeef0b047 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:21:51.496868 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 130/266] 10.222.0.23 () {56 vars in 1374 bytes} [Tue May 10 05:21:51 2022] GET /identity/v3/role_assignments?user.id=cc50aa11bf2a41638dc00b154aa382b2&scope.project.id=c00aac4e3d244bf5a26814ed404a08f0&role.id=199ac1dd842441d7913c6ee89d8fbecc => generated 608 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:21:51.581228 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f924bd4-9e2a-4e95-8948-a74e3d6ca965 None admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:21:51.619358 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab2e72b-8a17-46c1-81ba-8004483f7488 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:21:51.620072 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab2e72b-8a17-46c1-81ba-8004483f7488 None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:21:51.620351 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab2e72b-8a17-46c1-81ba-8004483f7488 None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:21:51.620978 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab2e72b-8a17-46c1-81ba-8004483f7488 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:21:51.704900 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab2e72b-8a17-46c1-81ba-8004483f7488 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:21:51.706466 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab2e72b-8a17-46c1-81ba-8004483f7488 None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:21:51.815429 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 137/267] 10.222.0.23 () {58 vars in 1282 bytes} [Tue May 10 05:21:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 10 05:21:51.816751 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947c8dae-d255-4b20-990b-9daeeef0b047 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:21:51.926585 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947c8dae-d255-4b20-990b-9daeeef0b047 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:21:51.962578 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631d4c2f-430e-49d2-bf1a-443f1e8f951c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:21:51.963780 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631d4c2f-430e-49d2-bf1a-443f1e8f951c None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:21:51.964203 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631d4c2f-430e-49d2-bf1a-443f1e8f951c None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:21:51.964616 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631d4c2f-430e-49d2-bf1a-443f1e8f951c None admin] PATH_INFO: `/v3/projects/c00aac4e3d244bf5a26814ed404a08f0` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:21:51.965982 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631d4c2f-430e-49d2-bf1a-443f1e8f951c None admin] RBAC: Authorizing `identity:get_project(project_id=c00aac4e3d244bf5a26814ed404a08f0)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:21:51.967601 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631d4c2f-430e-49d2-bf1a-443f1e8f951c None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:21:51.969794 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 131/268] 10.222.0.23 () {56 vars in 1186 bytes} [Tue May 10 05:21:51 2022] GET /identity/v3/projects/c00aac4e3d244bf5a26814ed404a08f0 => generated 302 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:21:51.975755 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab2e72b-8a17-46c1-81ba-8004483f7488 None admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:21:52.073323 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab2e72b-8a17-46c1-81ba-8004483f7488 None admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:21:52.111037 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c835dd4-f063-4b96-9af1-6ea4485ff476 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:21:52.112071 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c835dd4-f063-4b96-9af1-6ea4485ff476 None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:21:52.112520 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c835dd4-f063-4b96-9af1-6ea4485ff476 None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:21:52.112961 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c835dd4-f063-4b96-9af1-6ea4485ff476 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:21:52.113955 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c835dd4-f063-4b96-9af1-6ea4485ff476 None admin] RBAC: Adding query filter params (role.id=b0cb991ebc2d42d5a5de343c57086616, scope.project.id=c00aac4e3d244bf5a26814ed404a08f0, user.id=cc50aa11bf2a41638dc00b154aa382b2) {{(pid=79879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:21:52.114464 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c835dd4-f063-4b96-9af1-6ea4485ff476 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:21:52.116121 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c835dd4-f063-4b96-9af1-6ea4485ff476 None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:21:52.123175 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 138/269] 10.222.0.23 () {56 vars in 1374 bytes} [Tue May 10 05:21:51 2022] GET /identity/v3/role_assignments?user.id=cc50aa11bf2a41638dc00b154aa382b2&scope.project.id=c00aac4e3d244bf5a26814ed404a08f0&role.id=b0cb991ebc2d42d5a5de343c57086616 => generated 608 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:21:52.412976 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b95d14a-0f9f-49b5-ad09-c5be5892ca35 None None] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:21:52.413585 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b95d14a-0f9f-49b5-ad09-c5be5892ca35 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:21:52.413994 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b95d14a-0f9f-49b5-ad09-c5be5892ca35 None None] PATH_INFO: `/` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:21:52.415858 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 132/270] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 10 05:21:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 05:21:52.422139 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb100b3f-5c9c-4b5f-868e-b85010b9af57 None None] REQUEST_METHOD: `POST` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:21:52.422615 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb100b3f-5c9c-4b5f-868e-b85010b9af57 None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:21:52.422901 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb100b3f-5c9c-4b5f-868e-b85010b9af57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:21:52.423532 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c686fc-d591-49af-9d3d-234d7c45b9b0 None None] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:21:52.423845 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c686fc-d591-49af-9d3d-234d7c45b9b0 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:21:52.424306 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c686fc-d591-49af-9d3d-234d7c45b9b0 None None] PATH_INFO: `/` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:21:52.425850 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 133/271] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 10 05:21:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 05:21:52.431782 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932cd896-0066-4a92-a955-64643e38f87d None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:21:52.432066 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932cd896-0066-4a92-a955-64643e38f87d None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:21:52.432337 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932cd896-0066-4a92-a955-64643e38f87d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:21:52.445642 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.auth.core [None req-fb100b3f-5c9c-4b5f-868e-b85010b9af57 None None] MFA Rules not processed for user `44883b22532e44049d846938dc2cf423`. Rule list: `[]` (Enabled: `True`). {{(pid=79879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:21:52.447176 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-fb100b3f-5c9c-4b5f-868e-b85010b9af57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:21:52.450376 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-932cd896-0066-4a92-a955-64643e38f87d None None] MFA Rules not processed for user `44883b22532e44049d846938dc2cf423`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:21:52.451895 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-932cd896-0066-4a92-a955-64643e38f87d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:21:52.537073 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 134/272] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 10 05:21:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 10 05:21:52.537938 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 139/273] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 10 05:21:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 05:21:52.560569 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932cd896-0066-4a92-a955-64643e38f87d None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:21:52.563789 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb100b3f-5c9c-4b5f-868e-b85010b9af57 None None] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:21:52.668949 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932cd896-0066-4a92-a955-64643e38f87d None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:21:52.681369 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb100b3f-5c9c-4b5f-868e-b85010b9af57 None None] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:21:52.706029 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10028a5a-ed47-4499-b302-061e00aeaa2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:21:52.707132 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10028a5a-ed47-4499-b302-061e00aeaa2f None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:21:52.707638 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10028a5a-ed47-4499-b302-061e00aeaa2f None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:21:52.708117 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10028a5a-ed47-4499-b302-061e00aeaa2f None admin] PATH_INFO: `/v3/roles/member` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:21:52.718937 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10028a5a-ed47-4499-b302-061e00aeaa2f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 05:21:52.720699 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2a2a7a-b0e5-466a-83e8-c995a7d37600 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:21:52.721624 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2a2a7a-b0e5-466a-83e8-c995a7d37600 None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:21:52.721990 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2a2a7a-b0e5-466a-83e8-c995a7d37600 None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:21:52.722354 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2a2a7a-b0e5-466a-83e8-c995a7d37600 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:21:52.723704 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2a2a7a-b0e5-466a-83e8-c995a7d37600 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:21:52.725666 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2a2a7a-b0e5-466a-83e8-c995a7d37600 None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:21:52.726984 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 140/274] 10.222.0.23 () {56 vars in 1108 bytes} [Tue May 10 05:21:52 2022] GET /identity/v3/domains/default => generated 199 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 05:21:52.728926 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application [None req-10028a5a-ed47-4499-b302-061e00aeaa2f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 10 05:21:52.728926 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 05:21:52.728926 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 05:21:52.728926 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 05:21:52.728926 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 05:21:52.728926 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 05:21:52.728926 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 05:21:52.728926 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 05:21:52.728926 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 05:21:52.728926 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 05:21:52.728926 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 05:21:52.728926 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 05:21:52.728926 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 05:21:52.728926 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 05:21:52.728926 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 05:21:52.728926 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 05:21:52.729840 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 05:21:52.729840 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 05:21:52.729840 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 05:21:52.729840 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 05:21:52.729840 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 05:21:52.729840 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 05:21:52.729840 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 05:21:52.729840 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 05:21:52.729840 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 05:21:52.729840 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.get_or_create( May 10 05:21:52.729840 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 05:21:52.729840 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application with Lock( May 10 05:21:52.729840 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 05:21:52.729840 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._enter() May 10 05:21:52.729840 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 05:21:52.729840 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 05:21:52.730630 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 05:21:52.730630 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.creator() May 10 05:21:52.730630 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 05:21:52.730630 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application created_value = creator( May 10 05:21:52.730630 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 05:21:52.730630 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 05:21:52.730630 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 05:21:52.730630 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 05:21:52.730630 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 05:21:52.730630 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 05:21:52.730630 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 10 05:21:52.730630 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application May 10 05:21:52.733081 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2a2a7a-b0e5-466a-83e8-c995a7d37600 None admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:21:52.733228 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 135/275] 10.222.0.23 () {56 vars in 1099 bytes} [Tue May 10 05:21:52 2022] GET /identity/v3/roles/member => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 05:21:52.739476 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10028a5a-ed47-4499-b302-061e00aeaa2f None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:21:52.851566 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10028a5a-ed47-4499-b302-061e00aeaa2f None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:21:52.852448 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2a2a7a-b0e5-466a-83e8-c995a7d37600 None admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:21:52.889902 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673acd0f-7696-406b-be71-7b322ba68ebc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:21:52.890580 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673acd0f-7696-406b-be71-7b322ba68ebc None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:21:52.890858 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673acd0f-7696-406b-be71-7b322ba68ebc None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:21:52.891130 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673acd0f-7696-406b-be71-7b322ba68ebc None admin] PATH_INFO: `/v3/roles` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:21:52.891913 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673acd0f-7696-406b-be71-7b322ba68ebc None admin] RBAC: Adding query filter params (name=member) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:21:52.892214 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673acd0f-7696-406b-be71-7b322ba68ebc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:21:52.893606 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673acd0f-7696-406b-be71-7b322ba68ebc None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:21:52.896962 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d2c9fb-d876-4d3c-b542-cf33b217772b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:21:52.897882 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d2c9fb-d876-4d3c-b542-cf33b217772b None admin] REQUEST_METHOD: `POST` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:21:52.898418 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d2c9fb-d876-4d3c-b542-cf33b217772b None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:21:52.898900 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d2c9fb-d876-4d3c-b542-cf33b217772b None admin] PATH_INFO: `/v3/users` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:21:52.899852 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d2c9fb-d876-4d3c-b542-cf33b217772b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:21:52.901511 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d2c9fb-d876-4d3c-b542-cf33b217772b None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:21:52.906727 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 136/276] 10.222.0.23 () {56 vars in 1101 bytes} [Tue May 10 05:21:52 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:21:52.907904 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673acd0f-7696-406b-be71-7b322ba68ebc None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:21:52.931366 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 141/277] 10.222.0.23 () {60 vars in 1132 bytes} [Tue May 10 05:21:52 2022] POST /identity/v3/users => generated 293 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 05:21:53.028444 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673acd0f-7696-406b-be71-7b322ba68ebc None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:21:53.065040 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e694c259-01b4-4acf-a32f-eaa4e5ad63bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:21:53.066322 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e694c259-01b4-4acf-a32f-eaa4e5ad63bf None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:21:53.066821 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e694c259-01b4-4acf-a32f-eaa4e5ad63bf None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:21:53.067364 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e694c259-01b4-4acf-a32f-eaa4e5ad63bf None admin] PATH_INFO: `/v3/users/8dd2fdab422a4c3da2f2faea882c469a` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:21:53.083331 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e694c259-01b4-4acf-a32f-eaa4e5ad63bf None admin] RBAC: Authorizing `identity:get_user(user_id=8dd2fdab422a4c3da2f2faea882c469a)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:21:53.085258 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e694c259-01b4-4acf-a32f-eaa4e5ad63bf None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:21:53.087385 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 137/278] 10.222.0.23 () {56 vars in 1177 bytes} [Tue May 10 05:21:52 2022] GET /identity/v3/users/8dd2fdab422a4c3da2f2faea882c469a => generated 293 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:21:53.093705 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d2c9fb-d876-4d3c-b542-cf33b217772b None admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:21:53.204342 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d2c9fb-d876-4d3c-b542-cf33b217772b None admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:21:53.243974 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64401704-4cbc-4b76-a076-e8e0e8e9fd59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:21:53.244649 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64401704-4cbc-4b76-a076-e8e0e8e9fd59 None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:21:53.244921 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64401704-4cbc-4b76-a076-e8e0e8e9fd59 None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:21:53.245193 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64401704-4cbc-4b76-a076-e8e0e8e9fd59 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:21:53.246479 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64401704-4cbc-4b76-a076-e8e0e8e9fd59 None admin] RBAC: Adding query filter params (role.id=382636e67fc142a2b2f486340d959e11, user.id=8dd2fdab422a4c3da2f2faea882c469a, scope.system=all) {{(pid=79879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:21:53.246850 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64401704-4cbc-4b76-a076-e8e0e8e9fd59 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:21:53.248349 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64401704-4cbc-4b76-a076-e8e0e8e9fd59 None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:21:53.254408 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 142/279] 10.222.0.23 () {56 vars in 1308 bytes} [Tue May 10 05:21:53 2022] GET /identity/v3/role_assignments?user.id=8dd2fdab422a4c3da2f2faea882c469a&scope.system=all&role.id=382636e67fc142a2b2f486340d959e11 => generated 226 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:21:53.368019 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3860a4-77f1-4845-a436-bba30aa68988 None None] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:21:53.368691 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3860a4-77f1-4845-a436-bba30aa68988 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:21:53.369181 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3860a4-77f1-4845-a436-bba30aa68988 None None] PATH_INFO: `/` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:21:53.371623 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 138/280] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 10 05:21:53 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 05:21:53.377016 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23382526-bf51-4fcd-82cd-811fa1ab040e None None] REQUEST_METHOD: `POST` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:21:53.377302 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23382526-bf51-4fcd-82cd-811fa1ab040e None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:21:53.377575 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23382526-bf51-4fcd-82cd-811fa1ab040e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:21:53.399032 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.auth.core [None req-23382526-bf51-4fcd-82cd-811fa1ab040e None None] MFA Rules not processed for user `44883b22532e44049d846938dc2cf423`. Rule list: `[]` (Enabled: `True`). {{(pid=79879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:21:53.400295 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-23382526-bf51-4fcd-82cd-811fa1ab040e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:21:53.467468 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c40833-98fe-4bff-bbeb-29c08216059f None None] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:21:53.468118 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c40833-98fe-4bff-bbeb-29c08216059f None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:21:53.468604 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c40833-98fe-4bff-bbeb-29c08216059f None None] PATH_INFO: `/` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:21:53.470719 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 139/281] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 10 05:21:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 05:21:53.477181 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e0e86b-c839-4307-b230-d53b5527d3e4 None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:21:53.477683 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e0e86b-c839-4307-b230-d53b5527d3e4 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:21:53.478100 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e0e86b-c839-4307-b230-d53b5527d3e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:21:53.489949 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 143/282] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 10 05:21:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 05:21:53.498781 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-77e0e86b-c839-4307-b230-d53b5527d3e4 None None] MFA Rules not processed for user `44883b22532e44049d846938dc2cf423`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:21:53.500183 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-77e0e86b-c839-4307-b230-d53b5527d3e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:21:53.513779 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23382526-bf51-4fcd-82cd-811fa1ab040e None None] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:21:53.589647 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 140/283] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 10 05:21:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 05:21:53.610518 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23382526-bf51-4fcd-82cd-811fa1ab040e None None] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:21:53.628749 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e0e86b-c839-4307-b230-d53b5527d3e4 None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:21:53.644460 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a94fb0-40d4-4809-9684-424a5da2fce3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:21:53.645269 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a94fb0-40d4-4809-9684-424a5da2fce3 None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:21:53.645688 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a94fb0-40d4-4809-9684-424a5da2fce3 None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:21:53.645960 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a94fb0-40d4-4809-9684-424a5da2fce3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:21:53.656318 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a94fb0-40d4-4809-9684-424a5da2fce3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 05:21:53.664024 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application [None req-16a94fb0-40d4-4809-9684-424a5da2fce3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 10 05:21:53.664024 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 05:21:53.664024 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 05:21:53.664024 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 05:21:53.664024 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 05:21:53.664024 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 05:21:53.664024 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 05:21:53.664024 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 05:21:53.664024 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 05:21:53.664024 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 05:21:53.664024 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 05:21:53.664024 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 05:21:53.664024 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 05:21:53.664024 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 05:21:53.664024 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 05:21:53.664024 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 05:21:53.664914 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 05:21:53.664914 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 05:21:53.664914 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 05:21:53.664914 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 05:21:53.664914 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 05:21:53.664914 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 05:21:53.664914 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 05:21:53.664914 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 05:21:53.664914 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 05:21:53.664914 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.get_or_create( May 10 05:21:53.664914 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 05:21:53.664914 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application with Lock( May 10 05:21:53.664914 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 05:21:53.664914 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self._enter() May 10 05:21:53.664914 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 05:21:53.664914 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 05:21:53.665710 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 05:21:53.665710 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.creator() May 10 05:21:53.665710 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 05:21:53.665710 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application created_value = creator( May 10 05:21:53.665710 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 05:21:53.665710 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 05:21:53.665710 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 05:21:53.665710 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 05:21:53.665710 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 05:21:53.665710 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 05:21:53.665710 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 10 05:21:53.665710 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application May 10 05:21:53.670114 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 144/284] 10.222.0.23 () {56 vars in 1099 bytes} [Tue May 10 05:21:53 2022] GET /identity/v3/roles/member => generated 84 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 05:21:53.671381 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a94fb0-40d4-4809-9684-424a5da2fce3 None admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:21:53.785737 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a94fb0-40d4-4809-9684-424a5da2fce3 None admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:21:53.821034 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966bce57-47ce-4f1d-8855-62362d5d8ebf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:21:53.821711 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966bce57-47ce-4f1d-8855-62362d5d8ebf None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:21:53.821984 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966bce57-47ce-4f1d-8855-62362d5d8ebf None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:21:53.822256 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966bce57-47ce-4f1d-8855-62362d5d8ebf None admin] PATH_INFO: `/v3/roles` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:21:53.823007 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966bce57-47ce-4f1d-8855-62362d5d8ebf None admin] RBAC: Adding query filter params (name=member) {{(pid=79879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:21:53.823319 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966bce57-47ce-4f1d-8855-62362d5d8ebf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:21:53.825176 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966bce57-47ce-4f1d-8855-62362d5d8ebf None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:21:53.834101 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 145/285] 10.222.0.23 () {56 vars in 1101 bytes} [Tue May 10 05:21:53 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 05:21:53.840027 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966bce57-47ce-4f1d-8855-62362d5d8ebf None admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:21:53.855493 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e0e86b-c839-4307-b230-d53b5527d3e4 None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:21:53.943470 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966bce57-47ce-4f1d-8855-62362d5d8ebf None admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:21:53.944177 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7abfb5-5139-4a27-96f6-51cd107a3cda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:21:53.945321 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7abfb5-5139-4a27-96f6-51cd107a3cda None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:21:53.945799 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7abfb5-5139-4a27-96f6-51cd107a3cda None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:21:53.946354 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7abfb5-5139-4a27-96f6-51cd107a3cda None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:21:53.971644 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7abfb5-5139-4a27-96f6-51cd107a3cda None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 05:21:53.977568 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6606c7b9-31d4-4e00-8af1-35d12a5c9dca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:21:53.978451 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6606c7b9-31d4-4e00-8af1-35d12a5c9dca None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:21:53.978727 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6606c7b9-31d4-4e00-8af1-35d12a5c9dca None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:21:53.983755 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6606c7b9-31d4-4e00-8af1-35d12a5c9dca None admin] PATH_INFO: `/v3/users/72541e1a3f7548e0bd576f054ded0dba` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:21:53.983755 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6606c7b9-31d4-4e00-8af1-35d12a5c9dca None admin] RBAC: Authorizing `identity:get_user(user_id=72541e1a3f7548e0bd576f054ded0dba)` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:21:53.983755 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6606c7b9-31d4-4e00-8af1-35d12a5c9dca None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:21:53.983755 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 146/286] 10.222.0.23 () {56 vars in 1177 bytes} [Tue May 10 05:21:53 2022] GET /identity/v3/users/72541e1a3f7548e0bd576f054ded0dba => generated 297 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 05:21:53.989715 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application [None req-2e7abfb5-5139-4a27-96f6-51cd107a3cda None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 10 05:21:53.989715 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 05:21:53.989715 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 05:21:53.989715 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 05:21:53.989715 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 05:21:53.989715 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 05:21:53.989715 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 05:21:53.989715 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 05:21:53.989715 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 05:21:53.989715 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 05:21:53.989715 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 05:21:53.989715 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 05:21:53.989715 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 05:21:53.989715 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 05:21:53.989715 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 05:21:53.989715 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 05:21:53.990667 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 05:21:53.990667 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 05:21:53.990667 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 05:21:53.990667 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 05:21:53.990667 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 05:21:53.990667 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 05:21:53.990667 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 05:21:53.990667 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 05:21:53.990667 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 05:21:53.990667 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.get_or_create( May 10 05:21:53.990667 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 05:21:53.990667 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application with Lock( May 10 05:21:53.990667 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 05:21:53.990667 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._enter() May 10 05:21:53.990667 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 05:21:53.990667 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 05:21:53.991483 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 05:21:53.991483 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.creator() May 10 05:21:53.991483 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 05:21:53.991483 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application created_value = creator( May 10 05:21:53.991483 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 05:21:53.991483 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 05:21:53.991483 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 05:21:53.991483 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 05:21:53.991483 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 05:21:53.991483 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 05:21:53.991483 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 10 05:21:53.991483 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application May 10 05:21:53.991483 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 141/287] 10.222.0.23 () {56 vars in 1099 bytes} [Tue May 10 05:21:53 2022] GET /identity/v3/roles/reader => generated 84 bytes in 363 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 05:21:53.993991 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6606c7b9-31d4-4e00-8af1-35d12a5c9dca None admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:21:53.999759 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7abfb5-5139-4a27-96f6-51cd107a3cda None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:21:54.113410 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7abfb5-5139-4a27-96f6-51cd107a3cda None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:21:54.149597 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec4920f-9450-45ca-933d-e4ee30c519f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:21:54.150269 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec4920f-9450-45ca-933d-e4ee30c519f4 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:21:54.150548 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec4920f-9450-45ca-933d-e4ee30c519f4 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:21:54.150819 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec4920f-9450-45ca-933d-e4ee30c519f4 None admin] PATH_INFO: `/v3/roles` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:21:54.151599 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec4920f-9450-45ca-933d-e4ee30c519f4 None admin] RBAC: Adding query filter params (name=reader) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:21:54.151905 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec4920f-9450-45ca-933d-e4ee30c519f4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:21:54.153284 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec4920f-9450-45ca-933d-e4ee30c519f4 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:21:54.162906 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 142/288] 10.222.0.23 () {56 vars in 1101 bytes} [Tue May 10 05:21:53 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:21:54.170207 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec4920f-9450-45ca-933d-e4ee30c519f4 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:21:54.253464 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6606c7b9-31d4-4e00-8af1-35d12a5c9dca None admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:21:54.286770 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec4920f-9450-45ca-933d-e4ee30c519f4 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:21:54.322898 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e7affd-46dc-4a57-944e-d678be08de60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:21:54.323949 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e7affd-46dc-4a57-944e-d678be08de60 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:21:54.324230 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e7affd-46dc-4a57-944e-d678be08de60 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:21:54.324505 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e7affd-46dc-4a57-944e-d678be08de60 None admin] PATH_INFO: `/v3/users/d7b3cdc04b8a448a8f780d17d0658c58` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:21:54.325863 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e7affd-46dc-4a57-944e-d678be08de60 None admin] RBAC: Authorizing `identity:get_user(user_id=d7b3cdc04b8a448a8f780d17d0658c58)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:21:54.327675 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e7affd-46dc-4a57-944e-d678be08de60 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:21:54.329976 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 143/289] 10.222.0.23 () {56 vars in 1177 bytes} [Tue May 10 05:21:54 2022] GET /identity/v3/users/d7b3cdc04b8a448a8f780d17d0658c58 => generated 297 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:21:54.333993 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407716fb-8274-44ff-9033-e33c236aed01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:21:54.335098 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407716fb-8274-44ff-9033-e33c236aed01 None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:21:54.336007 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e7affd-46dc-4a57-944e-d678be08de60 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:21:54.336348 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407716fb-8274-44ff-9033-e33c236aed01 None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:21:54.336786 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407716fb-8274-44ff-9033-e33c236aed01 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:21:54.455650 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e7affd-46dc-4a57-944e-d678be08de60 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:21:54.459100 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407716fb-8274-44ff-9033-e33c236aed01 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:21:54.460765 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407716fb-8274-44ff-9033-e33c236aed01 None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:21:54.500066 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5101b658-e204-404f-a23d-c05bea45ecb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:21:54.501421 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5101b658-e204-404f-a23d-c05bea45ecb5 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:21:54.501911 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5101b658-e204-404f-a23d-c05bea45ecb5 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:21:54.502391 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5101b658-e204-404f-a23d-c05bea45ecb5 None admin] PATH_INFO: `/v3/projects/c00aac4e3d244bf5a26814ed404a08f0` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:21:54.504042 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5101b658-e204-404f-a23d-c05bea45ecb5 None admin] RBAC: Authorizing `identity:get_project(project_id=c00aac4e3d244bf5a26814ed404a08f0)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:21:54.505816 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5101b658-e204-404f-a23d-c05bea45ecb5 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:21:54.508368 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 144/290] 10.222.0.23 () {56 vars in 1186 bytes} [Tue May 10 05:21:54 2022] GET /identity/v3/projects/c00aac4e3d244bf5a26814ed404a08f0 => generated 302 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 05:21:54.514822 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5101b658-e204-404f-a23d-c05bea45ecb5 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:21:54.602986 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 147/291] 10.222.0.23 () {58 vars in 1282 bytes} [Tue May 10 05:21:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 605 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 10 05:21:54.617389 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407716fb-8274-44ff-9033-e33c236aed01 None admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:21:54.631407 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5101b658-e204-404f-a23d-c05bea45ecb5 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:21:54.669418 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a808b9b-67cb-4194-9c09-f65f468d5187 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:21:54.670938 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a808b9b-67cb-4194-9c09-f65f468d5187 None admin] REQUEST_METHOD: `PUT` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:21:54.672079 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a808b9b-67cb-4194-9c09-f65f468d5187 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:21:54.672715 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a808b9b-67cb-4194-9c09-f65f468d5187 None admin] PATH_INFO: `/v3/projects/c00aac4e3d244bf5a26814ed404a08f0/users/d7b3cdc04b8a448a8f780d17d0658c58/roles/8df798e3160347fd84a42d1aedd8ccde` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:21:54.677172 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a808b9b-67cb-4194-9c09-f65f468d5187 None admin] RBAC: Authorizing `identity:create_grant(project_id=c00aac4e3d244bf5a26814ed404a08f0, user_id=d7b3cdc04b8a448a8f780d17d0658c58, role_id=8df798e3160347fd84a42d1aedd8ccde)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:21:54.679007 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a808b9b-67cb-4194-9c09-f65f468d5187 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:21:54.705216 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 145/292] 10.222.0.23 () {58 vars in 1439 bytes} [Tue May 10 05:21:54 2022] PUT /identity/v3/projects/c00aac4e3d244bf5a26814ed404a08f0/users/d7b3cdc04b8a448a8f780d17d0658c58/roles/8df798e3160347fd84a42d1aedd8ccde => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 05:21:54.779328 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407716fb-8274-44ff-9033-e33c236aed01 None admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:21:54.828113 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99372df2-2a3b-4e5f-83ad-c8d0c99458c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:21:54.829400 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99372df2-2a3b-4e5f-83ad-c8d0c99458c6 None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:21:54.829881 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99372df2-2a3b-4e5f-83ad-c8d0c99458c6 None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:21:54.830381 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99372df2-2a3b-4e5f-83ad-c8d0c99458c6 None admin] PATH_INFO: `/v3/projects/c00aac4e3d244bf5a26814ed404a08f0` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:21:54.831854 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99372df2-2a3b-4e5f-83ad-c8d0c99458c6 None admin] RBAC: Authorizing `identity:get_project(project_id=c00aac4e3d244bf5a26814ed404a08f0)` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:21:54.833636 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99372df2-2a3b-4e5f-83ad-c8d0c99458c6 None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:21:54.835662 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 148/293] 10.222.0.23 () {56 vars in 1186 bytes} [Tue May 10 05:21:54 2022] GET /identity/v3/projects/c00aac4e3d244bf5a26814ed404a08f0 => generated 302 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 05:21:54.842177 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a808b9b-67cb-4194-9c09-f65f468d5187 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:21:54.946583 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a808b9b-67cb-4194-9c09-f65f468d5187 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:21:54.980976 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9373021b-c863-4719-bbef-ac57b4cc273a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:21:54.981977 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9373021b-c863-4719-bbef-ac57b4cc273a None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:21:54.982480 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9373021b-c863-4719-bbef-ac57b4cc273a None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:21:54.982951 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9373021b-c863-4719-bbef-ac57b4cc273a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:21:54.984026 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9373021b-c863-4719-bbef-ac57b4cc273a None admin] RBAC: Adding query filter params (role.id=382636e67fc142a2b2f486340d959e11, scope.project.id=c00aac4e3d244bf5a26814ed404a08f0, user.id=72541e1a3f7548e0bd576f054ded0dba) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:21:54.984539 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9373021b-c863-4719-bbef-ac57b4cc273a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:21:54.986192 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9373021b-c863-4719-bbef-ac57b4cc273a None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:21:54.999718 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 146/294] 10.222.0.23 () {56 vars in 1374 bytes} [Tue May 10 05:21:54 2022] GET /identity/v3/role_assignments?user.id=72541e1a3f7548e0bd576f054ded0dba&scope.project.id=c00aac4e3d244bf5a26814ed404a08f0&role.id=382636e67fc142a2b2f486340d959e11 => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:21:55.715632 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f77a7c-c40e-4c1e-b85f-bbe7faef9b8c None None] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:21:55.716161 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f77a7c-c40e-4c1e-b85f-bbe7faef9b8c None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:21:55.716161 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f77a7c-c40e-4c1e-b85f-bbe7faef9b8c None None] PATH_INFO: `/` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:21:55.717779 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 149/295] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 10 05:21:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 05:21:55.723263 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a35159f-033a-42cb-b0c0-38512be7d1b3 None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:21:55.723527 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a35159f-033a-42cb-b0c0-38512be7d1b3 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:21:55.723864 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a35159f-033a-42cb-b0c0-38512be7d1b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:21:55.741278 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-0a35159f-033a-42cb-b0c0-38512be7d1b3 None None] MFA Rules not processed for user `44883b22532e44049d846938dc2cf423`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:21:55.742476 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-0a35159f-033a-42cb-b0c0-38512be7d1b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:21:55.769962 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185be92a-3494-4cbc-b8a6-0dadc5956d82 None None] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:21:55.770268 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185be92a-3494-4cbc-b8a6-0dadc5956d82 None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:21:55.770552 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185be92a-3494-4cbc-b8a6-0dadc5956d82 None None] PATH_INFO: `/` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:21:55.771960 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 150/296] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 10 05:21:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 05:21:55.776708 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09dc1757-46b8-422f-b454-8406f0a7126c None None] REQUEST_METHOD: `POST` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:21:55.776993 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09dc1757-46b8-422f-b454-8406f0a7126c None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:21:55.777263 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09dc1757-46b8-422f-b454-8406f0a7126c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:21:55.793288 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.auth.core [None req-09dc1757-46b8-422f-b454-8406f0a7126c None None] MFA Rules not processed for user `44883b22532e44049d846938dc2cf423`. Rule list: `[]` (Enabled: `True`). {{(pid=79879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:21:55.794475 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-09dc1757-46b8-422f-b454-8406f0a7126c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:21:55.815201 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 147/297] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 10 05:21:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 05:21:55.837932 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a35159f-033a-42cb-b0c0-38512be7d1b3 None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:21:55.872723 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 151/298] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 10 05:21:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 10 05:21:55.895402 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09dc1757-46b8-422f-b454-8406f0a7126c None None] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:21:55.952379 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a35159f-033a-42cb-b0c0-38512be7d1b3 None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:21:55.991665 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f242c5-1953-4825-85ec-75b40d1e8449 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:21:55.992396 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f242c5-1953-4825-85ec-75b40d1e8449 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:21:55.992667 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f242c5-1953-4825-85ec-75b40d1e8449 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:21:55.992931 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f242c5-1953-4825-85ec-75b40d1e8449 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:21:55.994087 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f242c5-1953-4825-85ec-75b40d1e8449 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:21:55.995511 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f242c5-1953-4825-85ec-75b40d1e8449 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:21:56.000516 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09dc1757-46b8-422f-b454-8406f0a7126c None None] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:21:56.002446 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 148/299] 10.222.0.23 () {56 vars in 1108 bytes} [Tue May 10 05:21:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 05:21:56.003298 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f242c5-1953-4825-85ec-75b40d1e8449 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:21:56.043515 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26651eb-0467-4242-b43a-31f7f1ebea34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:21:56.044391 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26651eb-0467-4242-b43a-31f7f1ebea34 None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:21:56.044669 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26651eb-0467-4242-b43a-31f7f1ebea34 None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:21:56.044942 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26651eb-0467-4242-b43a-31f7f1ebea34 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:21:56.058006 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26651eb-0467-4242-b43a-31f7f1ebea34 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 05:21:56.068077 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application [None req-e26651eb-0467-4242-b43a-31f7f1ebea34 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 10 05:21:56.068077 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 05:21:56.068077 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 05:21:56.068077 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 05:21:56.068077 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 05:21:56.068077 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 05:21:56.068077 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 05:21:56.068077 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 05:21:56.068077 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 05:21:56.068077 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 05:21:56.068077 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 05:21:56.068077 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 05:21:56.068077 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 05:21:56.068077 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 05:21:56.068077 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 05:21:56.068077 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 05:21:56.070486 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 05:21:56.070486 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 05:21:56.070486 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 05:21:56.070486 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 05:21:56.070486 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 05:21:56.070486 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 05:21:56.070486 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 05:21:56.070486 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 05:21:56.070486 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 05:21:56.070486 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.get_or_create( May 10 05:21:56.070486 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 05:21:56.070486 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application with Lock( May 10 05:21:56.070486 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 05:21:56.070486 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self._enter() May 10 05:21:56.070486 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 05:21:56.070486 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 05:21:56.072533 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 05:21:56.072533 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.creator() May 10 05:21:56.072533 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 05:21:56.072533 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application created_value = creator( May 10 05:21:56.072533 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 05:21:56.072533 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 05:21:56.072533 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 05:21:56.072533 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 05:21:56.072533 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 05:21:56.072533 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 05:21:56.072533 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 10 05:21:56.072533 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application May 10 05:21:56.072533 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 152/300] 10.222.0.23 () {56 vars in 1099 bytes} [Tue May 10 05:21:55 2022] GET /identity/v3/roles/reader => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 05:21:56.072533 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29711009-e8a9-4599-bc03-17a098273e6f None None] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:21:56.074190 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29711009-e8a9-4599-bc03-17a098273e6f None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:21:56.074190 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29711009-e8a9-4599-bc03-17a098273e6f None None] PATH_INFO: `/` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:21:56.074190 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 153/301] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 10 05:21:56 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 05:21:56.076295 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29711009-e8a9-4599-bc03-17a098273e6f None None] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:21:56.111667 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f242c5-1953-4825-85ec-75b40d1e8449 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:21:56.145071 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddc7a08-cf61-4529-a328-5f05dcd93793 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:21:56.145818 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddc7a08-cf61-4529-a328-5f05dcd93793 None admin] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:21:56.146098 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddc7a08-cf61-4529-a328-5f05dcd93793 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:21:56.146373 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddc7a08-cf61-4529-a328-5f05dcd93793 None admin] PATH_INFO: `/v3/groups` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:21:56.147080 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ddc7a08-cf61-4529-a328-5f05dcd93793 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:21:56.148558 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ddc7a08-cf61-4529-a328-5f05dcd93793 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:21:56.163962 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 149/302] 10.222.0.23 () {60 vars in 1134 bytes} [Tue May 10 05:21:56 2022] POST /identity/v3/groups => generated 229 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 05:21:56.173864 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c9914b-5235-4c37-9272-45ebd021bb97 None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:21:56.173864 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c9914b-5235-4c37-9272-45ebd021bb97 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:21:56.173864 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c9914b-5235-4c37-9272-45ebd021bb97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:21:56.190105 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29711009-e8a9-4599-bc03-17a098273e6f None None] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:21:56.192596 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-24c9914b-5235-4c37-9272-45ebd021bb97 None None] MFA Rules not processed for user `44883b22532e44049d846938dc2cf423`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:21:56.194941 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-24c9914b-5235-4c37-9272-45ebd021bb97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:21:56.235479 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80973f8-e828-465d-9a97-09084af9d552 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:21:56.236467 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80973f8-e828-465d-9a97-09084af9d552 None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:21:56.236842 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80973f8-e828-465d-9a97-09084af9d552 None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:21:56.237185 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80973f8-e828-465d-9a97-09084af9d552 None admin] PATH_INFO: `/v3/roles` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:21:56.238022 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80973f8-e828-465d-9a97-09084af9d552 None admin] RBAC: Adding query filter params (name=reader) {{(pid=79879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:21:56.238325 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80973f8-e828-465d-9a97-09084af9d552 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:21:56.241218 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80973f8-e828-465d-9a97-09084af9d552 None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:21:56.254903 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 154/303] 10.222.0.23 () {56 vars in 1101 bytes} [Tue May 10 05:21:56 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:21:56.268679 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80973f8-e828-465d-9a97-09084af9d552 None admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:21:56.284223 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 150/304] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 10 05:21:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 05:21:56.306709 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c9914b-5235-4c37-9272-45ebd021bb97 None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:21:56.398889 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80973f8-e828-465d-9a97-09084af9d552 None admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:21:56.421929 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c9914b-5235-4c37-9272-45ebd021bb97 None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:21:56.435899 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c9b306-96ea-4706-b277-3da7aee5f73e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:21:56.437077 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c9b306-96ea-4706-b277-3da7aee5f73e None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:21:56.437585 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c9b306-96ea-4706-b277-3da7aee5f73e None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:21:56.437852 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c9b306-96ea-4706-b277-3da7aee5f73e None admin] PATH_INFO: `/v3/users/01503106067349578e5e7b0a4befb0f2` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:21:56.454256 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c9b306-96ea-4706-b277-3da7aee5f73e None admin] RBAC: Authorizing `identity:get_user(user_id=01503106067349578e5e7b0a4befb0f2)` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:21:56.455773 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c9b306-96ea-4706-b277-3da7aee5f73e None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:21:56.457714 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 155/305] 10.222.0.23 () {56 vars in 1177 bytes} [Tue May 10 05:21:56 2022] GET /identity/v3/users/01503106067349578e5e7b0a4befb0f2 => generated 293 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:21:56.463656 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c9b306-96ea-4706-b277-3da7aee5f73e None admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:21:56.475028 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d828442-d1bd-4251-8ba6-4504f44fed63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:21:56.475885 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d828442-d1bd-4251-8ba6-4504f44fed63 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:21:56.476163 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d828442-d1bd-4251-8ba6-4504f44fed63 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:21:56.476431 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d828442-d1bd-4251-8ba6-4504f44fed63 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:21:56.489601 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d828442-d1bd-4251-8ba6-4504f44fed63 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 05:21:56.500127 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application [None req-7d828442-d1bd-4251-8ba6-4504f44fed63 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 10 05:21:56.500127 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 05:21:56.500127 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 05:21:56.500127 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 05:21:56.500127 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 05:21:56.500127 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 05:21:56.500127 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 05:21:56.500127 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 05:21:56.500127 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 05:21:56.500127 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 05:21:56.500127 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 05:21:56.500127 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 05:21:56.500127 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 05:21:56.500127 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 05:21:56.500127 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 05:21:56.500127 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 05:21:56.501041 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 05:21:56.501041 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 05:21:56.501041 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 05:21:56.501041 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 05:21:56.501041 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 05:21:56.501041 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 05:21:56.501041 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 05:21:56.501041 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 05:21:56.501041 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 05:21:56.501041 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.get_or_create( May 10 05:21:56.501041 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 05:21:56.501041 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application with Lock( May 10 05:21:56.501041 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 05:21:56.501041 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._enter() May 10 05:21:56.501041 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 05:21:56.501041 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 05:21:56.501821 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 05:21:56.501821 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.creator() May 10 05:21:56.501821 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 05:21:56.501821 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application created_value = creator( May 10 05:21:56.501821 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 05:21:56.501821 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 05:21:56.501821 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 05:21:56.501821 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 05:21:56.501821 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 05:21:56.501821 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 05:21:56.501821 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 10 05:21:56.501821 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application May 10 05:21:56.501821 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 151/306] 10.222.0.23 () {56 vars in 1099 bytes} [Tue May 10 05:21:56 2022] GET /identity/v3/roles/member => generated 84 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 05:21:56.508737 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d828442-d1bd-4251-8ba6-4504f44fed63 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:21:56.578938 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c9b306-96ea-4706-b277-3da7aee5f73e None admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:21:56.612751 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e3fd85-2ed4-4b08-af54-90fd86b1dcb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:21:56.613794 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e3fd85-2ed4-4b08-af54-90fd86b1dcb2 None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:21:56.614331 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e3fd85-2ed4-4b08-af54-90fd86b1dcb2 None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:21:56.614832 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e3fd85-2ed4-4b08-af54-90fd86b1dcb2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:21:56.615892 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e3fd85-2ed4-4b08-af54-90fd86b1dcb2 None admin] RBAC: Adding query filter params (role.id=8df798e3160347fd84a42d1aedd8ccde, user.id=01503106067349578e5e7b0a4befb0f2, scope.system=all) {{(pid=79879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:21:56.615997 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d828442-d1bd-4251-8ba6-4504f44fed63 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:21:56.616516 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e3fd85-2ed4-4b08-af54-90fd86b1dcb2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:21:56.618262 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e3fd85-2ed4-4b08-af54-90fd86b1dcb2 None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:21:56.624467 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 156/307] 10.222.0.23 () {56 vars in 1308 bytes} [Tue May 10 05:21:56 2022] GET /identity/v3/role_assignments?user.id=01503106067349578e5e7b0a4befb0f2&scope.system=all&role.id=8df798e3160347fd84a42d1aedd8ccde => generated 226 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:21:56.653045 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7adb0b-0e88-47ae-bcf7-6c8f67a0eafd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:21:56.653732 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7adb0b-0e88-47ae-bcf7-6c8f67a0eafd None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:21:56.654012 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7adb0b-0e88-47ae-bcf7-6c8f67a0eafd None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:21:56.654280 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7adb0b-0e88-47ae-bcf7-6c8f67a0eafd None admin] PATH_INFO: `/v3/roles` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:21:56.655048 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7adb0b-0e88-47ae-bcf7-6c8f67a0eafd None admin] RBAC: Adding query filter params (name=member) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:21:56.655350 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7adb0b-0e88-47ae-bcf7-6c8f67a0eafd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:21:56.656815 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7adb0b-0e88-47ae-bcf7-6c8f67a0eafd None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:21:56.666754 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 152/308] 10.222.0.23 () {56 vars in 1101 bytes} [Tue May 10 05:21:56 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:21:56.672720 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e3fd85-2ed4-4b08-af54-90fd86b1dcb2 None admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:21:56.783339 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e3fd85-2ed4-4b08-af54-90fd86b1dcb2 None admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:21:56.818753 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab273c9-6212-4e69-893b-857d3517cbbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:21:56.819692 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab273c9-6212-4e69-893b-857d3517cbbd None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:21:56.820016 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab273c9-6212-4e69-893b-857d3517cbbd None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:21:56.820306 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab273c9-6212-4e69-893b-857d3517cbbd None admin] PATH_INFO: `/v3/users/8dd2fdab422a4c3da2f2faea882c469a` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:21:56.821519 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab273c9-6212-4e69-893b-857d3517cbbd None admin] RBAC: Authorizing `identity:get_user(user_id=8dd2fdab422a4c3da2f2faea882c469a)` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:21:56.824530 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab273c9-6212-4e69-893b-857d3517cbbd None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:21:56.825005 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 157/309] 10.222.0.23 () {56 vars in 1177 bytes} [Tue May 10 05:21:56 2022] GET /identity/v3/users/8dd2fdab422a4c3da2f2faea882c469a => generated 293 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:21:56.831111 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7adb0b-0e88-47ae-bcf7-6c8f67a0eafd None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:21:56.935522 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7adb0b-0e88-47ae-bcf7-6c8f67a0eafd None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:21:56.968993 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c81a02-e896-4659-a4bd-360383b40677 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:21:56.970682 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c81a02-e896-4659-a4bd-360383b40677 None admin] REQUEST_METHOD: `PUT` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:21:56.971159 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c81a02-e896-4659-a4bd-360383b40677 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:21:56.971674 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c81a02-e896-4659-a4bd-360383b40677 None admin] PATH_INFO: `/v3/system/users/8dd2fdab422a4c3da2f2faea882c469a/roles/382636e67fc142a2b2f486340d959e11` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:21:56.973550 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c81a02-e896-4659-a4bd-360383b40677 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=8dd2fdab422a4c3da2f2faea882c469a, role_id=382636e67fc142a2b2f486340d959e11)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:21:56.975140 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c81a02-e896-4659-a4bd-360383b40677 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:21:56.988748 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 153/310] 10.222.0.23 () {58 vars in 1334 bytes} [Tue May 10 05:21:56 2022] PUT /identity/v3/system/users/8dd2fdab422a4c3da2f2faea882c469a/roles/382636e67fc142a2b2f486340d959e11 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 05:21:57.075449 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d981008e-6719-48d6-8f16-5632cfc5fa06 None None] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:21:57.075974 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d981008e-6719-48d6-8f16-5632cfc5fa06 None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:21:57.076344 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d981008e-6719-48d6-8f16-5632cfc5fa06 None None] PATH_INFO: `/` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:21:57.078179 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 158/311] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 10 05:21:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 05:21:57.084254 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32717740-fb14-41a0-9313-52294a1109c7 None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:21:57.084809 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32717740-fb14-41a0-9313-52294a1109c7 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:21:57.085257 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32717740-fb14-41a0-9313-52294a1109c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:21:57.104578 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-32717740-fb14-41a0-9313-52294a1109c7 None None] MFA Rules not processed for user `44883b22532e44049d846938dc2cf423`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:21:57.106114 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-32717740-fb14-41a0-9313-52294a1109c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:21:57.179659 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 154/312] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 10 05:21:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 10 05:21:57.204558 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d981008e-6719-48d6-8f16-5632cfc5fa06 None None] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:21:57.303990 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d981008e-6719-48d6-8f16-5632cfc5fa06 None None] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:21:57.337411 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9bf13e-b941-438f-adf8-db1ccf089456 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:21:57.338511 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9bf13e-b941-438f-adf8-db1ccf089456 None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:21:57.338964 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9bf13e-b941-438f-adf8-db1ccf089456 None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:21:57.339405 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9bf13e-b941-438f-adf8-db1ccf089456 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:21:57.349889 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9bf13e-b941-438f-adf8-db1ccf089456 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 05:21:57.357961 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application [None req-ae9bf13e-b941-438f-adf8-db1ccf089456 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 10 05:21:57.357961 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 05:21:57.357961 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 05:21:57.357961 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 05:21:57.357961 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 05:21:57.357961 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 05:21:57.357961 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 05:21:57.357961 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 05:21:57.357961 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 05:21:57.357961 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 05:21:57.357961 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 05:21:57.357961 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 05:21:57.357961 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 05:21:57.357961 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 05:21:57.357961 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 05:21:57.357961 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 05:21:57.358819 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 05:21:57.358819 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 05:21:57.358819 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 05:21:57.358819 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 05:21:57.358819 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 05:21:57.358819 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 05:21:57.358819 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 05:21:57.358819 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 05:21:57.358819 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 05:21:57.358819 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.get_or_create( May 10 05:21:57.358819 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 05:21:57.358819 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application with Lock( May 10 05:21:57.358819 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 05:21:57.358819 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self._enter() May 10 05:21:57.358819 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 05:21:57.358819 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 05:21:57.359658 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 05:21:57.359658 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.creator() May 10 05:21:57.359658 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 05:21:57.359658 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application created_value = creator( May 10 05:21:57.359658 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 05:21:57.359658 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 05:21:57.359658 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 05:21:57.359658 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 05:21:57.359658 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 05:21:57.359658 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 05:21:57.359658 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 10 05:21:57.359658 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application May 10 05:21:57.361998 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 159/313] 10.222.0.23 () {56 vars in 1099 bytes} [Tue May 10 05:21:57 2022] GET /identity/v3/roles/reader => generated 84 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 05:21:57.367960 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32717740-fb14-41a0-9313-52294a1109c7 None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:21:57.475631 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32717740-fb14-41a0-9313-52294a1109c7 None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:21:57.507511 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7d3e61-013e-46e2-8dd0-84e34867861a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:21:57.508223 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7d3e61-013e-46e2-8dd0-84e34867861a None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:21:57.508497 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7d3e61-013e-46e2-8dd0-84e34867861a None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:21:57.508769 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7d3e61-013e-46e2-8dd0-84e34867861a None admin] PATH_INFO: `/v3/roles` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:21:57.509534 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7d3e61-013e-46e2-8dd0-84e34867861a None admin] RBAC: Adding query filter params (name=reader) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:21:57.509836 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7d3e61-013e-46e2-8dd0-84e34867861a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:21:57.511208 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7d3e61-013e-46e2-8dd0-84e34867861a None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:21:57.523948 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 155/314] 10.222.0.23 () {56 vars in 1101 bytes} [Tue May 10 05:21:57 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:21:57.525676 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9bf13e-b941-438f-adf8-db1ccf089456 None admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:21:57.626118 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9bf13e-b941-438f-adf8-db1ccf089456 None admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:21:57.658207 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c244128-1049-443a-a2c4-bd32ce52dd56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:21:57.659096 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c244128-1049-443a-a2c4-bd32ce52dd56 None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:21:57.659369 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c244128-1049-443a-a2c4-bd32ce52dd56 None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:21:57.659669 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c244128-1049-443a-a2c4-bd32ce52dd56 None admin] PATH_INFO: `/v3/users/d7b3cdc04b8a448a8f780d17d0658c58` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:21:57.660862 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c244128-1049-443a-a2c4-bd32ce52dd56 None admin] RBAC: Authorizing `identity:get_user(user_id=d7b3cdc04b8a448a8f780d17d0658c58)` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:21:57.662346 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c244128-1049-443a-a2c4-bd32ce52dd56 None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:21:57.664012 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 160/315] 10.222.0.23 () {56 vars in 1177 bytes} [Tue May 10 05:21:57 2022] GET /identity/v3/users/d7b3cdc04b8a448a8f780d17d0658c58 => generated 297 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:21:57.670093 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7d3e61-013e-46e2-8dd0-84e34867861a None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:21:57.770883 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7d3e61-013e-46e2-8dd0-84e34867861a None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:21:57.806805 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec958204-a260-4245-842c-9eaf2881c310 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:21:57.807472 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec958204-a260-4245-842c-9eaf2881c310 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:21:57.807781 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec958204-a260-4245-842c-9eaf2881c310 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:21:57.808053 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec958204-a260-4245-842c-9eaf2881c310 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:21:57.874198 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec958204-a260-4245-842c-9eaf2881c310 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:21:57.875689 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec958204-a260-4245-842c-9eaf2881c310 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:21:57.972393 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 156/316] 10.222.0.23 () {58 vars in 1282 bytes} [Tue May 10 05:21:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 05:21:57.977735 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c244128-1049-443a-a2c4-bd32ce52dd56 None admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:21:58.076075 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c244128-1049-443a-a2c4-bd32ce52dd56 None admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:21:58.108861 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba66f295-f3a0-4e92-9749-8194fc33b961 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:21:58.109732 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba66f295-f3a0-4e92-9749-8194fc33b961 None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:21:58.110012 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba66f295-f3a0-4e92-9749-8194fc33b961 None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:21:58.110284 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba66f295-f3a0-4e92-9749-8194fc33b961 None admin] PATH_INFO: `/v3/projects/c00aac4e3d244bf5a26814ed404a08f0` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:21:58.111476 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba66f295-f3a0-4e92-9749-8194fc33b961 None admin] RBAC: Authorizing `identity:get_project(project_id=c00aac4e3d244bf5a26814ed404a08f0)` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:21:58.112978 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba66f295-f3a0-4e92-9749-8194fc33b961 None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:21:58.115018 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 161/317] 10.222.0.23 () {56 vars in 1186 bytes} [Tue May 10 05:21:57 2022] GET /identity/v3/projects/c00aac4e3d244bf5a26814ed404a08f0 => generated 302 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:21:58.121177 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec958204-a260-4245-842c-9eaf2881c310 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:21:58.217377 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec958204-a260-4245-842c-9eaf2881c310 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:21:58.251293 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f7698c-be9f-4855-bae2-bd5aee8a6ed6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:21:58.251905 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f7698c-be9f-4855-bae2-bd5aee8a6ed6 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:21:58.252177 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f7698c-be9f-4855-bae2-bd5aee8a6ed6 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:21:58.252453 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f7698c-be9f-4855-bae2-bd5aee8a6ed6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:21:58.253282 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f7698c-be9f-4855-bae2-bd5aee8a6ed6 None admin] RBAC: Adding query filter params (role.id=8df798e3160347fd84a42d1aedd8ccde, scope.project.id=c00aac4e3d244bf5a26814ed404a08f0, user.id=d7b3cdc04b8a448a8f780d17d0658c58) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:21:58.253591 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f7698c-be9f-4855-bae2-bd5aee8a6ed6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:21:58.255073 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f7698c-be9f-4855-bae2-bd5aee8a6ed6 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:21:58.260998 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 157/318] 10.222.0.23 () {56 vars in 1374 bytes} [Tue May 10 05:21:58 2022] GET /identity/v3/role_assignments?user.id=d7b3cdc04b8a448a8f780d17d0658c58&scope.project.id=c00aac4e3d244bf5a26814ed404a08f0&role.id=8df798e3160347fd84a42d1aedd8ccde => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:21:58.501262 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd5f141-9eee-43ca-9fca-cb1715451f1b None None] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:21:58.501636 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd5f141-9eee-43ca-9fca-cb1715451f1b None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:21:58.501831 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd5f141-9eee-43ca-9fca-cb1715451f1b None None] PATH_INFO: `/` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:21:58.503483 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 162/319] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 10 05:21:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 05:21:58.510744 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d8bd55-8615-4084-b993-fadc59966efd None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:21:58.510744 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d8bd55-8615-4084-b993-fadc59966efd None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:21:58.510744 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d8bd55-8615-4084-b993-fadc59966efd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:21:58.526453 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-13d8bd55-8615-4084-b993-fadc59966efd None None] MFA Rules not processed for user `44883b22532e44049d846938dc2cf423`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:21:58.527998 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-13d8bd55-8615-4084-b993-fadc59966efd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:21:58.590370 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 158/320] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 10 05:21:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 05:21:58.612726 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd5f141-9eee-43ca-9fca-cb1715451f1b None None] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:21:58.712345 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd5f141-9eee-43ca-9fca-cb1715451f1b None None] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:21:58.750914 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c032a2f-5f46-42ed-928b-804e60a13292 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:21:58.751864 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c032a2f-5f46-42ed-928b-804e60a13292 None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:21:58.752088 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c032a2f-5f46-42ed-928b-804e60a13292 None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:21:58.752365 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c032a2f-5f46-42ed-928b-804e60a13292 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:21:58.753602 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c032a2f-5f46-42ed-928b-804e60a13292 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:21:58.755174 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c032a2f-5f46-42ed-928b-804e60a13292 None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:21:58.757063 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 163/321] 10.222.0.23 () {56 vars in 1108 bytes} [Tue May 10 05:21:58 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:21:58.762664 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d8bd55-8615-4084-b993-fadc59966efd None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:21:58.855963 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d8bd55-8615-4084-b993-fadc59966efd None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:21:58.889277 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157513ce-345e-4e8a-8580-52697252cab7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:21:58.889962 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157513ce-345e-4e8a-8580-52697252cab7 None admin] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:21:58.890245 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157513ce-345e-4e8a-8580-52697252cab7 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:21:58.890521 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157513ce-345e-4e8a-8580-52697252cab7 None admin] PATH_INFO: `/v3/groups` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:21:58.891233 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157513ce-345e-4e8a-8580-52697252cab7 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:21:58.892737 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157513ce-345e-4e8a-8580-52697252cab7 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:21:58.908162 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 159/322] 10.222.0.23 () {60 vars in 1134 bytes} [Tue May 10 05:21:58 2022] POST /identity/v3/groups => generated 226 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 05:21:58.912898 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2528320c-4337-4ed9-ad44-e0da6c002b3c None None] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:21:58.913266 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2528320c-4337-4ed9-ad44-e0da6c002b3c None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:21:58.913614 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2528320c-4337-4ed9-ad44-e0da6c002b3c None None] PATH_INFO: `/` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:21:58.915322 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 164/323] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 10 05:21:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 05:21:58.921576 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd222e7e-2737-4065-89b6-778b85f22039 None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:21:58.922205 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd222e7e-2737-4065-89b6-778b85f22039 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:21:58.922650 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd222e7e-2737-4065-89b6-778b85f22039 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:21:58.941238 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-fd222e7e-2737-4065-89b6-778b85f22039 None None] MFA Rules not processed for user `44883b22532e44049d846938dc2cf423`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:21:58.942848 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-fd222e7e-2737-4065-89b6-778b85f22039 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:21:59.016773 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 160/324] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 10 05:21:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 05:21:59.037913 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2528320c-4337-4ed9-ad44-e0da6c002b3c None None] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:21:59.140873 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2528320c-4337-4ed9-ad44-e0da6c002b3c None None] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:21:59.180850 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22d7dbe-105a-49a7-a577-18f27cc5d273 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:21:59.181672 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22d7dbe-105a-49a7-a577-18f27cc5d273 None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:21:59.181959 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22d7dbe-105a-49a7-a577-18f27cc5d273 None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:21:59.182235 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22d7dbe-105a-49a7-a577-18f27cc5d273 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:21:59.193182 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22d7dbe-105a-49a7-a577-18f27cc5d273 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 05:21:59.201022 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application [None req-c22d7dbe-105a-49a7-a577-18f27cc5d273 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 10 05:21:59.201022 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 05:21:59.201022 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 05:21:59.201022 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 05:21:59.201022 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 05:21:59.201022 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 05:21:59.201022 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 05:21:59.201022 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 05:21:59.201022 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 05:21:59.201022 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 05:21:59.201022 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 05:21:59.201022 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 05:21:59.201022 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 05:21:59.201022 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 05:21:59.201022 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 05:21:59.201022 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 05:21:59.201950 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 05:21:59.201950 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 05:21:59.201950 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 05:21:59.201950 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 05:21:59.201950 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 05:21:59.201950 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 05:21:59.201950 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 05:21:59.201950 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 05:21:59.201950 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 05:21:59.201950 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.get_or_create( May 10 05:21:59.201950 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 05:21:59.201950 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application with Lock( May 10 05:21:59.201950 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 05:21:59.201950 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self._enter() May 10 05:21:59.201950 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 05:21:59.201950 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 05:21:59.202961 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 05:21:59.202961 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.creator() May 10 05:21:59.202961 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 05:21:59.202961 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application created_value = creator( May 10 05:21:59.202961 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 05:21:59.202961 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 05:21:59.202961 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 05:21:59.202961 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 05:21:59.202961 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 05:21:59.202961 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 05:21:59.202961 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 10 05:21:59.202961 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application May 10 05:21:59.202961 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 165/325] 10.222.0.23 () {56 vars in 1099 bytes} [Tue May 10 05:21:59 2022] GET /identity/v3/roles/reader => generated 84 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 05:21:59.210087 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd222e7e-2737-4065-89b6-778b85f22039 None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:21:59.309952 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd222e7e-2737-4065-89b6-778b85f22039 None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:21:59.334805 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfdd651-6f72-44ee-b7be-bd2d5161b123 None None] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:21:59.335114 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfdd651-6f72-44ee-b7be-bd2d5161b123 None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:21:59.335383 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfdd651-6f72-44ee-b7be-bd2d5161b123 None None] PATH_INFO: `/` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:21:59.338077 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 166/326] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 10 05:21:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 05:21:59.343364 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15e304f-1436-4544-8799-430149a1170b None None] REQUEST_METHOD: `POST` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:21:59.343676 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15e304f-1436-4544-8799-430149a1170b None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:21:59.343961 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15e304f-1436-4544-8799-430149a1170b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:21:59.346637 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721b960a-f683-490b-9142-ce0ffde5f33a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:21:59.347705 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721b960a-f683-490b-9142-ce0ffde5f33a None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:21:59.348188 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721b960a-f683-490b-9142-ce0ffde5f33a None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:21:59.348899 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721b960a-f683-490b-9142-ce0ffde5f33a None admin] PATH_INFO: `/v3/roles` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:21:59.349972 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721b960a-f683-490b-9142-ce0ffde5f33a None admin] RBAC: Adding query filter params (name=reader) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:21:59.350472 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721b960a-f683-490b-9142-ce0ffde5f33a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:21:59.353260 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721b960a-f683-490b-9142-ce0ffde5f33a None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:21:59.364707 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.auth.core [None req-d15e304f-1436-4544-8799-430149a1170b None None] MFA Rules not processed for user `44883b22532e44049d846938dc2cf423`. Rule list: `[]` (Enabled: `True`). {{(pid=79879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:21:59.365901 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-d15e304f-1436-4544-8799-430149a1170b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:21:59.366995 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 161/327] 10.222.0.23 () {56 vars in 1101 bytes} [Tue May 10 05:21:59 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:21:59.373612 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721b960a-f683-490b-9142-ce0ffde5f33a None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:21:59.441456 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 167/328] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 10 05:21:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 05:21:59.476131 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15e304f-1436-4544-8799-430149a1170b None None] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:21:59.501964 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721b960a-f683-490b-9142-ce0ffde5f33a None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:21:59.559506 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08804a73-481a-4de2-90e4-454e4665d79a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:21:59.560550 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08804a73-481a-4de2-90e4-454e4665d79a None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:21:59.560779 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08804a73-481a-4de2-90e4-454e4665d79a None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:21:59.561052 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08804a73-481a-4de2-90e4-454e4665d79a None admin] PATH_INFO: `/v3/users/01503106067349578e5e7b0a4befb0f2` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:21:59.562679 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08804a73-481a-4de2-90e4-454e4665d79a None admin] RBAC: Authorizing `identity:get_user(user_id=01503106067349578e5e7b0a4befb0f2)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:21:59.564158 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08804a73-481a-4de2-90e4-454e4665d79a None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:21:59.565828 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 162/329] 10.222.0.23 () {56 vars in 1177 bytes} [Tue May 10 05:21:59 2022] GET /identity/v3/users/01503106067349578e5e7b0a4befb0f2 => generated 293 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:21:59.572124 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08804a73-481a-4de2-90e4-454e4665d79a None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:21:59.611113 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15e304f-1436-4544-8799-430149a1170b None None] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:21:59.648526 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f2ac7c-a87d-4dcc-ae37-b57f61fc4ff8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:21:59.649348 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f2ac7c-a87d-4dcc-ae37-b57f61fc4ff8 None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:21:59.649633 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f2ac7c-a87d-4dcc-ae37-b57f61fc4ff8 None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:21:59.649911 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f2ac7c-a87d-4dcc-ae37-b57f61fc4ff8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:21:59.662498 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f2ac7c-a87d-4dcc-ae37-b57f61fc4ff8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 05:21:59.670219 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application [None req-39f2ac7c-a87d-4dcc-ae37-b57f61fc4ff8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 10 05:21:59.670219 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 05:21:59.670219 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 05:21:59.670219 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 05:21:59.670219 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 05:21:59.670219 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 05:21:59.670219 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 05:21:59.670219 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 05:21:59.670219 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 05:21:59.670219 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 05:21:59.670219 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 05:21:59.670219 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 05:21:59.670219 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 05:21:59.670219 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 05:21:59.670219 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 05:21:59.670219 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 05:21:59.671116 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 05:21:59.671116 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 05:21:59.671116 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 05:21:59.671116 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 05:21:59.671116 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 05:21:59.671116 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 05:21:59.671116 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 05:21:59.671116 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 05:21:59.671116 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 05:21:59.671116 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.get_or_create( May 10 05:21:59.671116 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 05:21:59.671116 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application with Lock( May 10 05:21:59.671116 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 05:21:59.671116 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self._enter() May 10 05:21:59.671116 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 05:21:59.671116 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 05:21:59.671931 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 05:21:59.671931 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.creator() May 10 05:21:59.671931 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 05:21:59.671931 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application created_value = creator( May 10 05:21:59.671931 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 05:21:59.671931 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 05:21:59.671931 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 05:21:59.671931 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 05:21:59.671931 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 05:21:59.671931 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 05:21:59.671931 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 10 05:21:59.671931 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application May 10 05:21:59.673132 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 168/330] 10.222.0.23 () {56 vars in 1099 bytes} [Tue May 10 05:21:59 2022] GET /identity/v3/roles/member => generated 84 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 05:21:59.675630 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08804a73-481a-4de2-90e4-454e4665d79a None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:21:59.679053 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f2ac7c-a87d-4dcc-ae37-b57f61fc4ff8 None admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:21:59.714719 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6722e9-7fae-4c50-8bc9-571f7e63d9d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:21:59.715667 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6722e9-7fae-4c50-8bc9-571f7e63d9d6 None admin] REQUEST_METHOD: `PUT` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:21:59.715943 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6722e9-7fae-4c50-8bc9-571f7e63d9d6 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:21:59.716212 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6722e9-7fae-4c50-8bc9-571f7e63d9d6 None admin] PATH_INFO: `/v3/system/users/01503106067349578e5e7b0a4befb0f2/roles/8df798e3160347fd84a42d1aedd8ccde` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:21:59.718739 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6722e9-7fae-4c50-8bc9-571f7e63d9d6 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=01503106067349578e5e7b0a4befb0f2, role_id=8df798e3160347fd84a42d1aedd8ccde)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:21:59.720239 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6722e9-7fae-4c50-8bc9-571f7e63d9d6 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:21:59.733005 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 163/331] 10.222.0.23 () {58 vars in 1334 bytes} [Tue May 10 05:21:59 2022] PUT /identity/v3/system/users/01503106067349578e5e7b0a4befb0f2/roles/8df798e3160347fd84a42d1aedd8ccde => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 05:21:59.806221 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f2ac7c-a87d-4dcc-ae37-b57f61fc4ff8 None admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:21:59.849688 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db365972-5178-4b01-a926-4ed2caf77879 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:21:59.850320 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db365972-5178-4b01-a926-4ed2caf77879 None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:21:59.850597 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db365972-5178-4b01-a926-4ed2caf77879 None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:21:59.850868 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db365972-5178-4b01-a926-4ed2caf77879 None admin] PATH_INFO: `/v3/roles` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:21:59.851693 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db365972-5178-4b01-a926-4ed2caf77879 None admin] RBAC: Adding query filter params (name=member) {{(pid=79879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:21:59.851999 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db365972-5178-4b01-a926-4ed2caf77879 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:21:59.853424 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db365972-5178-4b01-a926-4ed2caf77879 None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:21:59.862904 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 169/332] 10.222.0.23 () {56 vars in 1101 bytes} [Tue May 10 05:21:59 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 05:21:59.869061 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6722e9-7fae-4c50-8bc9-571f7e63d9d6 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:21:59.986401 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6722e9-7fae-4c50-8bc9-571f7e63d9d6 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:22:00.030220 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428499e1-4346-463e-a5b7-cc354ecf1f11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:22:00.031119 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428499e1-4346-463e-a5b7-cc354ecf1f11 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:00.031444 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428499e1-4346-463e-a5b7-cc354ecf1f11 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:00.031757 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428499e1-4346-463e-a5b7-cc354ecf1f11 None admin] PATH_INFO: `/v3/users/8dd2fdab422a4c3da2f2faea882c469a` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:00.032971 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428499e1-4346-463e-a5b7-cc354ecf1f11 None admin] RBAC: Authorizing `identity:get_user(user_id=8dd2fdab422a4c3da2f2faea882c469a)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:22:00.034421 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428499e1-4346-463e-a5b7-cc354ecf1f11 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:22:00.036700 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 164/333] 10.222.0.23 () {56 vars in 1177 bytes} [Tue May 10 05:21:59 2022] GET /identity/v3/users/8dd2fdab422a4c3da2f2faea882c469a => generated 293 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:22:00.042402 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db365972-5178-4b01-a926-4ed2caf77879 None admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:22:00.165573 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db365972-5178-4b01-a926-4ed2caf77879 None admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:22:00.203967 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19ac3ce-fde2-420b-9189-bb907d63ba99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:22:00.204637 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19ac3ce-fde2-420b-9189-bb907d63ba99 None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:00.204921 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19ac3ce-fde2-420b-9189-bb907d63ba99 None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:00.205197 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19ac3ce-fde2-420b-9189-bb907d63ba99 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:00.206045 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19ac3ce-fde2-420b-9189-bb907d63ba99 None admin] RBAC: Adding query filter params (role.id=382636e67fc142a2b2f486340d959e11, user.id=8dd2fdab422a4c3da2f2faea882c469a, scope.system=all) {{(pid=79879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:22:00.206358 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19ac3ce-fde2-420b-9189-bb907d63ba99 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:22:00.207903 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19ac3ce-fde2-420b-9189-bb907d63ba99 None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:22:00.223667 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 170/334] 10.222.0.23 () {56 vars in 1308 bytes} [Tue May 10 05:22:00 2022] GET /identity/v3/role_assignments?user.id=8dd2fdab422a4c3da2f2faea882c469a&scope.system=all&role.id=382636e67fc142a2b2f486340d959e11 => generated 510 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:22:02.321741 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c674e5-f783-44d2-bf99-f64f9ffec8a8 None None] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:02.322918 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c674e5-f783-44d2-bf99-f64f9ffec8a8 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:02.323404 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c674e5-f783-44d2-bf99-f64f9ffec8a8 None None] PATH_INFO: `/` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:02.325345 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 165/335] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 10 05:22:02 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 05:22:02.330847 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a385f9-1d09-49c8-8c66-2c7a8385512d None None] REQUEST_METHOD: `POST` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:02.331317 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a385f9-1d09-49c8-8c66-2c7a8385512d None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:02.331400 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a385f9-1d09-49c8-8c66-2c7a8385512d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:02.353667 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.auth.core [None req-04a385f9-1d09-49c8-8c66-2c7a8385512d None None] MFA Rules not processed for user `44883b22532e44049d846938dc2cf423`. Rule list: `[]` (Enabled: `True`). {{(pid=79879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:22:02.355929 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4726222-9822-475d-be95-31e3009110fa None None] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:02.356218 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4726222-9822-475d-be95-31e3009110fa None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:02.356493 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4726222-9822-475d-be95-31e3009110fa None None] PATH_INFO: `/` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:02.358030 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 166/336] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 10 05:22:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 05:22:02.358538 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-04a385f9-1d09-49c8-8c66-2c7a8385512d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:22:02.366064 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268159b9-6889-473f-96cc-e270b73c5eb6 None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:02.366654 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268159b9-6889-473f-96cc-e270b73c5eb6 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:02.367138 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268159b9-6889-473f-96cc-e270b73c5eb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:02.398375 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-268159b9-6889-473f-96cc-e270b73c5eb6 None None] MFA Rules not processed for user `44883b22532e44049d846938dc2cf423`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:22:02.399972 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-268159b9-6889-473f-96cc-e270b73c5eb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:22:02.472432 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 171/337] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 10 05:22:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 05:22:02.500468 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 167/338] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 10 05:22:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 05:22:02.504242 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a385f9-1d09-49c8-8c66-2c7a8385512d None None] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:22:02.536310 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268159b9-6889-473f-96cc-e270b73c5eb6 None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:22:02.682254 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a385f9-1d09-49c8-8c66-2c7a8385512d None None] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:22:02.702232 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268159b9-6889-473f-96cc-e270b73c5eb6 None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:22:02.743779 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c92f83c-1271-44a1-9b23-4d29c825897e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:22:02.744987 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c92f83c-1271-44a1-9b23-4d29c825897e None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:02.745477 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c92f83c-1271-44a1-9b23-4d29c825897e None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:02.746297 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c92f83c-1271-44a1-9b23-4d29c825897e None admin] PATH_INFO: `/v3/roles/member` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:02.762335 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c92f83c-1271-44a1-9b23-4d29c825897e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 05:22:02.762789 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed917c0-087b-4b6a-a094-2db11ab1927f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:22:02.763882 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed917c0-087b-4b6a-a094-2db11ab1927f None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:02.764367 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed917c0-087b-4b6a-a094-2db11ab1927f None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:02.764834 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed917c0-087b-4b6a-a094-2db11ab1927f None admin] PATH_INFO: `/v3/roles/member` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:02.770215 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application [None req-4c92f83c-1271-44a1-9b23-4d29c825897e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 10 05:22:02.770215 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 05:22:02.770215 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 05:22:02.770215 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 05:22:02.770215 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 05:22:02.770215 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 05:22:02.770215 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 05:22:02.770215 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 05:22:02.770215 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 05:22:02.770215 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 05:22:02.770215 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 05:22:02.770215 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 05:22:02.770215 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 05:22:02.770215 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 05:22:02.770215 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 05:22:02.770215 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 05:22:02.771255 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 05:22:02.771255 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 05:22:02.771255 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 05:22:02.771255 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 05:22:02.771255 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 05:22:02.771255 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 05:22:02.771255 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 05:22:02.771255 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 05:22:02.771255 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 05:22:02.771255 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.get_or_create( May 10 05:22:02.771255 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 05:22:02.771255 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application with Lock( May 10 05:22:02.771255 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 05:22:02.771255 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self._enter() May 10 05:22:02.771255 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 05:22:02.771255 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 05:22:02.772112 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 05:22:02.772112 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.creator() May 10 05:22:02.772112 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 05:22:02.772112 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application created_value = creator( May 10 05:22:02.772112 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 05:22:02.772112 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 05:22:02.772112 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 05:22:02.772112 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 05:22:02.772112 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 05:22:02.772112 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 05:22:02.772112 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 10 05:22:02.772112 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application May 10 05:22:02.772740 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 172/339] 10.222.0.23 () {56 vars in 1099 bytes} [Tue May 10 05:22:02 2022] GET /identity/v3/roles/member => generated 84 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 05:22:02.775697 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a1390d-9c0c-43c7-9aa6-814343f81836 None None] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:02.775697 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a1390d-9c0c-43c7-9aa6-814343f81836 None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:02.775697 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a1390d-9c0c-43c7-9aa6-814343f81836 None None] PATH_INFO: `/` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:02.775949 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 173/340] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 10 05:22:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 05:22:02.777097 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154a248e-8af3-4186-8b66-77a64e1adc8a None None] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:02.777373 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154a248e-8af3-4186-8b66-77a64e1adc8a None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:02.777688 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154a248e-8af3-4186-8b66-77a64e1adc8a None None] PATH_INFO: `/` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:02.779047 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 174/341] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 10 05:22:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 05:22:02.786014 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154a248e-8af3-4186-8b66-77a64e1adc8a None None] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:22:02.788466 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed917c0-087b-4b6a-a094-2db11ab1927f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 05:22:02.796828 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application [None req-aed917c0-087b-4b6a-a094-2db11ab1927f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 10 05:22:02.796828 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 05:22:02.796828 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 05:22:02.796828 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 05:22:02.796828 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 05:22:02.796828 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 05:22:02.796828 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 05:22:02.796828 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 05:22:02.796828 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 05:22:02.796828 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 05:22:02.796828 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 05:22:02.796828 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 05:22:02.796828 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 05:22:02.796828 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 05:22:02.796828 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 05:22:02.796828 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 05:22:02.797714 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 05:22:02.797714 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 05:22:02.797714 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 05:22:02.797714 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 05:22:02.797714 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 05:22:02.797714 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 05:22:02.797714 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 05:22:02.797714 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 05:22:02.797714 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 05:22:02.797714 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.get_or_create( May 10 05:22:02.797714 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 05:22:02.797714 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application with Lock( May 10 05:22:02.797714 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 05:22:02.797714 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._enter() May 10 05:22:02.797714 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 05:22:02.797714 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 05:22:02.798507 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 05:22:02.798507 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.creator() May 10 05:22:02.798507 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 05:22:02.798507 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application created_value = creator( May 10 05:22:02.798507 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 05:22:02.798507 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 05:22:02.798507 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 05:22:02.798507 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 05:22:02.798507 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 05:22:02.798507 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 05:22:02.798507 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 10 05:22:02.798507 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application May 10 05:22:02.800605 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 168/342] 10.222.0.23 () {56 vars in 1099 bytes} [Tue May 10 05:22:02 2022] GET /identity/v3/roles/member => generated 84 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 05:22:02.804136 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c703467a-4805-4381-abf8-6f5f9f4f67e3 None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:02.806867 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c703467a-4805-4381-abf8-6f5f9f4f67e3 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:02.806867 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c703467a-4805-4381-abf8-6f5f9f4f67e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:02.823379 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-c703467a-4805-4381-abf8-6f5f9f4f67e3 None None] MFA Rules not processed for user `44883b22532e44049d846938dc2cf423`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:22:02.825395 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-c703467a-4805-4381-abf8-6f5f9f4f67e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:22:02.909336 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 169/343] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 10 05:22:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 05:22:02.910673 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b335fcc-5af9-4346-bc0f-3e43b5c8b0de None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:02.911013 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b335fcc-5af9-4346-bc0f-3e43b5c8b0de None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:02.911294 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b335fcc-5af9-4346-bc0f-3e43b5c8b0de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:02.921474 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154a248e-8af3-4186-8b66-77a64e1adc8a None None] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:22:02.955181 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-0b335fcc-5af9-4346-bc0f-3e43b5c8b0de None None] MFA Rules not processed for user `44883b22532e44049d846938dc2cf423`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:22:02.956164 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5451d045-2aea-4ef6-b203-2587bcd89cb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:22:02.956471 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-0b335fcc-5af9-4346-bc0f-3e43b5c8b0de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:22:02.956841 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5451d045-2aea-4ef6-b203-2587bcd89cb1 None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:02.957116 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5451d045-2aea-4ef6-b203-2587bcd89cb1 None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:02.957387 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5451d045-2aea-4ef6-b203-2587bcd89cb1 None admin] PATH_INFO: `/v3/roles` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:02.958229 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5451d045-2aea-4ef6-b203-2587bcd89cb1 None admin] RBAC: Adding query filter params (name=member) {{(pid=79879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:22:02.958708 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5451d045-2aea-4ef6-b203-2587bcd89cb1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:22:02.960950 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5451d045-2aea-4ef6-b203-2587bcd89cb1 None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:22:02.972652 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 175/344] 10.222.0.23 () {56 vars in 1101 bytes} [Tue May 10 05:22:02 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:22:02.973956 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5451d045-2aea-4ef6-b203-2587bcd89cb1 None admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:22:03.041244 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 170/345] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 10 05:22:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 05:22:03.042140 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b335fcc-5af9-4346-bc0f-3e43b5c8b0de None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:22:03.116426 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5451d045-2aea-4ef6-b203-2587bcd89cb1 None admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:22:03.172291 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6294b4a1-38a6-42d8-8b24-0f87299a51a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:22:03.173241 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6294b4a1-38a6-42d8-8b24-0f87299a51a9 None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:03.173518 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6294b4a1-38a6-42d8-8b24-0f87299a51a9 None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:03.173938 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6294b4a1-38a6-42d8-8b24-0f87299a51a9 None admin] PATH_INFO: `/v3/roles` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:03.174756 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6294b4a1-38a6-42d8-8b24-0f87299a51a9 None admin] RBAC: Adding query filter params (name=member) {{(pid=79879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:22:03.175064 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6294b4a1-38a6-42d8-8b24-0f87299a51a9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:22:03.177200 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6294b4a1-38a6-42d8-8b24-0f87299a51a9 None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:22:03.183921 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b335fcc-5af9-4346-bc0f-3e43b5c8b0de None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:22:03.188122 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 176/346] 10.222.0.23 () {56 vars in 1101 bytes} [Tue May 10 05:22:02 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:22:03.188951 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6294b4a1-38a6-42d8-8b24-0f87299a51a9 None admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:22:03.223586 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9570f0-21fa-4d5a-beb1-6eb1526c78fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:22:03.224429 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9570f0-21fa-4d5a-beb1-6eb1526c78fa None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:03.224719 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9570f0-21fa-4d5a-beb1-6eb1526c78fa None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:03.224996 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9570f0-21fa-4d5a-beb1-6eb1526c78fa None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:03.240068 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9570f0-21fa-4d5a-beb1-6eb1526c78fa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 05:22:03.248486 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application [None req-3a9570f0-21fa-4d5a-beb1-6eb1526c78fa None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 10 05:22:03.248486 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 05:22:03.248486 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 05:22:03.248486 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 05:22:03.248486 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 05:22:03.248486 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 05:22:03.248486 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 05:22:03.248486 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 05:22:03.248486 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 05:22:03.248486 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 05:22:03.248486 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 05:22:03.248486 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 05:22:03.248486 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 05:22:03.248486 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 05:22:03.248486 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 05:22:03.248486 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 05:22:03.249479 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 05:22:03.249479 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 05:22:03.249479 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 05:22:03.249479 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 05:22:03.249479 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 05:22:03.249479 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 05:22:03.249479 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 05:22:03.249479 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 05:22:03.249479 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 05:22:03.249479 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.get_or_create( May 10 05:22:03.249479 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 05:22:03.249479 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application with Lock( May 10 05:22:03.249479 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 05:22:03.249479 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._enter() May 10 05:22:03.249479 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 05:22:03.249479 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 05:22:03.250295 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 05:22:03.250295 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.creator() May 10 05:22:03.250295 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 05:22:03.250295 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application created_value = creator( May 10 05:22:03.250295 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 05:22:03.250295 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 05:22:03.250295 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 05:22:03.250295 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 05:22:03.250295 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 05:22:03.250295 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 05:22:03.250295 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 10 05:22:03.250295 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application May 10 05:22:03.250295 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 171/347] 10.222.0.23 () {56 vars in 1099 bytes} [Tue May 10 05:22:03 2022] GET /identity/v3/roles/reader => generated 84 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 05:22:03.250975 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9570f0-21fa-4d5a-beb1-6eb1526c78fa None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:22:03.308862 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6294b4a1-38a6-42d8-8b24-0f87299a51a9 None admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:22:03.345438 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec18892f-c525-4fe8-ac7e-a20987dcd3ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:22:03.346224 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec18892f-c525-4fe8-ac7e-a20987dcd3ad None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:03.346386 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec18892f-c525-4fe8-ac7e-a20987dcd3ad None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:03.346659 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec18892f-c525-4fe8-ac7e-a20987dcd3ad None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:03.377265 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9570f0-21fa-4d5a-beb1-6eb1526c78fa None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:22:03.419685 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2258a62e-647d-4708-9091-db3d2201e3e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:22:03.420611 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2258a62e-647d-4708-9091-db3d2201e3e2 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:03.420895 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2258a62e-647d-4708-9091-db3d2201e3e2 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:03.421164 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2258a62e-647d-4708-9091-db3d2201e3e2 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:03.423532 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec18892f-c525-4fe8-ac7e-a20987dcd3ad None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:22:03.425162 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec18892f-c525-4fe8-ac7e-a20987dcd3ad None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:22:03.433921 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2258a62e-647d-4708-9091-db3d2201e3e2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 05:22:03.443472 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application [None req-2258a62e-647d-4708-9091-db3d2201e3e2 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 10 05:22:03.443472 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 05:22:03.443472 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 05:22:03.443472 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 05:22:03.443472 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 05:22:03.443472 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 05:22:03.443472 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 05:22:03.443472 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 05:22:03.443472 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 05:22:03.443472 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 05:22:03.443472 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 05:22:03.443472 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 05:22:03.443472 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 05:22:03.443472 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 05:22:03.443472 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 05:22:03.443472 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 05:22:03.445537 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 05:22:03.445537 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 05:22:03.445537 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 05:22:03.445537 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 05:22:03.445537 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 05:22:03.445537 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 05:22:03.445537 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 05:22:03.445537 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 05:22:03.445537 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 05:22:03.445537 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.get_or_create( May 10 05:22:03.445537 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 05:22:03.445537 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application with Lock( May 10 05:22:03.445537 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 05:22:03.445537 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._enter() May 10 05:22:03.445537 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 05:22:03.445537 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 05:22:03.446461 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 05:22:03.446461 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.creator() May 10 05:22:03.446461 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 05:22:03.446461 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application created_value = creator( May 10 05:22:03.446461 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 05:22:03.446461 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 05:22:03.446461 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 05:22:03.446461 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 05:22:03.446461 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 05:22:03.446461 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 05:22:03.446461 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 10 05:22:03.446461 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application May 10 05:22:03.446461 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 172/348] 10.222.0.23 () {56 vars in 1114 bytes} [Tue May 10 05:22:03 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 05:22:03.446461 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2258a62e-647d-4708-9091-db3d2201e3e2 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:22:03.538846 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 177/349] 10.222.0.23 () {58 vars in 1282 bytes} [Tue May 10 05:22:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 05:22:03.539913 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec18892f-c525-4fe8-ac7e-a20987dcd3ad None admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:22:03.561597 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2258a62e-647d-4708-9091-db3d2201e3e2 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:22:03.598997 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c556f3d6-491d-449b-a7f9-89b2a5386807 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:22:03.599955 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c556f3d6-491d-449b-a7f9-89b2a5386807 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:03.599955 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c556f3d6-491d-449b-a7f9-89b2a5386807 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:03.600243 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c556f3d6-491d-449b-a7f9-89b2a5386807 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:03.655493 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec18892f-c525-4fe8-ac7e-a20987dcd3ad None admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:22:03.693849 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c556f3d6-491d-449b-a7f9-89b2a5386807 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:22:03.695838 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c556f3d6-491d-449b-a7f9-89b2a5386807 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:22:03.698162 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8300ca4c-cac0-4450-88ca-ff1eb7b33fcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:22:03.699352 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8300ca4c-cac0-4450-88ca-ff1eb7b33fcd None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:03.699352 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8300ca4c-cac0-4450-88ca-ff1eb7b33fcd None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:03.699553 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8300ca4c-cac0-4450-88ca-ff1eb7b33fcd None admin] PATH_INFO: `/v3/roles` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:03.700681 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8300ca4c-cac0-4450-88ca-ff1eb7b33fcd None admin] RBAC: Adding query filter params (name=reader) {{(pid=79879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:22:03.700681 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8300ca4c-cac0-4450-88ca-ff1eb7b33fcd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:22:03.702864 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8300ca4c-cac0-4450-88ca-ff1eb7b33fcd None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:22:03.716295 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 178/350] 10.222.0.23 () {56 vars in 1101 bytes} [Tue May 10 05:22:03 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:22:03.717198 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8300ca4c-cac0-4450-88ca-ff1eb7b33fcd None admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:22:03.817056 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 173/351] 10.222.0.23 () {58 vars in 1282 bytes} [Tue May 10 05:22:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 05:22:03.818073 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c556f3d6-491d-449b-a7f9-89b2a5386807 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:22:03.848612 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8300ca4c-cac0-4450-88ca-ff1eb7b33fcd None admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:22:03.892323 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5a9ee9-c691-46f0-8c98-b5b4769da9e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:22:03.893182 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5a9ee9-c691-46f0-8c98-b5b4769da9e1 None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:03.893371 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5a9ee9-c691-46f0-8c98-b5b4769da9e1 None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:03.893648 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5a9ee9-c691-46f0-8c98-b5b4769da9e1 None admin] PATH_INFO: `/v3/roles` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:03.894414 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5a9ee9-c691-46f0-8c98-b5b4769da9e1 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:22:03.894721 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5a9ee9-c691-46f0-8c98-b5b4769da9e1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:22:03.896401 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5a9ee9-c691-46f0-8c98-b5b4769da9e1 None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:22:03.904945 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 179/352] 10.222.0.23 () {56 vars in 1111 bytes} [Tue May 10 05:22:03 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:22:03.906394 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8b3144-a4fd-4a4b-9603-893fa6f449a8 None None] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:03.906687 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8b3144-a4fd-4a4b-9603-893fa6f449a8 None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:03.906978 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8b3144-a4fd-4a4b-9603-893fa6f449a8 None None] PATH_INFO: `/` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:03.909448 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 180/353] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 10 05:22:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 05:22:03.909448 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8b3144-a4fd-4a4b-9603-893fa6f449a8 None None] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:22:03.932096 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c556f3d6-491d-449b-a7f9-89b2a5386807 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:22:03.970735 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3d722b-45cb-4f0e-a81c-fdce8bdf2109 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:22:03.971711 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3d722b-45cb-4f0e-a81c-fdce8bdf2109 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:03.972000 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3d722b-45cb-4f0e-a81c-fdce8bdf2109 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:03.972276 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3d722b-45cb-4f0e-a81c-fdce8bdf2109 None admin] PATH_INFO: `/v3/projects/c00aac4e3d244bf5a26814ed404a08f0` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:03.975095 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3d722b-45cb-4f0e-a81c-fdce8bdf2109 None admin] RBAC: Authorizing `identity:get_project(project_id=c00aac4e3d244bf5a26814ed404a08f0)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:22:03.976576 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3d722b-45cb-4f0e-a81c-fdce8bdf2109 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:22:03.978330 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 174/354] 10.222.0.23 () {56 vars in 1186 bytes} [Tue May 10 05:22:03 2022] GET /identity/v3/projects/c00aac4e3d244bf5a26814ed404a08f0 => generated 302 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:22:03.980639 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3d722b-45cb-4f0e-a81c-fdce8bdf2109 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:22:04.021039 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8b3144-a4fd-4a4b-9603-893fa6f449a8 None None] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:22:04.055716 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831e1c03-a541-41c8-bfb3-79f8142e03fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:22:04.056604 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831e1c03-a541-41c8-bfb3-79f8142e03fb None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:04.056881 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831e1c03-a541-41c8-bfb3-79f8142e03fb None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:04.057153 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831e1c03-a541-41c8-bfb3-79f8142e03fb None admin] PATH_INFO: `/v3/users/01503106067349578e5e7b0a4befb0f2` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:04.059142 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831e1c03-a541-41c8-bfb3-79f8142e03fb None admin] RBAC: Authorizing `identity:get_user(user_id=01503106067349578e5e7b0a4befb0f2)` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:22:04.060623 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831e1c03-a541-41c8-bfb3-79f8142e03fb None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:22:04.063780 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 181/355] 10.222.0.23 () {56 vars in 1177 bytes} [Tue May 10 05:22:03 2022] GET /identity/v3/users/01503106067349578e5e7b0a4befb0f2 => generated 293 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:22:04.063780 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfea6378-295a-430b-b4e6-1b66871964c6 None None] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:04.063780 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfea6378-295a-430b-b4e6-1b66871964c6 None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:04.064042 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfea6378-295a-430b-b4e6-1b66871964c6 None None] PATH_INFO: `/` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:04.066463 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 182/356] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 10 05:22:04 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 05:22:04.066463 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfea6378-295a-430b-b4e6-1b66871964c6 None None] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:22:04.094874 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3d722b-45cb-4f0e-a81c-fdce8bdf2109 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:22:04.134007 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5b5de0-937c-4292-92f8-7f8ea9d3e26e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:22:04.134890 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5b5de0-937c-4292-92f8-7f8ea9d3e26e None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:04.135166 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5b5de0-937c-4292-92f8-7f8ea9d3e26e None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:04.135435 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5b5de0-937c-4292-92f8-7f8ea9d3e26e None admin] PATH_INFO: `/v3/projects/294a6d4f4d1f45058a0706d961479db2` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:04.136734 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5b5de0-937c-4292-92f8-7f8ea9d3e26e None admin] RBAC: Authorizing `identity:get_project(project_id=294a6d4f4d1f45058a0706d961479db2)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:22:04.138191 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5b5de0-937c-4292-92f8-7f8ea9d3e26e None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:22:04.140220 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 175/357] 10.222.0.23 () {56 vars in 1186 bytes} [Tue May 10 05:22:03 2022] GET /identity/v3/projects/294a6d4f4d1f45058a0706d961479db2 => generated 298 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:22:04.141426 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6702b330-c36a-4432-b483-d883273596ec None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:04.141426 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6702b330-c36a-4432-b483-d883273596ec None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:04.141696 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6702b330-c36a-4432-b483-d883273596ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:04.163051 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-6702b330-c36a-4432-b483-d883273596ec None None] MFA Rules not processed for user `44883b22532e44049d846938dc2cf423`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:22:04.164279 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-6702b330-c36a-4432-b483-d883273596ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:22:04.180045 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfea6378-295a-430b-b4e6-1b66871964c6 None None] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:22:04.219216 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a667efd4-f0c3-4852-b3c6-4ba6f1ed2ceb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:22:04.219945 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a667efd4-f0c3-4852-b3c6-4ba6f1ed2ceb None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:04.220229 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a667efd4-f0c3-4852-b3c6-4ba6f1ed2ceb None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:04.220506 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a667efd4-f0c3-4852-b3c6-4ba6f1ed2ceb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:04.242481 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 176/358] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 10 05:22:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 05:22:04.243345 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6702b330-c36a-4432-b483-d883273596ec None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:22:04.303533 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a667efd4-f0c3-4852-b3c6-4ba6f1ed2ceb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:22:04.305101 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a667efd4-f0c3-4852-b3c6-4ba6f1ed2ceb None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:22:04.349178 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6702b330-c36a-4432-b483-d883273596ec None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:22:04.383245 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6399f48d-795f-4290-aded-bdbc4d64b706 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:22:04.384833 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6399f48d-795f-4290-aded-bdbc4d64b706 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:04.385116 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6399f48d-795f-4290-aded-bdbc4d64b706 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:04.385396 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6399f48d-795f-4290-aded-bdbc4d64b706 None admin] PATH_INFO: `/v3/groups/b6631029d19d4604addb0ffd47e0d443` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:04.394616 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6399f48d-795f-4290-aded-bdbc4d64b706 None admin] RBAC: Authorizing `identity:get_group(group_id=b6631029d19d4604addb0ffd47e0d443)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:22:04.394616 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6399f48d-795f-4290-aded-bdbc4d64b706 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:22:04.398303 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 177/359] 10.222.0.23 () {56 vars in 1180 bytes} [Tue May 10 05:22:04 2022] GET /identity/v3/groups/b6631029d19d4604addb0ffd47e0d443 => generated 226 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:22:04.398303 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6399f48d-795f-4290-aded-bdbc4d64b706 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:22:04.408308 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 183/360] 10.222.0.23 () {58 vars in 1282 bytes} [Tue May 10 05:22:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 05:22:04.409737 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994fc357-daaa-4494-8099-1f1d4e9719c6 None None] REQUEST_METHOD: `POST` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:04.410026 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994fc357-daaa-4494-8099-1f1d4e9719c6 None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:04.410299 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994fc357-daaa-4494-8099-1f1d4e9719c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:04.426731 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.auth.core [None req-994fc357-daaa-4494-8099-1f1d4e9719c6 None None] MFA Rules not processed for user `44883b22532e44049d846938dc2cf423`. Rule list: `[]` (Enabled: `True`). {{(pid=79879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:22:04.427961 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-994fc357-daaa-4494-8099-1f1d4e9719c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:22:04.504413 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 184/361] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 10 05:22:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 05:22:04.505547 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994fc357-daaa-4494-8099-1f1d4e9719c6 None None] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:22:04.521298 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6399f48d-795f-4290-aded-bdbc4d64b706 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:22:04.565320 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26edce9b-aab5-4067-97c1-c1d1bc4dad95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:22:04.565988 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26edce9b-aab5-4067-97c1-c1d1bc4dad95 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:04.566268 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26edce9b-aab5-4067-97c1-c1d1bc4dad95 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:04.566544 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26edce9b-aab5-4067-97c1-c1d1bc4dad95 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:04.567541 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26edce9b-aab5-4067-97c1-c1d1bc4dad95 None admin] RBAC: Adding query filter params (role.id=8df798e3160347fd84a42d1aedd8ccde, user.id=01503106067349578e5e7b0a4befb0f2, scope.system=all) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:22:04.567882 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26edce9b-aab5-4067-97c1-c1d1bc4dad95 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:22:04.569333 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26edce9b-aab5-4067-97c1-c1d1bc4dad95 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:22:04.581134 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 178/362] 10.222.0.23 () {56 vars in 1308 bytes} [Tue May 10 05:22:04 2022] GET /identity/v3/role_assignments?user.id=01503106067349578e5e7b0a4befb0f2&scope.system=all&role.id=8df798e3160347fd84a42d1aedd8ccde => generated 510 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:22:04.582033 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26edce9b-aab5-4067-97c1-c1d1bc4dad95 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:22:04.616439 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994fc357-daaa-4494-8099-1f1d4e9719c6 None None] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:22:04.661320 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f607a49b-39d8-4771-91a8-3c68a521da70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:22:04.662495 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f607a49b-39d8-4771-91a8-3c68a521da70 None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:04.662778 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f607a49b-39d8-4771-91a8-3c68a521da70 None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:04.663047 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f607a49b-39d8-4771-91a8-3c68a521da70 None admin] PATH_INFO: `/v3/groups/b6631029d19d4604addb0ffd47e0d443` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:04.664570 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f607a49b-39d8-4771-91a8-3c68a521da70 None admin] RBAC: Authorizing `identity:get_group(group_id=b6631029d19d4604addb0ffd47e0d443)` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:22:04.666066 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f607a49b-39d8-4771-91a8-3c68a521da70 None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:22:04.667999 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 185/363] 10.222.0.23 () {56 vars in 1180 bytes} [Tue May 10 05:22:04 2022] GET /identity/v3/groups/b6631029d19d4604addb0ffd47e0d443 => generated 226 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:22:04.671651 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f607a49b-39d8-4771-91a8-3c68a521da70 None admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:22:04.721013 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26edce9b-aab5-4067-97c1-c1d1bc4dad95 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:22:04.768745 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3dd3d9-19d0-41e1-ac41-5bd4037ed5ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:22:04.769584 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3dd3d9-19d0-41e1-ac41-5bd4037ed5ff None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:04.769863 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3dd3d9-19d0-41e1-ac41-5bd4037ed5ff None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:04.770134 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3dd3d9-19d0-41e1-ac41-5bd4037ed5ff None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:04.782800 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3dd3d9-19d0-41e1-ac41-5bd4037ed5ff None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 05:22:04.791449 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application [None req-bc3dd3d9-19d0-41e1-ac41-5bd4037ed5ff None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 10 05:22:04.791449 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 05:22:04.791449 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 05:22:04.791449 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 05:22:04.791449 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 05:22:04.791449 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 05:22:04.791449 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 05:22:04.791449 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 05:22:04.791449 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 05:22:04.791449 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 05:22:04.791449 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 05:22:04.791449 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 05:22:04.791449 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 05:22:04.791449 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 05:22:04.791449 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 05:22:04.791449 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 05:22:04.792389 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 05:22:04.792389 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 05:22:04.792389 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 05:22:04.792389 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 05:22:04.792389 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 05:22:04.792389 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 05:22:04.792389 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 05:22:04.792389 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 05:22:04.792389 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 05:22:04.792389 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.get_or_create( May 10 05:22:04.792389 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 05:22:04.792389 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application with Lock( May 10 05:22:04.792389 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 05:22:04.792389 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._enter() May 10 05:22:04.792389 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 05:22:04.792389 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 05:22:04.793193 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 05:22:04.793193 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.creator() May 10 05:22:04.793193 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 05:22:04.793193 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application created_value = creator( May 10 05:22:04.793193 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 05:22:04.793193 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 05:22:04.793193 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 05:22:04.793193 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 05:22:04.793193 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 05:22:04.793193 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 05:22:04.793193 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 10 05:22:04.793193 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application May 10 05:22:04.793193 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 179/364] 10.222.0.23 () {56 vars in 1114 bytes} [Tue May 10 05:22:04 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 05:22:04.794448 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3dd3d9-19d0-41e1-ac41-5bd4037ed5ff None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:22:04.805328 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f607a49b-39d8-4771-91a8-3c68a521da70 None admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:22:04.852138 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5b0208-343b-4e3a-af85-ff2fd773f131 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:22:04.853042 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5b0208-343b-4e3a-af85-ff2fd773f131 None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:04.853478 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5b0208-343b-4e3a-af85-ff2fd773f131 None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:04.853753 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5b0208-343b-4e3a-af85-ff2fd773f131 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:04.854597 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5b0208-343b-4e3a-af85-ff2fd773f131 None admin] RBAC: Adding query filter params (group.id=b6631029d19d4604addb0ffd47e0d443, role.id=382636e67fc142a2b2f486340d959e11, scope.project.id=c00aac4e3d244bf5a26814ed404a08f0) {{(pid=79879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:22:04.854904 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5b0208-343b-4e3a-af85-ff2fd773f131 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:22:04.856610 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5b0208-343b-4e3a-af85-ff2fd773f131 None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:22:04.861952 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 186/365] 10.222.0.23 () {56 vars in 1376 bytes} [Tue May 10 05:22:04 2022] GET /identity/v3/role_assignments?group.id=b6631029d19d4604addb0ffd47e0d443&scope.project.id=c00aac4e3d244bf5a26814ed404a08f0&role.id=382636e67fc142a2b2f486340d959e11 => generated 260 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:22:04.862747 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5b0208-343b-4e3a-af85-ff2fd773f131 None admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:22:04.920926 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3dd3d9-19d0-41e1-ac41-5bd4037ed5ff None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:22:04.972463 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e10994c-4bfd-468d-a2e2-6e02b55ae7c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:22:04.973414 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e10994c-4bfd-468d-a2e2-6e02b55ae7c0 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:04.973765 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e10994c-4bfd-468d-a2e2-6e02b55ae7c0 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:04.974039 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e10994c-4bfd-468d-a2e2-6e02b55ae7c0 None admin] PATH_INFO: `/v3/projects/294a6d4f4d1f45058a0706d961479db2` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:04.975410 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e10994c-4bfd-468d-a2e2-6e02b55ae7c0 None admin] RBAC: Authorizing `identity:get_project(project_id=294a6d4f4d1f45058a0706d961479db2)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:22:04.977605 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e10994c-4bfd-468d-a2e2-6e02b55ae7c0 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:22:04.979900 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 180/366] 10.222.0.23 () {56 vars in 1186 bytes} [Tue May 10 05:22:04 2022] GET /identity/v3/projects/294a6d4f4d1f45058a0706d961479db2 => generated 298 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:22:04.980370 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e10994c-4bfd-468d-a2e2-6e02b55ae7c0 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:22:05.012960 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5b0208-343b-4e3a-af85-ff2fd773f131 None admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:22:05.067410 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b64933-6d52-45e6-b9cd-c7abfe032b22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:22:05.068266 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b64933-6d52-45e6-b9cd-c7abfe032b22 None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:05.068545 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b64933-6d52-45e6-b9cd-c7abfe032b22 None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:05.068816 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b64933-6d52-45e6-b9cd-c7abfe032b22 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:05.084176 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b64933-6d52-45e6-b9cd-c7abfe032b22 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 05:22:05.092484 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application [None req-a2b64933-6d52-45e6-b9cd-c7abfe032b22 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 10 05:22:05.092484 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 05:22:05.092484 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 05:22:05.092484 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 05:22:05.092484 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 05:22:05.092484 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 05:22:05.092484 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 05:22:05.092484 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 05:22:05.092484 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 05:22:05.092484 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 05:22:05.092484 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 05:22:05.092484 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 05:22:05.092484 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 05:22:05.092484 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 05:22:05.092484 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 05:22:05.092484 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 05:22:05.093376 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 05:22:05.093376 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 05:22:05.093376 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 05:22:05.093376 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 05:22:05.093376 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 05:22:05.093376 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 05:22:05.093376 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 05:22:05.093376 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 05:22:05.093376 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 05:22:05.093376 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.get_or_create( May 10 05:22:05.093376 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 05:22:05.093376 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application with Lock( May 10 05:22:05.093376 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 05:22:05.093376 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self._enter() May 10 05:22:05.093376 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 05:22:05.093376 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 05:22:05.094623 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 05:22:05.094623 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.creator() May 10 05:22:05.094623 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 05:22:05.094623 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application created_value = creator( May 10 05:22:05.094623 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 05:22:05.094623 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 05:22:05.094623 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 05:22:05.094623 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 05:22:05.094623 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 05:22:05.094623 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 05:22:05.094623 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 10 05:22:05.094623 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application May 10 05:22:05.094623 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 187/367] 10.222.0.23 () {56 vars in 1096 bytes} [Tue May 10 05:22:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 05:22:05.094623 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b64933-6d52-45e6-b9cd-c7abfe032b22 None admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:22:05.107585 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e10994c-4bfd-468d-a2e2-6e02b55ae7c0 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:22:05.144016 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ffacb0-2fc3-414f-8a01-4029a08b69a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:22:05.144692 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ffacb0-2fc3-414f-8a01-4029a08b69a8 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:05.144969 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ffacb0-2fc3-414f-8a01-4029a08b69a8 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:05.145336 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ffacb0-2fc3-414f-8a01-4029a08b69a8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:05.146186 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ffacb0-2fc3-414f-8a01-4029a08b69a8 None admin] RBAC: Adding query filter params (group.id=b6631029d19d4604addb0ffd47e0d443, role.id=382636e67fc142a2b2f486340d959e11, scope.project.id=294a6d4f4d1f45058a0706d961479db2) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:22:05.146494 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ffacb0-2fc3-414f-8a01-4029a08b69a8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:22:05.149452 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ffacb0-2fc3-414f-8a01-4029a08b69a8 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:22:05.155388 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 181/368] 10.222.0.23 () {56 vars in 1376 bytes} [Tue May 10 05:22:04 2022] GET /identity/v3/role_assignments?group.id=b6631029d19d4604addb0ffd47e0d443&scope.project.id=294a6d4f4d1f45058a0706d961479db2&role.id=382636e67fc142a2b2f486340d959e11 => generated 260 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:22:05.157740 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ffacb0-2fc3-414f-8a01-4029a08b69a8 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:22:05.228250 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b64933-6d52-45e6-b9cd-c7abfe032b22 None admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:22:05.265979 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd6c75d-b471-4731-bc40-e16f3e4c7ef8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:22:05.266655 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd6c75d-b471-4731-bc40-e16f3e4c7ef8 None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:05.266932 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd6c75d-b471-4731-bc40-e16f3e4c7ef8 None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:05.267199 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd6c75d-b471-4731-bc40-e16f3e4c7ef8 None admin] PATH_INFO: `/v3/roles` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:05.269290 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd6c75d-b471-4731-bc40-e16f3e4c7ef8 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:22:05.269605 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd6c75d-b471-4731-bc40-e16f3e4c7ef8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:22:05.271142 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd6c75d-b471-4731-bc40-e16f3e4c7ef8 None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:22:05.280519 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 188/369] 10.222.0.23 () {56 vars in 1111 bytes} [Tue May 10 05:22:05 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:22:05.281456 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd6c75d-b471-4731-bc40-e16f3e4c7ef8 None admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:22:05.283496 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ffacb0-2fc3-414f-8a01-4029a08b69a8 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:22:05.337384 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffccd909-970d-4228-8c5a-6805326efd16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:22:05.338617 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffccd909-970d-4228-8c5a-6805326efd16 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:05.338617 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffccd909-970d-4228-8c5a-6805326efd16 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:05.338803 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffccd909-970d-4228-8c5a-6805326efd16 None admin] PATH_INFO: `/v3/groups/b6631029d19d4604addb0ffd47e0d443` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:05.340762 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffccd909-970d-4228-8c5a-6805326efd16 None admin] RBAC: Authorizing `identity:get_group(group_id=b6631029d19d4604addb0ffd47e0d443)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:22:05.342234 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffccd909-970d-4228-8c5a-6805326efd16 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:22:05.344459 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 182/370] 10.222.0.23 () {56 vars in 1180 bytes} [Tue May 10 05:22:05 2022] GET /identity/v3/groups/b6631029d19d4604addb0ffd47e0d443 => generated 226 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:22:05.345307 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffccd909-970d-4228-8c5a-6805326efd16 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:22:05.405081 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd6c75d-b471-4731-bc40-e16f3e4c7ef8 None admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:22:05.441656 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311ae4d8-4273-421f-b0c3-f6b149549fc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:22:05.443337 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311ae4d8-4273-421f-b0c3-f6b149549fc8 None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:05.443820 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311ae4d8-4273-421f-b0c3-f6b149549fc8 None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:05.444267 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311ae4d8-4273-421f-b0c3-f6b149549fc8 None admin] PATH_INFO: `/v3/roles` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:05.445217 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311ae4d8-4273-421f-b0c3-f6b149549fc8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:22:05.445694 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311ae4d8-4273-421f-b0c3-f6b149549fc8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:22:05.447272 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311ae4d8-4273-421f-b0c3-f6b149549fc8 None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:22:05.455991 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffccd909-970d-4228-8c5a-6805326efd16 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:22:05.457564 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 189/371] 10.222.0.23 () {56 vars in 1099 bytes} [Tue May 10 05:22:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:22:05.458631 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311ae4d8-4273-421f-b0c3-f6b149549fc8 None admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:22:05.502187 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47c2ce6-9bc6-4d59-bb3b-622f7ee95630 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:22:05.502869 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47c2ce6-9bc6-4d59-bb3b-622f7ee95630 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:05.503508 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47c2ce6-9bc6-4d59-bb3b-622f7ee95630 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:05.503889 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47c2ce6-9bc6-4d59-bb3b-622f7ee95630 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:05.572807 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311ae4d8-4273-421f-b0c3-f6b149549fc8 None admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:22:05.593960 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47c2ce6-9bc6-4d59-bb3b-622f7ee95630 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:22:05.596509 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47c2ce6-9bc6-4d59-bb3b-622f7ee95630 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:22:05.605552 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbca5a2a-b728-4c9e-8e96-cdc79db71a9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:22:05.606221 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbca5a2a-b728-4c9e-8e96-cdc79db71a9a None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:05.606499 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbca5a2a-b728-4c9e-8e96-cdc79db71a9a None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:05.606769 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbca5a2a-b728-4c9e-8e96-cdc79db71a9a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:05.607624 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbca5a2a-b728-4c9e-8e96-cdc79db71a9a None admin] RBAC: Adding query filter params (group.id=b6631029d19d4604addb0ffd47e0d443, role.id=b0cb991ebc2d42d5a5de343c57086616, scope.project.id=294a6d4f4d1f45058a0706d961479db2) {{(pid=79879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:22:05.607937 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbca5a2a-b728-4c9e-8e96-cdc79db71a9a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:22:05.609451 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbca5a2a-b728-4c9e-8e96-cdc79db71a9a None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:22:05.615626 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 190/372] 10.222.0.23 () {56 vars in 1376 bytes} [Tue May 10 05:22:05 2022] GET /identity/v3/role_assignments?group.id=b6631029d19d4604addb0ffd47e0d443&scope.project.id=294a6d4f4d1f45058a0706d961479db2&role.id=b0cb991ebc2d42d5a5de343c57086616 => generated 260 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:22:05.616538 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbca5a2a-b728-4c9e-8e96-cdc79db71a9a None admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:22:05.715630 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 183/373] 10.222.0.23 () {58 vars in 1282 bytes} [Tue May 10 05:22:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 05:22:05.718721 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47c2ce6-9bc6-4d59-bb3b-622f7ee95630 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:22:05.772287 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbca5a2a-b728-4c9e-8e96-cdc79db71a9a None admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:22:05.845590 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9845a74d-675b-4e45-a912-f2c62c2aea73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:22:05.846620 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9845a74d-675b-4e45-a912-f2c62c2aea73 None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:05.847073 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9845a74d-675b-4e45-a912-f2c62c2aea73 None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:05.847523 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9845a74d-675b-4e45-a912-f2c62c2aea73 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:05.929708 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47c2ce6-9bc6-4d59-bb3b-622f7ee95630 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:22:05.937592 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9845a74d-675b-4e45-a912-f2c62c2aea73 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:22:05.939075 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9845a74d-675b-4e45-a912-f2c62c2aea73 None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:22:06.013150 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad49a52-2105-46e1-b8ea-ce8e882c004b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:22:06.014337 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad49a52-2105-46e1-b8ea-ce8e882c004b None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:06.014822 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad49a52-2105-46e1-b8ea-ce8e882c004b None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:06.015259 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad49a52-2105-46e1-b8ea-ce8e882c004b None admin] PATH_INFO: `/v3/projects/c00aac4e3d244bf5a26814ed404a08f0` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:06.020368 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad49a52-2105-46e1-b8ea-ce8e882c004b None admin] RBAC: Authorizing `identity:get_project(project_id=c00aac4e3d244bf5a26814ed404a08f0)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:22:06.022022 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad49a52-2105-46e1-b8ea-ce8e882c004b None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:22:06.024349 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 184/374] 10.222.0.23 () {56 vars in 1186 bytes} [Tue May 10 05:22:05 2022] GET /identity/v3/projects/c00aac4e3d244bf5a26814ed404a08f0 => generated 302 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 05:22:06.029280 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad49a52-2105-46e1-b8ea-ce8e882c004b None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:22:06.042565 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 191/375] 10.222.0.23 () {58 vars in 1282 bytes} [Tue May 10 05:22:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 05:22:06.052242 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9845a74d-675b-4e45-a912-f2c62c2aea73 None admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:22:06.178241 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9845a74d-675b-4e45-a912-f2c62c2aea73 None admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:22:06.220867 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8c514c-4ea0-47f7-842e-7c4cb851df0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:22:06.221749 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8c514c-4ea0-47f7-842e-7c4cb851df0e None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:06.222029 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8c514c-4ea0-47f7-842e-7c4cb851df0e None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:06.222303 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8c514c-4ea0-47f7-842e-7c4cb851df0e None admin] PATH_INFO: `/v3/projects/3a8435696f504d709a504bf384af26ea` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:06.225271 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8c514c-4ea0-47f7-842e-7c4cb851df0e None admin] RBAC: Authorizing `identity:get_project(project_id=3a8435696f504d709a504bf384af26ea)` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:22:06.226731 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8c514c-4ea0-47f7-842e-7c4cb851df0e None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:22:06.228474 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 192/376] 10.222.0.23 () {56 vars in 1186 bytes} [Tue May 10 05:22:06 2022] GET /identity/v3/projects/3a8435696f504d709a504bf384af26ea => generated 344 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 05:22:06.236600 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8c514c-4ea0-47f7-842e-7c4cb851df0e None admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:22:06.253167 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad49a52-2105-46e1-b8ea-ce8e882c004b None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:22:06.292337 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e59a73-b151-4ab3-a93c-062309c4b5cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:22:06.293229 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e59a73-b151-4ab3-a93c-062309c4b5cc None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:06.293506 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e59a73-b151-4ab3-a93c-062309c4b5cc None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:06.293779 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e59a73-b151-4ab3-a93c-062309c4b5cc None admin] PATH_INFO: `/v3/groups/b6631029d19d4604addb0ffd47e0d443` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:06.300316 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e59a73-b151-4ab3-a93c-062309c4b5cc None admin] RBAC: Authorizing `identity:get_group(group_id=b6631029d19d4604addb0ffd47e0d443)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:22:06.301831 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e59a73-b151-4ab3-a93c-062309c4b5cc None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:22:06.303544 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 185/377] 10.222.0.23 () {56 vars in 1180 bytes} [Tue May 10 05:22:06 2022] GET /identity/v3/groups/b6631029d19d4604addb0ffd47e0d443 => generated 226 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 05:22:06.309224 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e59a73-b151-4ab3-a93c-062309c4b5cc None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:22:06.372607 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8c514c-4ea0-47f7-842e-7c4cb851df0e None admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:22:06.414946 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cecfa1-8611-4226-8c94-86014eb13779 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:22:06.415864 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cecfa1-8611-4226-8c94-86014eb13779 None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:06.416144 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cecfa1-8611-4226-8c94-86014eb13779 None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:06.416414 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cecfa1-8611-4226-8c94-86014eb13779 None admin] PATH_INFO: `/v3/groups/90faba46b0184513afa12ee7eee83e6f` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:06.422684 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61cecfa1-8611-4226-8c94-86014eb13779 None admin] RBAC: Authorizing `identity:get_group(group_id=90faba46b0184513afa12ee7eee83e6f)` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:22:06.424193 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61cecfa1-8611-4226-8c94-86014eb13779 None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:22:06.426183 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 193/378] 10.222.0.23 () {56 vars in 1180 bytes} [Tue May 10 05:22:06 2022] GET /identity/v3/groups/90faba46b0184513afa12ee7eee83e6f => generated 229 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:22:06.436611 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cecfa1-8611-4226-8c94-86014eb13779 None admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:22:06.457216 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e59a73-b151-4ab3-a93c-062309c4b5cc None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:22:06.502221 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19efa81-d9c9-473f-a2a6-44194a958358 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:22:06.502899 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19efa81-d9c9-473f-a2a6-44194a958358 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:06.503181 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19efa81-d9c9-473f-a2a6-44194a958358 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:06.503457 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19efa81-d9c9-473f-a2a6-44194a958358 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:06.504330 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19efa81-d9c9-473f-a2a6-44194a958358 None admin] RBAC: Adding query filter params (group.id=b6631029d19d4604addb0ffd47e0d443, role.id=b0cb991ebc2d42d5a5de343c57086616, scope.project.id=c00aac4e3d244bf5a26814ed404a08f0) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:22:06.504688 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19efa81-d9c9-473f-a2a6-44194a958358 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:22:06.506141 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19efa81-d9c9-473f-a2a6-44194a958358 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:22:06.519298 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 186/379] 10.222.0.23 () {56 vars in 1376 bytes} [Tue May 10 05:22:06 2022] GET /identity/v3/role_assignments?group.id=b6631029d19d4604addb0ffd47e0d443&scope.project.id=c00aac4e3d244bf5a26814ed404a08f0&role.id=b0cb991ebc2d42d5a5de343c57086616 => generated 260 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 05:22:06.569756 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cecfa1-8611-4226-8c94-86014eb13779 None admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:22:06.603728 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ea1775-ee46-49de-acf7-78a624ad721d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:22:06.604419 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ea1775-ee46-49de-acf7-78a624ad721d None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:06.604753 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ea1775-ee46-49de-acf7-78a624ad721d None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:06.605035 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ea1775-ee46-49de-acf7-78a624ad721d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:06.605883 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ea1775-ee46-49de-acf7-78a624ad721d None admin] RBAC: Adding query filter params (group.id=90faba46b0184513afa12ee7eee83e6f, role.id=199ac1dd842441d7913c6ee89d8fbecc, scope.project.id=3a8435696f504d709a504bf384af26ea) {{(pid=79879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:22:06.606196 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ea1775-ee46-49de-acf7-78a624ad721d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:22:06.607690 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ea1775-ee46-49de-acf7-78a624ad721d None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:22:06.614328 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 194/380] 10.222.0.23 () {56 vars in 1376 bytes} [Tue May 10 05:22:06 2022] GET /identity/v3/role_assignments?group.id=90faba46b0184513afa12ee7eee83e6f&scope.project.id=3a8435696f504d709a504bf384af26ea&role.id=199ac1dd842441d7913c6ee89d8fbecc => generated 260 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:22:07.598909 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef80e519-19ec-42d3-b5d9-b4bbcabeef30 None None] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:07.599458 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef80e519-19ec-42d3-b5d9-b4bbcabeef30 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:07.599458 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef80e519-19ec-42d3-b5d9-b4bbcabeef30 None None] PATH_INFO: `/` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:07.601077 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 187/381] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 10 05:22:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 05:22:07.606130 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b647d5-815e-489f-bc73-0281bbb87295 None None] REQUEST_METHOD: `POST` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:07.606920 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b647d5-815e-489f-bc73-0281bbb87295 None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:07.607394 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b647d5-815e-489f-bc73-0281bbb87295 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:07.627789 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.auth.core [None req-97b647d5-815e-489f-bc73-0281bbb87295 None None] MFA Rules not processed for user `44883b22532e44049d846938dc2cf423`. Rule list: `[]` (Enabled: `True`). {{(pid=79879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:22:07.629283 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-97b647d5-815e-489f-bc73-0281bbb87295 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:22:07.692938 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8768c314-4100-4766-b4e8-3fb71c355483 None None] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:07.693250 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8768c314-4100-4766-b4e8-3fb71c355483 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:07.693499 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8768c314-4100-4766-b4e8-3fb71c355483 None None] PATH_INFO: `/` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:07.694894 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 188/382] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 10 05:22:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 05:22:07.700726 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c79a00-f743-40f6-ae93-e366ae9321f1 None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:07.701010 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c79a00-f743-40f6-ae93-e366ae9321f1 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:07.701286 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c79a00-f743-40f6-ae93-e366ae9321f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:07.718766 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 195/383] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 10 05:22:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 05:22:07.736737 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-09c79a00-f743-40f6-ae93-e366ae9321f1 None None] MFA Rules not processed for user `44883b22532e44049d846938dc2cf423`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:22:07.737880 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-09c79a00-f743-40f6-ae93-e366ae9321f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:22:07.774753 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b647d5-815e-489f-bc73-0281bbb87295 None None] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:22:07.837940 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 189/384] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 10 05:22:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 05:22:07.880629 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c79a00-f743-40f6-ae93-e366ae9321f1 None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:22:07.916676 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b647d5-815e-489f-bc73-0281bbb87295 None None] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:22:07.949966 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73093a5-7e34-4e51-86c2-8a629deb321b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:22:07.950781 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73093a5-7e34-4e51-86c2-8a629deb321b None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:07.951060 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73093a5-7e34-4e51-86c2-8a629deb321b None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:07.951338 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73093a5-7e34-4e51-86c2-8a629deb321b None admin] PATH_INFO: `/v3/roles/member` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:07.961637 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73093a5-7e34-4e51-86c2-8a629deb321b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 05:22:07.969306 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application [None req-b73093a5-7e34-4e51-86c2-8a629deb321b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 10 05:22:07.969306 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 05:22:07.969306 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 05:22:07.969306 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 05:22:07.969306 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 05:22:07.969306 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 05:22:07.969306 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 05:22:07.969306 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 05:22:07.969306 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 05:22:07.969306 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 05:22:07.969306 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 05:22:07.969306 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 05:22:07.969306 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 05:22:07.969306 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 05:22:07.969306 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 05:22:07.969306 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 05:22:07.970209 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 05:22:07.970209 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 05:22:07.970209 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 05:22:07.970209 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 05:22:07.970209 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 05:22:07.970209 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 05:22:07.970209 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 05:22:07.970209 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 05:22:07.970209 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 05:22:07.970209 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.get_or_create( May 10 05:22:07.970209 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 05:22:07.970209 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application with Lock( May 10 05:22:07.970209 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 05:22:07.970209 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self._enter() May 10 05:22:07.970209 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 05:22:07.970209 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 05:22:07.971460 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 05:22:07.971460 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.creator() May 10 05:22:07.971460 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 05:22:07.971460 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application created_value = creator( May 10 05:22:07.971460 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 05:22:07.971460 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 05:22:07.971460 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 05:22:07.971460 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 05:22:07.971460 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 05:22:07.971460 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 05:22:07.971460 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 10 05:22:07.971460 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application May 10 05:22:07.971460 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 196/385] 10.222.0.23 () {56 vars in 1099 bytes} [Tue May 10 05:22:07 2022] GET /identity/v3/roles/member => generated 84 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 05:22:07.976508 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73093a5-7e34-4e51-86c2-8a629deb321b None admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:22:08.089716 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c79a00-f743-40f6-ae93-e366ae9321f1 None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:22:08.107615 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73093a5-7e34-4e51-86c2-8a629deb321b None admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:22:08.143458 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea97943d-3461-48ce-a8f7-a5e088985ae9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:22:08.144166 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea97943d-3461-48ce-a8f7-a5e088985ae9 None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:08.144449 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea97943d-3461-48ce-a8f7-a5e088985ae9 None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:08.144721 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea97943d-3461-48ce-a8f7-a5e088985ae9 None admin] PATH_INFO: `/v3/roles` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:08.145538 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea97943d-3461-48ce-a8f7-a5e088985ae9 None admin] RBAC: Adding query filter params (name=member) {{(pid=79879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:22:08.145844 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea97943d-3461-48ce-a8f7-a5e088985ae9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:22:08.147248 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea97943d-3461-48ce-a8f7-a5e088985ae9 None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:22:08.162438 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 197/386] 10.222.0.23 () {56 vars in 1101 bytes} [Tue May 10 05:22:07 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 05:22:08.163090 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95d377d-426f-47d4-821d-d8894d7e392f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:22:08.167608 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95d377d-426f-47d4-821d-d8894d7e392f None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:08.167920 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95d377d-426f-47d4-821d-d8894d7e392f None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:08.168251 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95d377d-426f-47d4-821d-d8894d7e392f None admin] PATH_INFO: `/v3/roles/member` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:08.169105 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea97943d-3461-48ce-a8f7-a5e088985ae9 None admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:22:08.192518 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95d377d-426f-47d4-821d-d8894d7e392f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 05:22:08.205889 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application [None req-c95d377d-426f-47d4-821d-d8894d7e392f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 10 05:22:08.205889 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 05:22:08.205889 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 05:22:08.205889 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 05:22:08.205889 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 05:22:08.205889 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 05:22:08.205889 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 05:22:08.205889 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 05:22:08.205889 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 05:22:08.205889 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 05:22:08.205889 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 05:22:08.205889 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 05:22:08.205889 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 05:22:08.205889 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 05:22:08.205889 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 05:22:08.205889 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 05:22:08.206784 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 05:22:08.206784 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 05:22:08.206784 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 05:22:08.206784 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 05:22:08.206784 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 05:22:08.206784 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 05:22:08.206784 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 05:22:08.206784 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 05:22:08.206784 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 05:22:08.206784 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.get_or_create( May 10 05:22:08.206784 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 05:22:08.206784 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application with Lock( May 10 05:22:08.206784 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 05:22:08.206784 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._enter() May 10 05:22:08.206784 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 05:22:08.206784 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 05:22:08.208370 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 05:22:08.208370 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.creator() May 10 05:22:08.208370 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 05:22:08.208370 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application created_value = creator( May 10 05:22:08.208370 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 05:22:08.208370 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 05:22:08.208370 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 05:22:08.208370 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 05:22:08.208370 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 05:22:08.208370 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 05:22:08.208370 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 10 05:22:08.208370 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application May 10 05:22:08.208370 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 190/387] 10.222.0.23 () {56 vars in 1099 bytes} [Tue May 10 05:22:07 2022] GET /identity/v3/roles/member => generated 84 bytes in 327 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 05:22:08.213201 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95d377d-426f-47d4-821d-d8894d7e392f None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:22:08.271200 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea97943d-3461-48ce-a8f7-a5e088985ae9 None admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:22:08.304469 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f29f72-6191-49ae-a888-162e2920471e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:22:08.305346 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f29f72-6191-49ae-a888-162e2920471e None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:08.305626 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f29f72-6191-49ae-a888-162e2920471e None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:08.305899 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f29f72-6191-49ae-a888-162e2920471e None admin] PATH_INFO: `/v3/groups/b6631029d19d4604addb0ffd47e0d443` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:08.307106 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f29f72-6191-49ae-a888-162e2920471e None admin] RBAC: Authorizing `identity:get_group(group_id=b6631029d19d4604addb0ffd47e0d443)` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:22:08.308595 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f29f72-6191-49ae-a888-162e2920471e None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:22:08.310561 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 198/388] 10.222.0.23 () {56 vars in 1180 bytes} [Tue May 10 05:22:08 2022] GET /identity/v3/groups/b6631029d19d4604addb0ffd47e0d443 => generated 226 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:22:08.315935 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f29f72-6191-49ae-a888-162e2920471e None admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:22:08.413127 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f29f72-6191-49ae-a888-162e2920471e None admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:22:08.413509 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95d377d-426f-47d4-821d-d8894d7e392f None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:22:08.447384 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6ec9c8-eb7a-4907-9504-34154440cd14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:22:08.448867 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6ec9c8-eb7a-4907-9504-34154440cd14 None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:08.449135 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6ec9c8-eb7a-4907-9504-34154440cd14 None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:08.449410 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6ec9c8-eb7a-4907-9504-34154440cd14 None admin] PATH_INFO: `/v3/projects/c00aac4e3d244bf5a26814ed404a08f0` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:08.451043 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6ec9c8-eb7a-4907-9504-34154440cd14 None admin] RBAC: Authorizing `identity:get_project(project_id=c00aac4e3d244bf5a26814ed404a08f0)` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:22:08.452811 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6ec9c8-eb7a-4907-9504-34154440cd14 None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:22:08.454809 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 199/389] 10.222.0.23 () {56 vars in 1186 bytes} [Tue May 10 05:22:08 2022] GET /identity/v3/projects/c00aac4e3d244bf5a26814ed404a08f0 => generated 302 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 05:22:08.455253 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b0ef2e-ee1e-43f4-b633-ce52652516ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:22:08.456023 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d301188-c5f7-4350-8afb-de8fc3e09321 None None] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:08.456181 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b0ef2e-ee1e-43f4-b633-ce52652516ab None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:08.456314 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d301188-c5f7-4350-8afb-de8fc3e09321 None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:08.456457 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b0ef2e-ee1e-43f4-b633-ce52652516ab None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:08.456584 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d301188-c5f7-4350-8afb-de8fc3e09321 None None] PATH_INFO: `/` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:08.456846 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b0ef2e-ee1e-43f4-b633-ce52652516ab None admin] PATH_INFO: `/v3/roles` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:08.457726 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b0ef2e-ee1e-43f4-b633-ce52652516ab None admin] RBAC: Adding query filter params (name=member) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:22:08.457872 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 200/390] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 10 05:22:08 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 05:22:08.458147 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b0ef2e-ee1e-43f4-b633-ce52652516ab None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:22:08.459590 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b0ef2e-ee1e-43f4-b633-ce52652516ab None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:22:08.465543 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d301188-c5f7-4350-8afb-de8fc3e09321 None None] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:22:08.471916 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 191/391] 10.222.0.23 () {56 vars in 1101 bytes} [Tue May 10 05:22:08 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 05:22:08.477909 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d915d09-5e63-4cd5-8dc4-8931984bd261 None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:08.478514 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d915d09-5e63-4cd5-8dc4-8931984bd261 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:08.478992 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d915d09-5e63-4cd5-8dc4-8931984bd261 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:08.495278 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-6d915d09-5e63-4cd5-8dc4-8931984bd261 None None] MFA Rules not processed for user `44883b22532e44049d846938dc2cf423`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:22:08.497188 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-6d915d09-5e63-4cd5-8dc4-8931984bd261 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:22:08.569441 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 192/392] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 10 05:22:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 05:22:08.570314 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d915d09-5e63-4cd5-8dc4-8931984bd261 None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:22:08.582656 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d301188-c5f7-4350-8afb-de8fc3e09321 None None] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:22:08.623173 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12af7b6-6cb2-4524-a132-24a17aa7d6dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:22:08.624908 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12af7b6-6cb2-4524-a132-24a17aa7d6dc None admin] REQUEST_METHOD: `PUT` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:08.625404 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12af7b6-6cb2-4524-a132-24a17aa7d6dc None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:08.625891 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12af7b6-6cb2-4524-a132-24a17aa7d6dc None admin] PATH_INFO: `/v3/projects/c00aac4e3d244bf5a26814ed404a08f0/groups/b6631029d19d4604addb0ffd47e0d443/roles/382636e67fc142a2b2f486340d959e11` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:08.628136 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12af7b6-6cb2-4524-a132-24a17aa7d6dc None admin] RBAC: Authorizing `identity:create_grant(project_id=c00aac4e3d244bf5a26814ed404a08f0, group_id=b6631029d19d4604addb0ffd47e0d443, role_id=382636e67fc142a2b2f486340d959e11)` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:22:08.629888 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12af7b6-6cb2-4524-a132-24a17aa7d6dc None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:22:08.646294 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 201/393] 10.222.0.23 () {58 vars in 1442 bytes} [Tue May 10 05:22:08 2022] PUT /identity/v3/projects/c00aac4e3d244bf5a26814ed404a08f0/groups/b6631029d19d4604addb0ffd47e0d443/roles/382636e67fc142a2b2f486340d959e11 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 05:22:08.647420 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12af7b6-6cb2-4524-a132-24a17aa7d6dc None admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:22:08.703387 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d915d09-5e63-4cd5-8dc4-8931984bd261 None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:22:08.753864 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12af7b6-6cb2-4524-a132-24a17aa7d6dc None admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:22:08.761767 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0626253c-ef73-42a1-82d6-e065d969744d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:22:08.762702 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0626253c-ef73-42a1-82d6-e065d969744d None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:08.763037 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0626253c-ef73-42a1-82d6-e065d969744d None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:08.763312 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0626253c-ef73-42a1-82d6-e065d969744d None admin] PATH_INFO: `/v3/groups/b6631029d19d4604addb0ffd47e0d443` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:08.766251 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0626253c-ef73-42a1-82d6-e065d969744d None admin] RBAC: Authorizing `identity:get_group(group_id=b6631029d19d4604addb0ffd47e0d443)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:22:08.767753 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0626253c-ef73-42a1-82d6-e065d969744d None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:22:08.769907 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 193/394] 10.222.0.23 () {56 vars in 1180 bytes} [Tue May 10 05:22:08 2022] GET /identity/v3/groups/b6631029d19d4604addb0ffd47e0d443 => generated 226 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:22:08.776506 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0626253c-ef73-42a1-82d6-e065d969744d None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:22:08.795354 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e867282-fd50-4a56-b25d-c30f81db7c0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:22:08.796590 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e867282-fd50-4a56-b25d-c30f81db7c0b None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:08.797066 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e867282-fd50-4a56-b25d-c30f81db7c0b None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:08.797549 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e867282-fd50-4a56-b25d-c30f81db7c0b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:08.815057 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e867282-fd50-4a56-b25d-c30f81db7c0b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 05:22:08.830974 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application [None req-9e867282-fd50-4a56-b25d-c30f81db7c0b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 10 05:22:08.830974 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 05:22:08.830974 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 05:22:08.830974 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 05:22:08.830974 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 05:22:08.830974 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 05:22:08.830974 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 05:22:08.830974 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 05:22:08.830974 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 05:22:08.830974 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 05:22:08.830974 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 05:22:08.830974 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 05:22:08.830974 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 05:22:08.830974 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 05:22:08.830974 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 05:22:08.830974 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 05:22:08.832026 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 05:22:08.832026 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 05:22:08.832026 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 05:22:08.832026 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 05:22:08.832026 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 05:22:08.832026 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 05:22:08.832026 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 05:22:08.832026 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 05:22:08.832026 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 05:22:08.832026 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.get_or_create( May 10 05:22:08.832026 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 05:22:08.832026 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application with Lock( May 10 05:22:08.832026 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 05:22:08.832026 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self._enter() May 10 05:22:08.832026 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 05:22:08.832026 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 05:22:08.833031 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 05:22:08.833031 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.creator() May 10 05:22:08.833031 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 05:22:08.833031 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application created_value = creator( May 10 05:22:08.833031 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 05:22:08.833031 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 05:22:08.833031 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 05:22:08.833031 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 05:22:08.833031 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 05:22:08.833031 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 05:22:08.833031 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 10 05:22:08.833031 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application May 10 05:22:08.837447 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 202/395] 10.222.0.23 () {56 vars in 1114 bytes} [Tue May 10 05:22:08 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 05:22:08.843526 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e867282-fd50-4a56-b25d-c30f81db7c0b None admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:22:08.999714 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0626253c-ef73-42a1-82d6-e065d969744d None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:22:09.011339 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e867282-fd50-4a56-b25d-c30f81db7c0b None admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:22:09.046745 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caee1e9e-069a-4abe-966d-def913a88dc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:22:09.047674 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caee1e9e-069a-4abe-966d-def913a88dc2 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:09.047964 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caee1e9e-069a-4abe-966d-def913a88dc2 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:09.048237 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caee1e9e-069a-4abe-966d-def913a88dc2 None admin] PATH_INFO: `/v3/projects/294a6d4f4d1f45058a0706d961479db2` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:09.050473 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caee1e9e-069a-4abe-966d-def913a88dc2 None admin] RBAC: Authorizing `identity:get_project(project_id=294a6d4f4d1f45058a0706d961479db2)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:22:09.050721 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a435a760-0e0f-49bd-89bd-9437b206aaf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:22:09.051496 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a435a760-0e0f-49bd-89bd-9437b206aaf7 None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:09.051804 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a435a760-0e0f-49bd-89bd-9437b206aaf7 None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:09.052052 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caee1e9e-069a-4abe-966d-def913a88dc2 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:22:09.052170 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a435a760-0e0f-49bd-89bd-9437b206aaf7 None admin] PATH_INFO: `/v3/roles` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:09.052841 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a435a760-0e0f-49bd-89bd-9437b206aaf7 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:22:09.053154 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a435a760-0e0f-49bd-89bd-9437b206aaf7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:22:09.053781 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 194/396] 10.222.0.23 () {56 vars in 1186 bytes} [Tue May 10 05:22:08 2022] GET /identity/v3/projects/294a6d4f4d1f45058a0706d961479db2 => generated 298 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:22:09.054675 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a435a760-0e0f-49bd-89bd-9437b206aaf7 None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:22:09.065113 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caee1e9e-069a-4abe-966d-def913a88dc2 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:22:09.072198 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 203/397] 10.222.0.23 () {56 vars in 1111 bytes} [Tue May 10 05:22:08 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:22:09.074541 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a435a760-0e0f-49bd-89bd-9437b206aaf7 None admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:22:09.208241 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a435a760-0e0f-49bd-89bd-9437b206aaf7 None admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:22:09.211531 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caee1e9e-069a-4abe-966d-def913a88dc2 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:22:09.248157 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cd1ef1-2a35-49bf-a67a-84e066275845 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:22:09.249467 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cd1ef1-2a35-49bf-a67a-84e066275845 None admin] REQUEST_METHOD: `PUT` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:09.249902 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cd1ef1-2a35-49bf-a67a-84e066275845 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:09.250210 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cd1ef1-2a35-49bf-a67a-84e066275845 None admin] PATH_INFO: `/v3/projects/294a6d4f4d1f45058a0706d961479db2/groups/b6631029d19d4604addb0ffd47e0d443/roles/382636e67fc142a2b2f486340d959e11` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:09.252330 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fa2360-3034-425c-84e9-80a46a9221f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:22:09.252479 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09cd1ef1-2a35-49bf-a67a-84e066275845 None admin] RBAC: Authorizing `identity:create_grant(project_id=294a6d4f4d1f45058a0706d961479db2, group_id=b6631029d19d4604addb0ffd47e0d443, role_id=382636e67fc142a2b2f486340d959e11)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:22:09.253464 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fa2360-3034-425c-84e9-80a46a9221f2 None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:09.253891 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fa2360-3034-425c-84e9-80a46a9221f2 None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:09.254216 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09cd1ef1-2a35-49bf-a67a-84e066275845 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:22:09.254442 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fa2360-3034-425c-84e9-80a46a9221f2 None admin] PATH_INFO: `/v3/groups/b6631029d19d4604addb0ffd47e0d443` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:09.255863 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0fa2360-3034-425c-84e9-80a46a9221f2 None admin] RBAC: Authorizing `identity:get_group(group_id=b6631029d19d4604addb0ffd47e0d443)` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:22:09.258064 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0fa2360-3034-425c-84e9-80a46a9221f2 None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:22:09.263629 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 204/398] 10.222.0.23 () {56 vars in 1180 bytes} [Tue May 10 05:22:09 2022] GET /identity/v3/groups/b6631029d19d4604addb0ffd47e0d443 => generated 226 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:22:09.265166 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff751cda-1b58-418b-8ac0-a9fc2980c5ea None None] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:09.265166 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff751cda-1b58-418b-8ac0-a9fc2980c5ea None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:09.265353 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff751cda-1b58-418b-8ac0-a9fc2980c5ea None None] PATH_INFO: `/` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:09.266754 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 205/399] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 10 05:22:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 05:22:09.267616 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff751cda-1b58-418b-8ac0-a9fc2980c5ea None None] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:22:09.276371 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 195/400] 10.222.0.23 () {58 vars in 1442 bytes} [Tue May 10 05:22:09 2022] PUT /identity/v3/projects/294a6d4f4d1f45058a0706d961479db2/groups/b6631029d19d4604addb0ffd47e0d443/roles/382636e67fc142a2b2f486340d959e11 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 05:22:09.278080 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a0f472-eefa-4288-8b24-30db99eb30ba None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:09.278620 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a0f472-eefa-4288-8b24-30db99eb30ba None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:09.279082 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a0f472-eefa-4288-8b24-30db99eb30ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:09.298987 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-a0a0f472-eefa-4288-8b24-30db99eb30ba None None] MFA Rules not processed for user `44883b22532e44049d846938dc2cf423`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:22:09.300581 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-a0a0f472-eefa-4288-8b24-30db99eb30ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:22:09.382178 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 196/401] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 10 05:22:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 05:22:09.384164 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09473882-a9b4-408d-b472-b0a860c15b14 None None] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:09.384451 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09473882-a9b4-408d-b472-b0a860c15b14 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:09.384724 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09473882-a9b4-408d-b472-b0a860c15b14 None None] PATH_INFO: `/` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:09.387903 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 197/402] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 10 05:22:09 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 05:22:09.391691 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a60e86-db7b-486e-81b8-c8cb7a4b163a None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:09.391970 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a60e86-db7b-486e-81b8-c8cb7a4b163a None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:09.392239 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a60e86-db7b-486e-81b8-c8cb7a4b163a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:09.412276 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-e1a60e86-db7b-486e-81b8-c8cb7a4b163a None None] MFA Rules not processed for user `44883b22532e44049d846938dc2cf423`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:22:09.413508 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-e1a60e86-db7b-486e-81b8-c8cb7a4b163a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:22:09.423610 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff751cda-1b58-418b-8ac0-a9fc2980c5ea None None] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:22:09.467366 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76abed1a-5521-4c98-abb4-86b68bcf1af5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:22:09.468396 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76abed1a-5521-4c98-abb4-86b68bcf1af5 None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:09.468675 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76abed1a-5521-4c98-abb4-86b68bcf1af5 None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:09.469243 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76abed1a-5521-4c98-abb4-86b68bcf1af5 None admin] PATH_INFO: `/v3/projects/294a6d4f4d1f45058a0706d961479db2` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:09.470188 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76abed1a-5521-4c98-abb4-86b68bcf1af5 None admin] RBAC: Authorizing `identity:get_project(project_id=294a6d4f4d1f45058a0706d961479db2)` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:22:09.471763 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76abed1a-5521-4c98-abb4-86b68bcf1af5 None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:22:09.473993 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 206/403] 10.222.0.23 () {56 vars in 1186 bytes} [Tue May 10 05:22:09 2022] GET /identity/v3/projects/294a6d4f4d1f45058a0706d961479db2 => generated 298 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:22:09.474812 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76abed1a-5521-4c98-abb4-86b68bcf1af5 None admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:22:09.495130 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 198/404] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 10 05:22:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 10 05:22:09.504241 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a60e86-db7b-486e-81b8-c8cb7a4b163a None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:22:09.594927 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76abed1a-5521-4c98-abb4-86b68bcf1af5 None admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:22:09.627107 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a60e86-db7b-486e-81b8-c8cb7a4b163a None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:22:09.635207 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664eb70a-33ac-4ed6-b5bb-763d965e42dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:22:09.636060 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664eb70a-33ac-4ed6-b5bb-763d965e42dd None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:09.636686 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664eb70a-33ac-4ed6-b5bb-763d965e42dd None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:09.636961 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664eb70a-33ac-4ed6-b5bb-763d965e42dd None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:09.651086 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664eb70a-33ac-4ed6-b5bb-763d965e42dd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 05:22:09.659941 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9622e79-4dff-4f2d-8d29-c078d46c2810 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:22:09.660643 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application [None req-664eb70a-33ac-4ed6-b5bb-763d965e42dd None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 10 05:22:09.660643 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 05:22:09.660643 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 05:22:09.660643 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 05:22:09.660643 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 05:22:09.660643 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 05:22:09.660643 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 05:22:09.660643 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 05:22:09.660643 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 05:22:09.660643 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 05:22:09.660643 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 05:22:09.660643 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 05:22:09.660643 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 05:22:09.660643 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 05:22:09.660643 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 05:22:09.660643 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 05:22:09.661552 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 05:22:09.661552 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 05:22:09.661552 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 05:22:09.661552 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 05:22:09.661552 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 05:22:09.661552 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 05:22:09.661552 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 05:22:09.661552 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 05:22:09.661552 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 05:22:09.661552 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.get_or_create( May 10 05:22:09.661552 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 05:22:09.661552 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application with Lock( May 10 05:22:09.661552 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 05:22:09.661552 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self._enter() May 10 05:22:09.661552 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 05:22:09.661552 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 05:22:09.662389 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 05:22:09.662389 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.creator() May 10 05:22:09.662389 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 05:22:09.662389 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application created_value = creator( May 10 05:22:09.662389 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 05:22:09.662389 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 05:22:09.662389 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 05:22:09.662389 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 05:22:09.662389 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 05:22:09.662389 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 05:22:09.662389 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 10 05:22:09.662389 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application May 10 05:22:09.662986 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9622e79-4dff-4f2d-8d29-c078d46c2810 None admin] REQUEST_METHOD: `PUT` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:09.662986 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9622e79-4dff-4f2d-8d29-c078d46c2810 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:09.662986 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9622e79-4dff-4f2d-8d29-c078d46c2810 None admin] PATH_INFO: `/v3/projects/294a6d4f4d1f45058a0706d961479db2/groups/b6631029d19d4604addb0ffd47e0d443/roles/b0cb991ebc2d42d5a5de343c57086616` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:09.663155 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 207/405] 10.222.0.23 () {56 vars in 1114 bytes} [Tue May 10 05:22:09 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 05:22:09.663155 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664eb70a-33ac-4ed6-b5bb-763d965e42dd None admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:22:09.668767 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9622e79-4dff-4f2d-8d29-c078d46c2810 None admin] RBAC: Authorizing `identity:create_grant(project_id=294a6d4f4d1f45058a0706d961479db2, group_id=b6631029d19d4604addb0ffd47e0d443, role_id=b0cb991ebc2d42d5a5de343c57086616)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:22:09.670224 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9622e79-4dff-4f2d-8d29-c078d46c2810 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:22:09.692965 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 199/406] 10.222.0.23 () {58 vars in 1442 bytes} [Tue May 10 05:22:09 2022] PUT /identity/v3/projects/294a6d4f4d1f45058a0706d961479db2/groups/b6631029d19d4604addb0ffd47e0d443/roles/b0cb991ebc2d42d5a5de343c57086616 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 05:22:09.693803 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9622e79-4dff-4f2d-8d29-c078d46c2810 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:22:09.792398 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664eb70a-33ac-4ed6-b5bb-763d965e42dd None admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:22:09.839118 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f043d6-a512-4ca4-9e1b-2332aff115f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:22:09.840099 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f043d6-a512-4ca4-9e1b-2332aff115f5 None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:09.840380 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f043d6-a512-4ca4-9e1b-2332aff115f5 None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:09.840887 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f043d6-a512-4ca4-9e1b-2332aff115f5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:09.856828 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f043d6-a512-4ca4-9e1b-2332aff115f5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 05:22:09.866020 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application [None req-f3f043d6-a512-4ca4-9e1b-2332aff115f5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 10 05:22:09.866020 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 05:22:09.866020 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 05:22:09.866020 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 05:22:09.866020 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 05:22:09.866020 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 05:22:09.866020 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 05:22:09.866020 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 05:22:09.866020 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 05:22:09.866020 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 05:22:09.866020 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 05:22:09.866020 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 05:22:09.866020 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 05:22:09.866020 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 05:22:09.866020 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 05:22:09.866020 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 05:22:09.868194 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 05:22:09.868194 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 05:22:09.868194 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 05:22:09.868194 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 05:22:09.868194 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 05:22:09.868194 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 05:22:09.868194 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 05:22:09.868194 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 05:22:09.868194 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 05:22:09.868194 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.get_or_create( May 10 05:22:09.868194 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 05:22:09.868194 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application with Lock( May 10 05:22:09.868194 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 05:22:09.868194 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self._enter() May 10 05:22:09.868194 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 05:22:09.868194 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 05:22:09.869452 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 05:22:09.869452 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.creator() May 10 05:22:09.869452 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 05:22:09.869452 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application created_value = creator( May 10 05:22:09.869452 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 05:22:09.869452 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 05:22:09.869452 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 05:22:09.869452 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 05:22:09.869452 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 05:22:09.869452 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 05:22:09.869452 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 10 05:22:09.869452 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application May 10 05:22:09.869452 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 208/407] 10.222.0.23 () {56 vars in 1096 bytes} [Tue May 10 05:22:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 05:22:09.876711 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f043d6-a512-4ca4-9e1b-2332aff115f5 None admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:22:09.965546 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9622e79-4dff-4f2d-8d29-c078d46c2810 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:22:09.984620 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f043d6-a512-4ca4-9e1b-2332aff115f5 None admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:22:10.010914 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85de1653-29cc-43de-a688-905dba3a5cf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:22:10.011619 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85de1653-29cc-43de-a688-905dba3a5cf5 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:10.011903 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85de1653-29cc-43de-a688-905dba3a5cf5 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:10.012235 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85de1653-29cc-43de-a688-905dba3a5cf5 None admin] PATH_INFO: `/v3/roles` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:10.012998 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85de1653-29cc-43de-a688-905dba3a5cf5 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:22:10.013300 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85de1653-29cc-43de-a688-905dba3a5cf5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:22:10.014678 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85de1653-29cc-43de-a688-905dba3a5cf5 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:22:10.026425 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 200/408] 10.222.0.23 () {56 vars in 1111 bytes} [Tue May 10 05:22:09 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 333 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:22:10.027157 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffc4506-b2fc-4463-80c4-a7468ce89e89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:22:10.027883 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffc4506-b2fc-4463-80c4-a7468ce89e89 None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:10.028161 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffc4506-b2fc-4463-80c4-a7468ce89e89 None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:10.028428 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffc4506-b2fc-4463-80c4-a7468ce89e89 None admin] PATH_INFO: `/v3/roles` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:10.029215 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ffc4506-b2fc-4463-80c4-a7468ce89e89 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:22:10.029520 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ffc4506-b2fc-4463-80c4-a7468ce89e89 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:22:10.030959 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ffc4506-b2fc-4463-80c4-a7468ce89e89 None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:22:10.032727 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85de1653-29cc-43de-a688-905dba3a5cf5 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:22:10.040595 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 209/409] 10.222.0.23 () {56 vars in 1099 bytes} [Tue May 10 05:22:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:22:10.046701 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffc4506-b2fc-4463-80c4-a7468ce89e89 None admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:22:10.148298 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffc4506-b2fc-4463-80c4-a7468ce89e89 None admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:22:10.186353 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3950b7-1563-4b13-9438-be25eefec0b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:22:10.187227 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3950b7-1563-4b13-9438-be25eefec0b5 None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:10.187504 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3950b7-1563-4b13-9438-be25eefec0b5 None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:10.187808 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3950b7-1563-4b13-9438-be25eefec0b5 None admin] PATH_INFO: `/v3/groups/90faba46b0184513afa12ee7eee83e6f` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:10.189492 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3950b7-1563-4b13-9438-be25eefec0b5 None admin] RBAC: Authorizing `identity:get_group(group_id=90faba46b0184513afa12ee7eee83e6f)` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:22:10.190898 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3950b7-1563-4b13-9438-be25eefec0b5 None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:22:10.193069 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 210/410] 10.222.0.23 () {56 vars in 1180 bytes} [Tue May 10 05:22:10 2022] GET /identity/v3/groups/90faba46b0184513afa12ee7eee83e6f => generated 229 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:22:10.198615 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3950b7-1563-4b13-9438-be25eefec0b5 None admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:22:10.219210 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85de1653-29cc-43de-a688-905dba3a5cf5 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:22:10.309188 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3950b7-1563-4b13-9438-be25eefec0b5 None admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:22:10.309548 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f22157-400c-431f-bd46-5be64bf11c49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:22:10.310722 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f22157-400c-431f-bd46-5be64bf11c49 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:10.311202 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f22157-400c-431f-bd46-5be64bf11c49 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:10.311797 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f22157-400c-431f-bd46-5be64bf11c49 None admin] PATH_INFO: `/v3/groups/b6631029d19d4604addb0ffd47e0d443` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:10.316257 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f22157-400c-431f-bd46-5be64bf11c49 None admin] RBAC: Authorizing `identity:get_group(group_id=b6631029d19d4604addb0ffd47e0d443)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:22:10.318000 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f22157-400c-431f-bd46-5be64bf11c49 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:22:10.320211 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 201/411] 10.222.0.23 () {56 vars in 1180 bytes} [Tue May 10 05:22:10 2022] GET /identity/v3/groups/b6631029d19d4604addb0ffd47e0d443 => generated 226 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:22:10.325256 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f22157-400c-431f-bd46-5be64bf11c49 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:22:10.342894 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ea57f0-df4f-43b3-9249-92ac9767e5ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:22:10.343792 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ea57f0-df4f-43b3-9249-92ac9767e5ed None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:10.344068 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ea57f0-df4f-43b3-9249-92ac9767e5ed None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:10.344336 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ea57f0-df4f-43b3-9249-92ac9767e5ed None admin] PATH_INFO: `/v3/projects/3a8435696f504d709a504bf384af26ea` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:10.345545 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ea57f0-df4f-43b3-9249-92ac9767e5ed None admin] RBAC: Authorizing `identity:get_project(project_id=3a8435696f504d709a504bf384af26ea)` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:22:10.353635 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ea57f0-df4f-43b3-9249-92ac9767e5ed None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:22:10.353635 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 211/412] 10.222.0.23 () {56 vars in 1186 bytes} [Tue May 10 05:22:10 2022] GET /identity/v3/projects/3a8435696f504d709a504bf384af26ea => generated 344 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 05:22:10.357056 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ea57f0-df4f-43b3-9249-92ac9767e5ed None admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:22:10.480814 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f22157-400c-431f-bd46-5be64bf11c49 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:22:10.541214 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ea57f0-df4f-43b3-9249-92ac9767e5ed None admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:22:10.560374 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809b94de-6001-4944-a765-f666dbf6a2e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:22:10.561181 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809b94de-6001-4944-a765-f666dbf6a2e7 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:10.561458 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809b94de-6001-4944-a765-f666dbf6a2e7 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:10.561725 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809b94de-6001-4944-a765-f666dbf6a2e7 None admin] PATH_INFO: `/v3/projects/c00aac4e3d244bf5a26814ed404a08f0` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:10.562949 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809b94de-6001-4944-a765-f666dbf6a2e7 None admin] RBAC: Authorizing `identity:get_project(project_id=c00aac4e3d244bf5a26814ed404a08f0)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:22:10.564426 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809b94de-6001-4944-a765-f666dbf6a2e7 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:22:10.567264 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 202/413] 10.222.0.23 () {56 vars in 1186 bytes} [Tue May 10 05:22:10 2022] GET /identity/v3/projects/c00aac4e3d244bf5a26814ed404a08f0 => generated 302 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:22:10.571727 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809b94de-6001-4944-a765-f666dbf6a2e7 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:22:10.577108 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c231e561-2c7f-49ba-ad37-1f7746483771 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:22:10.578258 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c231e561-2c7f-49ba-ad37-1f7746483771 None admin] REQUEST_METHOD: `PUT` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:10.578738 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c231e561-2c7f-49ba-ad37-1f7746483771 None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:10.579271 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c231e561-2c7f-49ba-ad37-1f7746483771 None admin] PATH_INFO: `/v3/projects/3a8435696f504d709a504bf384af26ea/groups/90faba46b0184513afa12ee7eee83e6f/roles/199ac1dd842441d7913c6ee89d8fbecc` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:10.581541 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c231e561-2c7f-49ba-ad37-1f7746483771 None admin] RBAC: Authorizing `identity:create_grant(project_id=3a8435696f504d709a504bf384af26ea, group_id=90faba46b0184513afa12ee7eee83e6f, role_id=199ac1dd842441d7913c6ee89d8fbecc)` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:22:10.583233 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c231e561-2c7f-49ba-ad37-1f7746483771 None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:22:10.618319 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 212/414] 10.222.0.23 () {58 vars in 1442 bytes} [Tue May 10 05:22:10 2022] PUT /identity/v3/projects/3a8435696f504d709a504bf384af26ea/groups/90faba46b0184513afa12ee7eee83e6f/roles/199ac1dd842441d7913c6ee89d8fbecc => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 05:22:10.688739 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809b94de-6001-4944-a765-f666dbf6a2e7 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:22:10.723778 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b6742f-23fe-49fc-8c64-c522b21dd943 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:22:10.724738 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b6742f-23fe-49fc-8c64-c522b21dd943 None admin] REQUEST_METHOD: `PUT` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:10.725061 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b6742f-23fe-49fc-8c64-c522b21dd943 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:10.725333 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b6742f-23fe-49fc-8c64-c522b21dd943 None admin] PATH_INFO: `/v3/projects/c00aac4e3d244bf5a26814ed404a08f0/groups/b6631029d19d4604addb0ffd47e0d443/roles/b0cb991ebc2d42d5a5de343c57086616` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:10.727663 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b6742f-23fe-49fc-8c64-c522b21dd943 None admin] RBAC: Authorizing `identity:create_grant(project_id=c00aac4e3d244bf5a26814ed404a08f0, group_id=b6631029d19d4604addb0ffd47e0d443, role_id=b0cb991ebc2d42d5a5de343c57086616)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:22:10.729173 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b6742f-23fe-49fc-8c64-c522b21dd943 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:22:10.747108 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 203/415] 10.222.0.23 () {58 vars in 1442 bytes} [Tue May 10 05:22:10 2022] PUT /identity/v3/projects/c00aac4e3d244bf5a26814ed404a08f0/groups/b6631029d19d4604addb0ffd47e0d443/roles/b0cb991ebc2d42d5a5de343c57086616 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 05:22:11.276394 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a285b89-2241-4505-a5ca-c92cfe35020d None None] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:11.276922 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a285b89-2241-4505-a5ca-c92cfe35020d None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:11.276922 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a285b89-2241-4505-a5ca-c92cfe35020d None None] PATH_INFO: `/` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:11.278605 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 213/416] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 10 05:22:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 05:22:11.284034 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dc9f1a-2a47-4529-ade7-a008a27890d6 None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:11.284481 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dc9f1a-2a47-4529-ade7-a008a27890d6 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:11.284579 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dc9f1a-2a47-4529-ade7-a008a27890d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:11.301563 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-43dc9f1a-2a47-4529-ade7-a008a27890d6 None None] MFA Rules not processed for user `44883b22532e44049d846938dc2cf423`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:22:11.302742 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-43dc9f1a-2a47-4529-ade7-a008a27890d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:22:11.372817 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 204/417] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 10 05:22:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 05:22:11.391891 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a285b89-2241-4505-a5ca-c92cfe35020d None None] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:22:11.492633 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a285b89-2241-4505-a5ca-c92cfe35020d None None] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:22:11.525804 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b09ecd-bd25-43c2-8af2-f2c477bae780 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:22:11.526662 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b09ecd-bd25-43c2-8af2-f2c477bae780 None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:11.526882 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b09ecd-bd25-43c2-8af2-f2c477bae780 None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:11.527155 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b09ecd-bd25-43c2-8af2-f2c477bae780 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:11.537649 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b09ecd-bd25-43c2-8af2-f2c477bae780 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 05:22:11.545319 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application [None req-97b09ecd-bd25-43c2-8af2-f2c477bae780 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 10 05:22:11.545319 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 05:22:11.545319 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 05:22:11.545319 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 05:22:11.545319 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 05:22:11.545319 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 05:22:11.545319 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 05:22:11.545319 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 05:22:11.545319 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 05:22:11.545319 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 05:22:11.545319 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 05:22:11.545319 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 05:22:11.545319 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 05:22:11.545319 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 05:22:11.545319 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 05:22:11.545319 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 05:22:11.546206 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 05:22:11.546206 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 05:22:11.546206 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 05:22:11.546206 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 05:22:11.546206 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 05:22:11.546206 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 05:22:11.546206 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 05:22:11.546206 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 05:22:11.546206 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 05:22:11.546206 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.get_or_create( May 10 05:22:11.546206 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 05:22:11.546206 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application with Lock( May 10 05:22:11.546206 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 05:22:11.546206 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self._enter() May 10 05:22:11.546206 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 05:22:11.546206 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 05:22:11.546990 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 05:22:11.546990 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.creator() May 10 05:22:11.546990 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 05:22:11.546990 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application created_value = creator( May 10 05:22:11.546990 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 05:22:11.546990 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 05:22:11.546990 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 05:22:11.546990 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 05:22:11.546990 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 05:22:11.546990 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 05:22:11.546990 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 10 05:22:11.546990 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application May 10 05:22:11.546990 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 214/418] 10.222.0.23 () {56 vars in 1099 bytes} [Tue May 10 05:22:11 2022] GET /identity/v3/roles/member => generated 84 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 05:22:11.553909 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43dc9f1a-2a47-4529-ade7-a008a27890d6 None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:22:11.673472 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43dc9f1a-2a47-4529-ade7-a008a27890d6 None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:22:11.714674 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e44471-862d-4834-87ac-3b9279e448e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:22:11.715772 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e44471-862d-4834-87ac-3b9279e448e1 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:11.716273 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e44471-862d-4834-87ac-3b9279e448e1 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:11.716735 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e44471-862d-4834-87ac-3b9279e448e1 None admin] PATH_INFO: `/v3/roles` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:11.717708 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e44471-862d-4834-87ac-3b9279e448e1 None admin] RBAC: Adding query filter params (name=member) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:22:11.718207 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e44471-862d-4834-87ac-3b9279e448e1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:22:11.719814 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e44471-862d-4834-87ac-3b9279e448e1 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:22:11.729213 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 205/419] 10.222.0.23 () {56 vars in 1101 bytes} [Tue May 10 05:22:11 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:22:11.735064 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b09ecd-bd25-43c2-8af2-f2c477bae780 None admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:22:11.889021 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b09ecd-bd25-43c2-8af2-f2c477bae780 None admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:22:11.932859 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bfc05a-6583-4e86-810e-181767f6b6ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:22:11.933529 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bfc05a-6583-4e86-810e-181767f6b6ca None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:11.933810 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bfc05a-6583-4e86-810e-181767f6b6ca None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:11.934082 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bfc05a-6583-4e86-810e-181767f6b6ca None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:11.935190 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18640bf3-b82d-4fbb-b11f-0f8b9cd103df None None] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:11.935856 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18640bf3-b82d-4fbb-b11f-0f8b9cd103df None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:11.936325 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18640bf3-b82d-4fbb-b11f-0f8b9cd103df None None] PATH_INFO: `/` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:11.938101 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 206/420] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 10 05:22:11 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 05:22:11.943840 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bacdffb-f86e-4a37-bc03-93899a63037e None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:11.944388 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bacdffb-f86e-4a37-bc03-93899a63037e None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:11.944874 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bacdffb-f86e-4a37-bc03-93899a63037e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:11.976636 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-5bacdffb-f86e-4a37-bc03-93899a63037e None None] MFA Rules not processed for user `44883b22532e44049d846938dc2cf423`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:22:11.978072 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-5bacdffb-f86e-4a37-bc03-93899a63037e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:22:12.000656 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0bfc05a-6583-4e86-810e-181767f6b6ca None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:22:12.002424 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0bfc05a-6583-4e86-810e-181767f6b6ca None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:22:12.108232 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 215/421] 10.222.0.23 () {58 vars in 1282 bytes} [Tue May 10 05:22:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 05:22:12.113600 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bfc05a-6583-4e86-810e-181767f6b6ca None admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:22:12.129093 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 207/422] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 10 05:22:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 10 05:22:12.152395 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bacdffb-f86e-4a37-bc03-93899a63037e None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:22:12.259476 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bacdffb-f86e-4a37-bc03-93899a63037e None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:22:12.297258 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c284e043-f75e-42db-8ec6-2844a5a7802f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:22:12.298064 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c284e043-f75e-42db-8ec6-2844a5a7802f None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:12.298350 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c284e043-f75e-42db-8ec6-2844a5a7802f None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:12.298622 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c284e043-f75e-42db-8ec6-2844a5a7802f None admin] PATH_INFO: `/v3/roles/member` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:12.302944 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bfc05a-6583-4e86-810e-181767f6b6ca None admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:22:12.321303 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c284e043-f75e-42db-8ec6-2844a5a7802f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 05:22:12.329297 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application [None req-c284e043-f75e-42db-8ec6-2844a5a7802f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 10 05:22:12.329297 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 05:22:12.329297 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 05:22:12.329297 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 05:22:12.329297 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 05:22:12.329297 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 05:22:12.329297 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 05:22:12.329297 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 05:22:12.329297 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 05:22:12.329297 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 05:22:12.329297 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 05:22:12.329297 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 05:22:12.329297 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 05:22:12.329297 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 05:22:12.329297 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 05:22:12.329297 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 05:22:12.330311 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 05:22:12.330311 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 05:22:12.330311 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 05:22:12.330311 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 05:22:12.330311 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 05:22:12.330311 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 05:22:12.330311 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 05:22:12.330311 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 05:22:12.330311 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 05:22:12.330311 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.get_or_create( May 10 05:22:12.330311 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 05:22:12.330311 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application with Lock( May 10 05:22:12.330311 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 05:22:12.330311 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._enter() May 10 05:22:12.330311 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 05:22:12.330311 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 05:22:12.331118 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 05:22:12.331118 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.creator() May 10 05:22:12.331118 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 05:22:12.331118 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application created_value = creator( May 10 05:22:12.331118 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 05:22:12.331118 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 05:22:12.331118 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 05:22:12.331118 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 05:22:12.331118 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 05:22:12.331118 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 05:22:12.331118 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 10 05:22:12.331118 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application May 10 05:22:12.331118 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 208/423] 10.222.0.23 () {56 vars in 1099 bytes} [Tue May 10 05:22:12 2022] GET /identity/v3/roles/member => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 05:22:12.336922 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c284e043-f75e-42db-8ec6-2844a5a7802f None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:22:12.368887 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b2f62d-2ad3-4dc3-aa8c-1ab9d7234ba2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:22:12.369768 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b2f62d-2ad3-4dc3-aa8c-1ab9d7234ba2 None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:12.370050 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b2f62d-2ad3-4dc3-aa8c-1ab9d7234ba2 None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:12.370323 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b2f62d-2ad3-4dc3-aa8c-1ab9d7234ba2 None admin] PATH_INFO: `/v3/projects/c00aac4e3d244bf5a26814ed404a08f0` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:12.374592 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b2f62d-2ad3-4dc3-aa8c-1ab9d7234ba2 None admin] RBAC: Authorizing `identity:get_project(project_id=c00aac4e3d244bf5a26814ed404a08f0)` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:22:12.376099 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b2f62d-2ad3-4dc3-aa8c-1ab9d7234ba2 None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:22:12.377983 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 216/424] 10.222.0.23 () {56 vars in 1186 bytes} [Tue May 10 05:22:12 2022] GET /identity/v3/projects/c00aac4e3d244bf5a26814ed404a08f0 => generated 302 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:22:12.384920 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b2f62d-2ad3-4dc3-aa8c-1ab9d7234ba2 None admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:22:12.441904 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c284e043-f75e-42db-8ec6-2844a5a7802f None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:22:12.487241 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04cb29a-9b09-4d8b-b82e-5b39158b7e17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:22:12.487985 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04cb29a-9b09-4d8b-b82e-5b39158b7e17 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:12.488265 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04cb29a-9b09-4d8b-b82e-5b39158b7e17 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:12.488536 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04cb29a-9b09-4d8b-b82e-5b39158b7e17 None admin] PATH_INFO: `/v3/roles` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:12.489396 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04cb29a-9b09-4d8b-b82e-5b39158b7e17 None admin] RBAC: Adding query filter params (name=member) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:22:12.489705 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04cb29a-9b09-4d8b-b82e-5b39158b7e17 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:22:12.491106 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04cb29a-9b09-4d8b-b82e-5b39158b7e17 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:22:12.505249 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 209/425] 10.222.0.23 () {56 vars in 1101 bytes} [Tue May 10 05:22:12 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 05:22:12.507990 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367581f2-076f-4354-8e9c-400878789334 None None] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:12.508284 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367581f2-076f-4354-8e9c-400878789334 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:12.508553 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367581f2-076f-4354-8e9c-400878789334 None None] PATH_INFO: `/` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:12.510070 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 210/426] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 10 05:22:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 05:22:12.512070 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367581f2-076f-4354-8e9c-400878789334 None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:22:12.558222 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b2f62d-2ad3-4dc3-aa8c-1ab9d7234ba2 None admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:22:12.591435 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009f96c9-ca13-4f5d-a6bc-7787acb98e70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:22:12.592376 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009f96c9-ca13-4f5d-a6bc-7787acb98e70 None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:12.592707 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009f96c9-ca13-4f5d-a6bc-7787acb98e70 None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:12.592975 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009f96c9-ca13-4f5d-a6bc-7787acb98e70 None admin] PATH_INFO: `/v3/groups/b6631029d19d4604addb0ffd47e0d443` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:12.594197 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009f96c9-ca13-4f5d-a6bc-7787acb98e70 None admin] RBAC: Authorizing `identity:get_group(group_id=b6631029d19d4604addb0ffd47e0d443)` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:22:12.595759 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009f96c9-ca13-4f5d-a6bc-7787acb98e70 None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:22:12.597730 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 217/427] 10.222.0.23 () {56 vars in 1180 bytes} [Tue May 10 05:22:12 2022] GET /identity/v3/groups/b6631029d19d4604addb0ffd47e0d443 => generated 226 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 05:22:12.598970 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98b7c82-4dac-4a4a-8f4c-65bd84ed9cce None None] REQUEST_METHOD: `POST` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:12.599294 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98b7c82-4dac-4a4a-8f4c-65bd84ed9cce None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:12.599564 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98b7c82-4dac-4a4a-8f4c-65bd84ed9cce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:12.616459 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.auth.core [None req-e98b7c82-4dac-4a4a-8f4c-65bd84ed9cce None None] MFA Rules not processed for user `44883b22532e44049d846938dc2cf423`. Rule list: `[]` (Enabled: `True`). {{(pid=79879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:22:12.617675 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-e98b7c82-4dac-4a4a-8f4c-65bd84ed9cce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:22:12.635954 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367581f2-076f-4354-8e9c-400878789334 None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:22:12.676323 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6aabd7-cf83-4184-a2cf-335118355efe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:22:12.677434 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6aabd7-cf83-4184-a2cf-335118355efe None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:12.677746 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6aabd7-cf83-4184-a2cf-335118355efe None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:12.678279 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6aabd7-cf83-4184-a2cf-335118355efe None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:12.691839 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 218/428] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 10 05:22:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 05:22:12.692841 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98b7c82-4dac-4a4a-8f4c-65bd84ed9cce None None] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:22:12.754382 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6aabd7-cf83-4184-a2cf-335118355efe None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:22:12.756152 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6aabd7-cf83-4184-a2cf-335118355efe None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:22:12.808675 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98b7c82-4dac-4a4a-8f4c-65bd84ed9cce None None] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:22:12.841825 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787b2c93-e29b-4cec-84b4-01889598c8e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:22:12.842475 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787b2c93-e29b-4cec-84b4-01889598c8e3 None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:12.842751 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787b2c93-e29b-4cec-84b4-01889598c8e3 None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:12.843022 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787b2c93-e29b-4cec-84b4-01889598c8e3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:12.843884 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787b2c93-e29b-4cec-84b4-01889598c8e3 None admin] RBAC: Adding query filter params (group.id=b6631029d19d4604addb0ffd47e0d443, role.id=382636e67fc142a2b2f486340d959e11, scope.project.id=c00aac4e3d244bf5a26814ed404a08f0) {{(pid=79879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:22:12.844191 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787b2c93-e29b-4cec-84b4-01889598c8e3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:22:12.845629 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787b2c93-e29b-4cec-84b4-01889598c8e3 None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:22:12.851691 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 219/429] 10.222.0.23 () {56 vars in 1376 bytes} [Tue May 10 05:22:12 2022] GET /identity/v3/role_assignments?group.id=b6631029d19d4604addb0ffd47e0d443&scope.project.id=c00aac4e3d244bf5a26814ed404a08f0&role.id=382636e67fc142a2b2f486340d959e11 => generated 611 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:22:12.852315 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787b2c93-e29b-4cec-84b4-01889598c8e3 None admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:22:12.906571 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 211/430] 10.222.0.23 () {58 vars in 1282 bytes} [Tue May 10 05:22:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 05:22:12.913868 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6aabd7-cf83-4184-a2cf-335118355efe None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:22:13.048363 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787b2c93-e29b-4cec-84b4-01889598c8e3 None admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:22:13.091553 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6aabd7-cf83-4184-a2cf-335118355efe None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:22:13.101184 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47cd3df-73db-4a33-81d9-0bcd9a04bade None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:22:13.102041 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47cd3df-73db-4a33-81d9-0bcd9a04bade None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:13.102322 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47cd3df-73db-4a33-81d9-0bcd9a04bade None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:13.102588 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47cd3df-73db-4a33-81d9-0bcd9a04bade None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:13.114623 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47cd3df-73db-4a33-81d9-0bcd9a04bade None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 05:22:13.123233 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application [None req-d47cd3df-73db-4a33-81d9-0bcd9a04bade None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 10 05:22:13.123233 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 05:22:13.123233 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 05:22:13.123233 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 05:22:13.123233 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 05:22:13.123233 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 05:22:13.123233 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 05:22:13.123233 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 05:22:13.123233 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 05:22:13.123233 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 05:22:13.123233 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 05:22:13.123233 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 05:22:13.123233 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 05:22:13.123233 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 05:22:13.123233 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 05:22:13.123233 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 05:22:13.125261 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 05:22:13.125261 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 05:22:13.125261 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 05:22:13.125261 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 05:22:13.125261 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 05:22:13.125261 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 05:22:13.125261 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 05:22:13.125261 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 05:22:13.125261 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 05:22:13.125261 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.get_or_create( May 10 05:22:13.125261 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 05:22:13.125261 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application with Lock( May 10 05:22:13.125261 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 05:22:13.125261 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self._enter() May 10 05:22:13.125261 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 05:22:13.125261 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 05:22:13.126228 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 05:22:13.126228 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.creator() May 10 05:22:13.126228 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 05:22:13.126228 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application created_value = creator( May 10 05:22:13.126228 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 05:22:13.126228 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 05:22:13.126228 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 05:22:13.126228 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 05:22:13.126228 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 05:22:13.126228 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 05:22:13.126228 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 10 05:22:13.126228 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application May 10 05:22:13.126228 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 220/431] 10.222.0.23 () {56 vars in 1114 bytes} [Tue May 10 05:22:12 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 05:22:13.130529 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47cd3df-73db-4a33-81d9-0bcd9a04bade None admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:22:13.142738 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e77b0a-d35e-4207-bf50-429f9497c6f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:22:13.144067 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e77b0a-d35e-4207-bf50-429f9497c6f2 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:13.144355 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e77b0a-d35e-4207-bf50-429f9497c6f2 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:13.144636 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e77b0a-d35e-4207-bf50-429f9497c6f2 None admin] PATH_INFO: `/v3/projects/294a6d4f4d1f45058a0706d961479db2` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:13.146259 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e77b0a-d35e-4207-bf50-429f9497c6f2 None admin] RBAC: Authorizing `identity:get_project(project_id=294a6d4f4d1f45058a0706d961479db2)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:22:13.148145 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e77b0a-d35e-4207-bf50-429f9497c6f2 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:22:13.151067 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 212/432] 10.222.0.23 () {56 vars in 1186 bytes} [Tue May 10 05:22:12 2022] GET /identity/v3/projects/294a6d4f4d1f45058a0706d961479db2 => generated 298 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 05:22:13.155853 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e77b0a-d35e-4207-bf50-429f9497c6f2 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:22:13.257605 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47cd3df-73db-4a33-81d9-0bcd9a04bade None admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:22:13.258961 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e77b0a-d35e-4207-bf50-429f9497c6f2 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:22:13.291736 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60763ff5-6536-4c65-9a4e-100693a12168 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:22:13.292727 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60763ff5-6536-4c65-9a4e-100693a12168 None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:13.293111 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60763ff5-6536-4c65-9a4e-100693a12168 None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:13.293312 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42da56aa-fa68-4c77-98e4-f94a9ebe020e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:22:13.293586 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60763ff5-6536-4c65-9a4e-100693a12168 None admin] PATH_INFO: `/v3/roles` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:13.294439 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60763ff5-6536-4c65-9a4e-100693a12168 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:22:13.294633 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42da56aa-fa68-4c77-98e4-f94a9ebe020e None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:13.294916 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60763ff5-6536-4c65-9a4e-100693a12168 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:22:13.295191 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42da56aa-fa68-4c77-98e4-f94a9ebe020e None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:13.295642 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42da56aa-fa68-4c77-98e4-f94a9ebe020e None admin] PATH_INFO: `/v3/groups/b6631029d19d4604addb0ffd47e0d443` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:13.296680 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60763ff5-6536-4c65-9a4e-100693a12168 None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:22:13.297111 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42da56aa-fa68-4c77-98e4-f94a9ebe020e None admin] RBAC: Authorizing `identity:get_group(group_id=b6631029d19d4604addb0ffd47e0d443)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:22:13.298725 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42da56aa-fa68-4c77-98e4-f94a9ebe020e None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:22:13.301380 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 213/433] 10.222.0.23 () {56 vars in 1180 bytes} [Tue May 10 05:22:13 2022] GET /identity/v3/groups/b6631029d19d4604addb0ffd47e0d443 => generated 226 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 05:22:13.306759 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 221/434] 10.222.0.23 () {56 vars in 1111 bytes} [Tue May 10 05:22:13 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:22:13.308219 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42da56aa-fa68-4c77-98e4-f94a9ebe020e None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:22:13.310024 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c68db9-9aee-4f7f-a12e-88ccd72bf9cb None None] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:13.310826 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c68db9-9aee-4f7f-a12e-88ccd72bf9cb None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:13.311724 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c68db9-9aee-4f7f-a12e-88ccd72bf9cb None None] PATH_INFO: `/` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:13.313067 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 222/435] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 10 05:22:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 05:22:13.313770 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c68db9-9aee-4f7f-a12e-88ccd72bf9cb None None] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:22:13.410380 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c68db9-9aee-4f7f-a12e-88ccd72bf9cb None None] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:22:13.411232 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42da56aa-fa68-4c77-98e4-f94a9ebe020e None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:22:13.444063 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3bac66-51c0-4f55-94e2-58881606e522 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:22:13.444328 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba5f01e-2097-4da5-9737-1103c426d0b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:22:13.444736 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba5f01e-2097-4da5-9737-1103c426d0b4 None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:13.444836 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3bac66-51c0-4f55-94e2-58881606e522 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:13.445011 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3bac66-51c0-4f55-94e2-58881606e522 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:13.445101 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba5f01e-2097-4da5-9737-1103c426d0b4 None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:13.445278 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba5f01e-2097-4da5-9737-1103c426d0b4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:13.445366 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3bac66-51c0-4f55-94e2-58881606e522 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:13.446126 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3bac66-51c0-4f55-94e2-58881606e522 None admin] RBAC: Adding query filter params (group.id=b6631029d19d4604addb0ffd47e0d443, role.id=382636e67fc142a2b2f486340d959e11, scope.project.id=294a6d4f4d1f45058a0706d961479db2) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:22:13.446434 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3bac66-51c0-4f55-94e2-58881606e522 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:22:13.447960 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3bac66-51c0-4f55-94e2-58881606e522 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:22:13.461855 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 214/436] 10.222.0.23 () {56 vars in 1376 bytes} [Tue May 10 05:22:13 2022] GET /identity/v3/role_assignments?group.id=b6631029d19d4604addb0ffd47e0d443&scope.project.id=294a6d4f4d1f45058a0706d961479db2&role.id=382636e67fc142a2b2f486340d959e11 => generated 611 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:22:13.461855 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e57a365-2095-48a0-8f58-4e3a95f63ee1 None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:13.461855 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e57a365-2095-48a0-8f58-4e3a95f63ee1 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:13.461855 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e57a365-2095-48a0-8f58-4e3a95f63ee1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:13.481890 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-0e57a365-2095-48a0-8f58-4e3a95f63ee1 None None] MFA Rules not processed for user `44883b22532e44049d846938dc2cf423`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:22:13.483443 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-0e57a365-2095-48a0-8f58-4e3a95f63ee1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:22:13.529774 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba5f01e-2097-4da5-9737-1103c426d0b4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:22:13.531318 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba5f01e-2097-4da5-9737-1103c426d0b4 None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:22:13.575326 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 215/437] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 10 05:22:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 05:22:13.594966 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e57a365-2095-48a0-8f58-4e3a95f63ee1 None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:22:13.669727 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 223/438] 10.222.0.23 () {58 vars in 1282 bytes} [Tue May 10 05:22:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 05:22:13.671107 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87e912d-62c8-44a4-bac4-45bdf3b348e1 None None] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:13.671393 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87e912d-62c8-44a4-bac4-45bdf3b348e1 None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:13.672485 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87e912d-62c8-44a4-bac4-45bdf3b348e1 None None] PATH_INFO: `/` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:13.673089 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 224/439] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 10 05:22:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 05:22:13.675263 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87e912d-62c8-44a4-bac4-45bdf3b348e1 None None] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:22:13.723066 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e57a365-2095-48a0-8f58-4e3a95f63ee1 None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:22:13.761291 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41be8adc-83ba-4b90-aab2-d82f584ee9d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:22:13.762103 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41be8adc-83ba-4b90-aab2-d82f584ee9d6 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:13.762377 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41be8adc-83ba-4b90-aab2-d82f584ee9d6 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:13.763653 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41be8adc-83ba-4b90-aab2-d82f584ee9d6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:13.772966 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41be8adc-83ba-4b90-aab2-d82f584ee9d6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 05:22:13.777717 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87e912d-62c8-44a4-bac4-45bdf3b348e1 None None] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:22:13.780585 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application [None req-41be8adc-83ba-4b90-aab2-d82f584ee9d6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 10 05:22:13.780585 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 05:22:13.780585 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 05:22:13.780585 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 05:22:13.780585 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 05:22:13.780585 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 05:22:13.780585 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 05:22:13.780585 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 05:22:13.780585 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 05:22:13.780585 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 05:22:13.780585 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 05:22:13.780585 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 05:22:13.780585 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 05:22:13.780585 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 05:22:13.780585 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 05:22:13.780585 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 05:22:13.781459 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 05:22:13.781459 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 05:22:13.781459 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 05:22:13.781459 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 05:22:13.781459 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 05:22:13.781459 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 05:22:13.781459 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 05:22:13.781459 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 05:22:13.781459 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 05:22:13.781459 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.get_or_create( May 10 05:22:13.781459 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 05:22:13.781459 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application with Lock( May 10 05:22:13.781459 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 05:22:13.781459 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._enter() May 10 05:22:13.781459 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 05:22:13.781459 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 05:22:13.782645 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 05:22:13.782645 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.creator() May 10 05:22:13.782645 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 05:22:13.782645 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application created_value = creator( May 10 05:22:13.782645 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 05:22:13.782645 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 05:22:13.782645 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 05:22:13.782645 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 05:22:13.782645 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 05:22:13.782645 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 05:22:13.782645 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 10 05:22:13.782645 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application May 10 05:22:13.782645 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 216/440] 10.222.0.23 () {56 vars in 1096 bytes} [Tue May 10 05:22:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 05:22:13.783770 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf66576-0685-45cd-aedc-d92d42dba519 None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:13.783770 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf66576-0685-45cd-aedc-d92d42dba519 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:13.783770 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf66576-0685-45cd-aedc-d92d42dba519 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:13.801424 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-4bf66576-0685-45cd-aedc-d92d42dba519 None None] MFA Rules not processed for user `44883b22532e44049d846938dc2cf423`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:22:13.802598 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-4bf66576-0685-45cd-aedc-d92d42dba519 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:22:13.814825 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85eecb83-0bca-4bdc-a59e-016c8f49a6e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:22:13.815818 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85eecb83-0bca-4bdc-a59e-016c8f49a6e2 None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:13.816097 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85eecb83-0bca-4bdc-a59e-016c8f49a6e2 None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:13.816368 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85eecb83-0bca-4bdc-a59e-016c8f49a6e2 None admin] PATH_INFO: `/v3/projects/294a6d4f4d1f45058a0706d961479db2` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:13.818714 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85eecb83-0bca-4bdc-a59e-016c8f49a6e2 None admin] RBAC: Authorizing `identity:get_project(project_id=294a6d4f4d1f45058a0706d961479db2)` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:22:13.820223 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85eecb83-0bca-4bdc-a59e-016c8f49a6e2 None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:22:13.822101 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 225/441] 10.222.0.23 () {56 vars in 1186 bytes} [Tue May 10 05:22:13 2022] GET /identity/v3/projects/294a6d4f4d1f45058a0706d961479db2 => generated 298 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 05:22:13.822868 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85eecb83-0bca-4bdc-a59e-016c8f49a6e2 None admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:22:13.884866 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 217/442] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 10 05:22:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 05:22:13.885781 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf66576-0685-45cd-aedc-d92d42dba519 None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:22:13.925435 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85eecb83-0bca-4bdc-a59e-016c8f49a6e2 None admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:22:13.956574 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce002fb7-de80-40be-a852-4f841ea21a6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:22:13.957242 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce002fb7-de80-40be-a852-4f841ea21a6f None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:13.957537 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce002fb7-de80-40be-a852-4f841ea21a6f None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:13.957850 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce002fb7-de80-40be-a852-4f841ea21a6f None admin] PATH_INFO: `/v3/roles` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:13.958605 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce002fb7-de80-40be-a852-4f841ea21a6f None admin] RBAC: Adding query filter params (name=admin) {{(pid=79879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:22:13.958904 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce002fb7-de80-40be-a852-4f841ea21a6f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:22:13.960321 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce002fb7-de80-40be-a852-4f841ea21a6f None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:22:13.968808 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 226/443] 10.222.0.23 () {56 vars in 1099 bytes} [Tue May 10 05:22:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:22:13.969625 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce002fb7-de80-40be-a852-4f841ea21a6f None admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:22:13.982664 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf66576-0685-45cd-aedc-d92d42dba519 None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:22:14.018289 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e58bf5-fa09-4088-a624-21e68b77fd39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:22:14.019170 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e58bf5-fa09-4088-a624-21e68b77fd39 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:14.019452 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e58bf5-fa09-4088-a624-21e68b77fd39 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:14.019759 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e58bf5-fa09-4088-a624-21e68b77fd39 None admin] PATH_INFO: `/v3/groups/b6631029d19d4604addb0ffd47e0d443` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:14.021194 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e58bf5-fa09-4088-a624-21e68b77fd39 None admin] RBAC: Authorizing `identity:get_group(group_id=b6631029d19d4604addb0ffd47e0d443)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:22:14.022668 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e58bf5-fa09-4088-a624-21e68b77fd39 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:22:14.024533 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 218/444] 10.222.0.23 () {56 vars in 1180 bytes} [Tue May 10 05:22:13 2022] GET /identity/v3/groups/b6631029d19d4604addb0ffd47e0d443 => generated 226 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:22:14.025135 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e58bf5-fa09-4088-a624-21e68b77fd39 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:22:14.070624 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce002fb7-de80-40be-a852-4f841ea21a6f None admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:22:14.103887 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170c15f2-a690-4bed-85bf-9cf87c9380ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:22:14.104715 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170c15f2-a690-4bed-85bf-9cf87c9380ad None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:14.104992 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170c15f2-a690-4bed-85bf-9cf87c9380ad None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:14.105269 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170c15f2-a690-4bed-85bf-9cf87c9380ad None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:14.115166 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170c15f2-a690-4bed-85bf-9cf87c9380ad None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 05:22:14.123336 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e58bf5-fa09-4088-a624-21e68b77fd39 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:22:14.123472 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application [None req-170c15f2-a690-4bed-85bf-9cf87c9380ad None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 10 05:22:14.123472 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 05:22:14.123472 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 05:22:14.123472 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 05:22:14.123472 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 05:22:14.123472 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 05:22:14.123472 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 05:22:14.123472 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 05:22:14.123472 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 05:22:14.123472 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 05:22:14.123472 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 05:22:14.123472 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 05:22:14.123472 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 05:22:14.123472 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 05:22:14.123472 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 05:22:14.123472 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 05:22:14.124361 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 05:22:14.124361 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 05:22:14.124361 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 05:22:14.124361 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 05:22:14.124361 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 05:22:14.124361 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 05:22:14.124361 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 05:22:14.124361 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 05:22:14.124361 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 05:22:14.124361 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.get_or_create( May 10 05:22:14.124361 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 05:22:14.124361 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application with Lock( May 10 05:22:14.124361 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 05:22:14.124361 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self._enter() May 10 05:22:14.124361 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 05:22:14.124361 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 05:22:14.125311 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 05:22:14.125311 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.creator() May 10 05:22:14.125311 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 05:22:14.125311 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application created_value = creator( May 10 05:22:14.125311 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 05:22:14.125311 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 05:22:14.125311 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 05:22:14.125311 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 05:22:14.125311 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 05:22:14.125311 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 05:22:14.125311 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 10 05:22:14.125311 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application May 10 05:22:14.125311 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 227/445] 10.222.0.23 () {56 vars in 1114 bytes} [Tue May 10 05:22:13 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 05:22:14.126159 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170c15f2-a690-4bed-85bf-9cf87c9380ad None admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:22:14.156695 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd73a08-5371-4eaa-923d-887a06956f7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:22:14.157283 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd73a08-5371-4eaa-923d-887a06956f7a None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:14.157581 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd73a08-5371-4eaa-923d-887a06956f7a None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:14.157853 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd73a08-5371-4eaa-923d-887a06956f7a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:14.220042 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd73a08-5371-4eaa-923d-887a06956f7a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:22:14.221492 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd73a08-5371-4eaa-923d-887a06956f7a None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:22:14.222138 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170c15f2-a690-4bed-85bf-9cf87c9380ad None admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:22:14.255168 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fc696a-b56f-4340-8ed9-2ad824bc8105 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:22:14.255835 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fc696a-b56f-4340-8ed9-2ad824bc8105 None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:14.256112 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fc696a-b56f-4340-8ed9-2ad824bc8105 None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:14.256361 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fc696a-b56f-4340-8ed9-2ad824bc8105 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:14.257190 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fc696a-b56f-4340-8ed9-2ad824bc8105 None admin] RBAC: Adding query filter params (group.id=b6631029d19d4604addb0ffd47e0d443, role.id=b0cb991ebc2d42d5a5de343c57086616, scope.project.id=294a6d4f4d1f45058a0706d961479db2) {{(pid=79879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:22:14.257496 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fc696a-b56f-4340-8ed9-2ad824bc8105 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:22:14.258926 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fc696a-b56f-4340-8ed9-2ad824bc8105 None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:22:14.264928 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 228/446] 10.222.0.23 () {56 vars in 1376 bytes} [Tue May 10 05:22:14 2022] GET /identity/v3/role_assignments?group.id=b6631029d19d4604addb0ffd47e0d443&scope.project.id=294a6d4f4d1f45058a0706d961479db2&role.id=b0cb991ebc2d42d5a5de343c57086616 => generated 611 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:22:14.265712 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fc696a-b56f-4340-8ed9-2ad824bc8105 None admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:22:14.330485 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 219/447] 10.222.0.23 () {58 vars in 1282 bytes} [Tue May 10 05:22:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 05:22:14.332173 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd73a08-5371-4eaa-923d-887a06956f7a None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:22:14.378931 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fc696a-b56f-4340-8ed9-2ad824bc8105 None admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:22:14.413912 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd6f7d2-0c50-4f10-b498-ce3d3b878110 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:22:14.414517 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd6f7d2-0c50-4f10-b498-ce3d3b878110 None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:14.414802 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd6f7d2-0c50-4f10-b498-ce3d3b878110 None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:14.415083 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd6f7d2-0c50-4f10-b498-ce3d3b878110 None admin] PATH_INFO: `/v3/roles` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:14.415884 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd6f7d2-0c50-4f10-b498-ce3d3b878110 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:22:14.416266 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd6f7d2-0c50-4f10-b498-ce3d3b878110 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:22:14.417702 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd6f7d2-0c50-4f10-b498-ce3d3b878110 None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:22:14.426624 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 229/448] 10.222.0.23 () {56 vars in 1111 bytes} [Tue May 10 05:22:14 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:22:14.432053 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd6f7d2-0c50-4f10-b498-ce3d3b878110 None admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:22:14.443684 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd73a08-5371-4eaa-923d-887a06956f7a None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:22:14.484701 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408bdad7-56d1-40e3-a50b-e6ecc183e072 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:22:14.485570 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408bdad7-56d1-40e3-a50b-e6ecc183e072 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:14.485852 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408bdad7-56d1-40e3-a50b-e6ecc183e072 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:14.486126 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408bdad7-56d1-40e3-a50b-e6ecc183e072 None admin] PATH_INFO: `/v3/projects/3a8435696f504d709a504bf384af26ea` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:14.487330 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408bdad7-56d1-40e3-a50b-e6ecc183e072 None admin] RBAC: Authorizing `identity:get_project(project_id=3a8435696f504d709a504bf384af26ea)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:22:14.488913 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408bdad7-56d1-40e3-a50b-e6ecc183e072 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:22:14.491052 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 220/449] 10.222.0.23 () {56 vars in 1186 bytes} [Tue May 10 05:22:14 2022] GET /identity/v3/projects/3a8435696f504d709a504bf384af26ea => generated 344 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:22:14.497003 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408bdad7-56d1-40e3-a50b-e6ecc183e072 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:22:14.542224 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd6f7d2-0c50-4f10-b498-ce3d3b878110 None admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:22:14.580550 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3fc1f5-ed50-4be6-83a7-8841a854a124 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:22:14.581208 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3fc1f5-ed50-4be6-83a7-8841a854a124 None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:14.581490 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3fc1f5-ed50-4be6-83a7-8841a854a124 None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:14.581761 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3fc1f5-ed50-4be6-83a7-8841a854a124 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:14.599849 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408bdad7-56d1-40e3-a50b-e6ecc183e072 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:22:14.636182 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700140c9-67f8-4869-8dbe-cc21a9eb0896 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:22:14.637053 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700140c9-67f8-4869-8dbe-cc21a9eb0896 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:14.637496 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700140c9-67f8-4869-8dbe-cc21a9eb0896 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:14.637592 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700140c9-67f8-4869-8dbe-cc21a9eb0896 None admin] PATH_INFO: `/v3/groups/90faba46b0184513afa12ee7eee83e6f` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:14.638830 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700140c9-67f8-4869-8dbe-cc21a9eb0896 None admin] RBAC: Authorizing `identity:get_group(group_id=90faba46b0184513afa12ee7eee83e6f)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:22:14.640329 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700140c9-67f8-4869-8dbe-cc21a9eb0896 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:22:14.642034 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 221/450] 10.222.0.23 () {56 vars in 1180 bytes} [Tue May 10 05:22:14 2022] GET /identity/v3/groups/90faba46b0184513afa12ee7eee83e6f => generated 229 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 05:22:14.649202 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700140c9-67f8-4869-8dbe-cc21a9eb0896 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:22:14.657648 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3fc1f5-ed50-4be6-83a7-8841a854a124 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:22:14.659158 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3fc1f5-ed50-4be6-83a7-8841a854a124 None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:22:14.746239 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700140c9-67f8-4869-8dbe-cc21a9eb0896 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:22:14.768728 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 230/451] 10.222.0.23 () {58 vars in 1282 bytes} [Tue May 10 05:22:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 10 05:22:14.773720 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3fc1f5-ed50-4be6-83a7-8841a854a124 None admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:22:14.780841 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5da649-c1f9-4448-879e-20836043d64f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:22:14.781520 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5da649-c1f9-4448-879e-20836043d64f None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:14.781799 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5da649-c1f9-4448-879e-20836043d64f None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:14.782072 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5da649-c1f9-4448-879e-20836043d64f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:14.782909 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5da649-c1f9-4448-879e-20836043d64f None admin] RBAC: Adding query filter params (group.id=90faba46b0184513afa12ee7eee83e6f, role.id=199ac1dd842441d7913c6ee89d8fbecc, scope.project.id=3a8435696f504d709a504bf384af26ea) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:22:14.783220 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5da649-c1f9-4448-879e-20836043d64f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:22:14.784697 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5da649-c1f9-4448-879e-20836043d64f None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:22:14.791038 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 222/452] 10.222.0.23 () {56 vars in 1376 bytes} [Tue May 10 05:22:14 2022] GET /identity/v3/role_assignments?group.id=90faba46b0184513afa12ee7eee83e6f&scope.project.id=3a8435696f504d709a504bf384af26ea&role.id=199ac1dd842441d7913c6ee89d8fbecc => generated 611 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 05:22:14.878921 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3fc1f5-ed50-4be6-83a7-8841a854a124 None admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:22:14.915092 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504bfa62-07f7-40aa-a472-1b535d0f6716 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:22:14.916005 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504bfa62-07f7-40aa-a472-1b535d0f6716 None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:14.916277 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504bfa62-07f7-40aa-a472-1b535d0f6716 None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:14.916531 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504bfa62-07f7-40aa-a472-1b535d0f6716 None admin] PATH_INFO: `/v3/projects/c00aac4e3d244bf5a26814ed404a08f0` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:14.917788 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504bfa62-07f7-40aa-a472-1b535d0f6716 None admin] RBAC: Authorizing `identity:get_project(project_id=c00aac4e3d244bf5a26814ed404a08f0)` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:22:14.919301 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504bfa62-07f7-40aa-a472-1b535d0f6716 None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:22:14.921118 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 231/453] 10.222.0.23 () {56 vars in 1186 bytes} [Tue May 10 05:22:14 2022] GET /identity/v3/projects/c00aac4e3d244bf5a26814ed404a08f0 => generated 302 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:22:14.927179 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5da649-c1f9-4448-879e-20836043d64f None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:22:15.027128 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5da649-c1f9-4448-879e-20836043d64f None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:22:15.058497 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21aeda3-a6e5-44b0-b20a-43957eec2b95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:22:15.059362 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21aeda3-a6e5-44b0-b20a-43957eec2b95 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:15.059679 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21aeda3-a6e5-44b0-b20a-43957eec2b95 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:15.059956 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21aeda3-a6e5-44b0-b20a-43957eec2b95 None admin] PATH_INFO: `/v3/groups/b6631029d19d4604addb0ffd47e0d443` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:15.061158 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21aeda3-a6e5-44b0-b20a-43957eec2b95 None admin] RBAC: Authorizing `identity:get_group(group_id=b6631029d19d4604addb0ffd47e0d443)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:22:15.062601 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21aeda3-a6e5-44b0-b20a-43957eec2b95 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:22:15.064295 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 223/454] 10.222.0.23 () {56 vars in 1180 bytes} [Tue May 10 05:22:14 2022] GET /identity/v3/groups/b6631029d19d4604addb0ffd47e0d443 => generated 226 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:22:15.070611 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504bfa62-07f7-40aa-a472-1b535d0f6716 None admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:22:15.198492 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504bfa62-07f7-40aa-a472-1b535d0f6716 None admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:22:15.231849 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb984a7-1db2-4319-a741-3c3951364018 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:22:15.232494 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb984a7-1db2-4319-a741-3c3951364018 None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:15.232778 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb984a7-1db2-4319-a741-3c3951364018 None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:15.233014 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb984a7-1db2-4319-a741-3c3951364018 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:15.233874 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb984a7-1db2-4319-a741-3c3951364018 None admin] RBAC: Adding query filter params (group.id=b6631029d19d4604addb0ffd47e0d443, role.id=b0cb991ebc2d42d5a5de343c57086616, scope.project.id=c00aac4e3d244bf5a26814ed404a08f0) {{(pid=79879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:22:15.234183 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb984a7-1db2-4319-a741-3c3951364018 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:22:15.235617 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb984a7-1db2-4319-a741-3c3951364018 None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:22:15.241641 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 232/455] 10.222.0.23 () {56 vars in 1376 bytes} [Tue May 10 05:22:15 2022] GET /identity/v3/role_assignments?group.id=b6631029d19d4604addb0ffd47e0d443&scope.project.id=c00aac4e3d244bf5a26814ed404a08f0&role.id=b0cb991ebc2d42d5a5de343c57086616 => generated 611 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:22:18.105203 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3cf7d3-535b-4154-95bd-5a16c063af92 None None] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:18.105737 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3cf7d3-535b-4154-95bd-5a16c063af92 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:18.105737 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3cf7d3-535b-4154-95bd-5a16c063af92 None None] PATH_INFO: `/` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:18.107425 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 224/456] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 10 05:22:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 05:22:18.112803 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5eb150f-df6e-49f0-aad9-cb5bb0bde6cf None None] REQUEST_METHOD: `POST` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:18.113222 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5eb150f-df6e-49f0-aad9-cb5bb0bde6cf None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:18.113391 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5eb150f-df6e-49f0-aad9-cb5bb0bde6cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:18.132229 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.auth.core [None req-f5eb150f-df6e-49f0-aad9-cb5bb0bde6cf None None] MFA Rules not processed for user `44883b22532e44049d846938dc2cf423`. Rule list: `[]` (Enabled: `True`). {{(pid=79879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:22:18.133807 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-f5eb150f-df6e-49f0-aad9-cb5bb0bde6cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:22:18.206513 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 233/457] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 10 05:22:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 05:22:18.254648 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3cf7d3-535b-4154-95bd-5a16c063af92 None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:22:18.350844 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9946096d-3239-4dfa-a806-0b991c39f0e2 None None] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:18.351478 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9946096d-3239-4dfa-a806-0b991c39f0e2 None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:18.352032 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9946096d-3239-4dfa-a806-0b991c39f0e2 None None] PATH_INFO: `/` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:18.353837 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 234/458] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 10 05:22:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 05:22:18.359423 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a778e4c-4ac4-4b27-81ae-4528efd28ce7 None None] REQUEST_METHOD: `POST` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:18.359659 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a778e4c-4ac4-4b27-81ae-4528efd28ce7 None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:18.359936 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a778e4c-4ac4-4b27-81ae-4528efd28ce7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:18.380759 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3cf7d3-535b-4154-95bd-5a16c063af92 None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:22:18.396616 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.auth.core [None req-9a778e4c-4ac4-4b27-81ae-4528efd28ce7 None None] MFA Rules not processed for user `44883b22532e44049d846938dc2cf423`. Rule list: `[]` (Enabled: `True`). {{(pid=79879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:22:18.397819 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-9a778e4c-4ac4-4b27-81ae-4528efd28ce7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:22:18.414678 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c4e8ac-f299-4f05-98ff-ddb1a59ce0c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:22:18.415486 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c4e8ac-f299-4f05-98ff-ddb1a59ce0c5 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:18.415797 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c4e8ac-f299-4f05-98ff-ddb1a59ce0c5 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:18.416078 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c4e8ac-f299-4f05-98ff-ddb1a59ce0c5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:18.426047 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c4e8ac-f299-4f05-98ff-ddb1a59ce0c5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:22:18.427611 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c4e8ac-f299-4f05-98ff-ddb1a59ce0c5 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:22:18.445174 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application [None req-b3c4e8ac-f299-4f05-98ff-ddb1a59ce0c5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 05:22:18.445174 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 05:22:18.445174 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 05:22:18.445174 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 05:22:18.445174 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 05:22:18.445174 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 05:22:18.445174 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 05:22:18.445174 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 05:22:18.445174 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 05:22:18.445174 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 05:22:18.445174 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 05:22:18.445174 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 05:22:18.445174 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 05:22:18.445174 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 05:22:18.445174 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 05:22:18.446195 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 05:22:18.446195 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 05:22:18.446195 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 05:22:18.446195 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 05:22:18.446195 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 05:22:18.446195 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 05:22:18.446195 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.get_or_create( May 10 05:22:18.446195 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 05:22:18.446195 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application with Lock( May 10 05:22:18.446195 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 05:22:18.446195 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._enter() May 10 05:22:18.446195 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 05:22:18.446195 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 05:22:18.446195 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 05:22:18.446195 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.creator() May 10 05:22:18.446195 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 05:22:18.446195 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application created_value = creator( May 10 05:22:18.447047 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 05:22:18.447047 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 05:22:18.447047 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 05:22:18.447047 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application May 10 05:22:18.447047 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 225/459] 10.222.0.23 () {56 vars in 1108 bytes} [Tue May 10 05:22:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 05:22:18.452410 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c4e8ac-f299-4f05-98ff-ddb1a59ce0c5 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:22:18.565544 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c4e8ac-f299-4f05-98ff-ddb1a59ce0c5 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:22:18.572517 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 235/460] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 10 05:22:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 05:22:18.574864 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b1d38e-6fbf-4c43-bd2b-afab8f195fd9 None None] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:18.575371 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b1d38e-6fbf-4c43-bd2b-afab8f195fd9 None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:18.575880 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b1d38e-6fbf-4c43-bd2b-afab8f195fd9 None None] PATH_INFO: `/` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:18.578007 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 236/461] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 10 05:22:18 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 05:22:18.587609 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80be19b3-add8-49e2-b750-ea5d08600d11 None None] REQUEST_METHOD: `POST` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:18.587609 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80be19b3-add8-49e2-b750-ea5d08600d11 None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:18.587609 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80be19b3-add8-49e2-b750-ea5d08600d11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:18.610527 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.auth.core [None req-80be19b3-add8-49e2-b750-ea5d08600d11 None None] MFA Rules not processed for user `44883b22532e44049d846938dc2cf423`. Rule list: `[]` (Enabled: `True`). {{(pid=79879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:22:18.611702 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-80be19b3-add8-49e2-b750-ea5d08600d11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:22:18.615885 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bbf422-f016-4431-a969-a17770a0c7d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:22:18.616822 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bbf422-f016-4431-a969-a17770a0c7d9 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:18.617298 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bbf422-f016-4431-a969-a17770a0c7d9 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:18.617782 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bbf422-f016-4431-a969-a17770a0c7d9 None admin] PATH_INFO: `/v3/domains` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:18.618718 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bbf422-f016-4431-a969-a17770a0c7d9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:22:18.619605 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bbf422-f016-4431-a969-a17770a0c7d9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:22:18.621932 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bbf422-f016-4431-a969-a17770a0c7d9 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:22:18.637341 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 226/462] 10.222.0.23 () {56 vars in 1109 bytes} [Tue May 10 05:22:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:22:18.642290 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bbf422-f016-4431-a969-a17770a0c7d9 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:22:18.693386 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 237/463] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 10 05:22:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 05:22:18.694573 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80be19b3-add8-49e2-b750-ea5d08600d11 None None] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:22:18.737474 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bbf422-f016-4431-a969-a17770a0c7d9 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:22:18.771346 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d5753f-914e-4206-8dfb-d26af27e11a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:22:18.772370 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d5753f-914e-4206-8dfb-d26af27e11a8 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:18.772750 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d5753f-914e-4206-8dfb-d26af27e11a8 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:18.773123 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d5753f-914e-4206-8dfb-d26af27e11a8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:18.785917 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d5753f-914e-4206-8dfb-d26af27e11a8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:22:18.787380 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d5753f-914e-4206-8dfb-d26af27e11a8 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:22:18.804518 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application [None req-f7d5753f-914e-4206-8dfb-d26af27e11a8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 05:22:18.804518 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 05:22:18.804518 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 05:22:18.804518 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 05:22:18.804518 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 05:22:18.804518 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 05:22:18.804518 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 05:22:18.804518 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 05:22:18.804518 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 05:22:18.804518 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 05:22:18.804518 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 05:22:18.804518 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 05:22:18.804518 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 05:22:18.804518 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 05:22:18.804518 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 05:22:18.805600 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 05:22:18.805600 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 05:22:18.805600 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 05:22:18.805600 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 05:22:18.805600 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 05:22:18.805600 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 05:22:18.805600 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.get_or_create( May 10 05:22:18.805600 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 05:22:18.805600 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application with Lock( May 10 05:22:18.805600 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 05:22:18.805600 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._enter() May 10 05:22:18.805600 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 05:22:18.805600 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 05:22:18.805600 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 05:22:18.805600 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.creator() May 10 05:22:18.805600 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 05:22:18.805600 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application created_value = creator( May 10 05:22:18.806704 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 05:22:18.806704 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 05:22:18.806704 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 05:22:18.806704 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application May 10 05:22:18.806704 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 227/464] 10.222.0.23 () {56 vars in 1108 bytes} [Tue May 10 05:22:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 05:22:18.807106 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d5753f-914e-4206-8dfb-d26af27e11a8 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:22:18.809784 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80be19b3-add8-49e2-b750-ea5d08600d11 None None] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:22:18.848432 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30dba379-1387-4d0c-84fb-bf8e0295aac3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:22:18.849381 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dba379-1387-4d0c-84fb-bf8e0295aac3 None admin] REQUEST_METHOD: `POST` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:18.849668 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dba379-1387-4d0c-84fb-bf8e0295aac3 None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:18.849942 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dba379-1387-4d0c-84fb-bf8e0295aac3 None admin] PATH_INFO: `/v3/users` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:18.850809 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30dba379-1387-4d0c-84fb-bf8e0295aac3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:22:18.852918 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30dba379-1387-4d0c-84fb-bf8e0295aac3 None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:22:18.883693 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 238/465] 10.222.0.23 () {60 vars in 1132 bytes} [Tue May 10 05:22:18 2022] POST /identity/v3/users => generated 246 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 05:22:18.883693 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fbdfa1-da7e-4590-97c6-d0891e3784da None None] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:18.883693 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fbdfa1-da7e-4590-97c6-d0891e3784da None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:18.883693 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fbdfa1-da7e-4590-97c6-d0891e3784da None None] PATH_INFO: `/` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:18.883693 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 239/466] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 10 05:22:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 05:22:18.883693 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fbdfa1-da7e-4590-97c6-d0891e3784da None None] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:22:18.916849 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d5753f-914e-4206-8dfb-d26af27e11a8 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:22:18.961474 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a77572-e8f0-4d4b-b17a-f86bb53e673d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:22:18.962843 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a77572-e8f0-4d4b-b17a-f86bb53e673d None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:18.963270 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a77572-e8f0-4d4b-b17a-f86bb53e673d None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:18.963915 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a77572-e8f0-4d4b-b17a-f86bb53e673d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:18.979187 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a77572-e8f0-4d4b-b17a-f86bb53e673d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:22:18.980966 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a77572-e8f0-4d4b-b17a-f86bb53e673d None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:22:19.003848 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application [None req-b6a77572-e8f0-4d4b-b17a-f86bb53e673d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 05:22:19.003848 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 05:22:19.003848 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 05:22:19.003848 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 05:22:19.003848 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 05:22:19.003848 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 05:22:19.003848 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 05:22:19.003848 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 05:22:19.003848 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 05:22:19.003848 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 05:22:19.003848 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 05:22:19.003848 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 05:22:19.003848 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 05:22:19.003848 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 05:22:19.003848 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 05:22:19.004881 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 05:22:19.004881 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 05:22:19.004881 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 05:22:19.004881 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 05:22:19.004881 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 05:22:19.004881 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 05:22:19.004881 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.get_or_create( May 10 05:22:19.004881 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 05:22:19.004881 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application with Lock( May 10 05:22:19.004881 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 05:22:19.004881 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._enter() May 10 05:22:19.004881 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 05:22:19.004881 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 05:22:19.004881 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 05:22:19.004881 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.creator() May 10 05:22:19.004881 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 05:22:19.004881 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application created_value = creator( May 10 05:22:19.005707 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 05:22:19.005707 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 05:22:19.005707 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 05:22:19.005707 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application May 10 05:22:19.013089 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 228/467] 10.222.0.23 () {56 vars in 1108 bytes} [Tue May 10 05:22:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 05:22:19.013275 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e26e11-54c6-4a16-8bca-d77e0793be85 None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:19.013967 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e26e11-54c6-4a16-8bca-d77e0793be85 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:19.013967 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e26e11-54c6-4a16-8bca-d77e0793be85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:19.023713 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fbdfa1-da7e-4590-97c6-d0891e3784da None None] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:22:19.036498 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-58e26e11-54c6-4a16-8bca-d77e0793be85 None None] MFA Rules not processed for user `44883b22532e44049d846938dc2cf423`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:22:19.038431 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-58e26e11-54c6-4a16-8bca-d77e0793be85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:22:19.064932 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19fdcc1-c262-4822-82d8-a7d0a648043d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:22:19.065967 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19fdcc1-c262-4822-82d8-a7d0a648043d None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:19.066462 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19fdcc1-c262-4822-82d8-a7d0a648043d None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:19.067011 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19fdcc1-c262-4822-82d8-a7d0a648043d None admin] PATH_INFO: `/v3/domains` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:19.067791 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19fdcc1-c262-4822-82d8-a7d0a648043d None admin] RBAC: Adding query filter params (name=Default) {{(pid=79879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:22:19.068105 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19fdcc1-c262-4822-82d8-a7d0a648043d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:22:19.069492 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19fdcc1-c262-4822-82d8-a7d0a648043d None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:22:19.083495 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 240/468] 10.222.0.23 () {56 vars in 1109 bytes} [Tue May 10 05:22:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:22:19.084435 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19fdcc1-c262-4822-82d8-a7d0a648043d None admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:22:19.125794 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 229/469] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 10 05:22:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 05:22:19.125794 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e26e11-54c6-4a16-8bca-d77e0793be85 None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:22:19.208670 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19fdcc1-c262-4822-82d8-a7d0a648043d None admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:22:19.250034 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a95a317-238e-4d54-b161-48b375660d7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:22:19.250858 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e26e11-54c6-4a16-8bca-d77e0793be85 None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:22:19.251149 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a95a317-238e-4d54-b161-48b375660d7b None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:19.251598 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a95a317-238e-4d54-b161-48b375660d7b None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:19.252014 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a95a317-238e-4d54-b161-48b375660d7b None admin] PATH_INFO: `/v3/domains` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:19.252929 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a95a317-238e-4d54-b161-48b375660d7b None admin] RBAC: Adding query filter params (name=Default) {{(pid=79879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:22:19.253437 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a95a317-238e-4d54-b161-48b375660d7b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:22:19.255121 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a95a317-238e-4d54-b161-48b375660d7b None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:22:19.267879 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 241/470] 10.222.0.23 () {56 vars in 1109 bytes} [Tue May 10 05:22:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:22:19.269167 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a95a317-238e-4d54-b161-48b375660d7b None admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:22:19.292198 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0370fc-4e8d-44d0-838a-b418d933b7ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:22:19.292886 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0370fc-4e8d-44d0-838a-b418d933b7ca None admin] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:19.293167 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0370fc-4e8d-44d0-838a-b418d933b7ca None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:19.293439 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0370fc-4e8d-44d0-838a-b418d933b7ca None admin] PATH_INFO: `/v3/users` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:19.294160 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0370fc-4e8d-44d0-838a-b418d933b7ca None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:22:19.296085 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0370fc-4e8d-44d0-838a-b418d933b7ca None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:22:19.323875 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 230/471] 10.222.0.23 () {60 vars in 1132 bytes} [Tue May 10 05:22:19 2022] POST /identity/v3/users => generated 248 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 05:22:19.324740 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0370fc-4e8d-44d0-838a-b418d933b7ca None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:22:19.382114 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a95a317-238e-4d54-b161-48b375660d7b None admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:22:19.438138 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b48517-75be-4544-9afb-46232b25e24d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:22:19.440097 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b48517-75be-4544-9afb-46232b25e24d None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:19.441497 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b48517-75be-4544-9afb-46232b25e24d None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:19.442163 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b48517-75be-4544-9afb-46232b25e24d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:19.464160 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b48517-75be-4544-9afb-46232b25e24d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:22:19.466744 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b48517-75be-4544-9afb-46232b25e24d None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:22:19.482934 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0370fc-4e8d-44d0-838a-b418d933b7ca None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:22:19.497088 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application [None req-e2b48517-75be-4544-9afb-46232b25e24d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 05:22:19.497088 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 05:22:19.497088 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 05:22:19.497088 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 05:22:19.497088 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 05:22:19.497088 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 05:22:19.497088 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 05:22:19.497088 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 05:22:19.497088 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 05:22:19.497088 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 05:22:19.497088 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 05:22:19.497088 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 05:22:19.497088 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 05:22:19.497088 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 05:22:19.497088 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 05:22:19.498011 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 05:22:19.498011 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 05:22:19.498011 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 05:22:19.498011 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 05:22:19.498011 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 05:22:19.498011 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 05:22:19.498011 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.get_or_create( May 10 05:22:19.498011 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 05:22:19.498011 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application with Lock( May 10 05:22:19.498011 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 05:22:19.498011 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self._enter() May 10 05:22:19.498011 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 05:22:19.498011 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 05:22:19.498011 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 05:22:19.498011 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.creator() May 10 05:22:19.498011 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 05:22:19.498011 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application created_value = creator( May 10 05:22:19.498928 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 05:22:19.498928 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 05:22:19.498928 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 05:22:19.498928 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application May 10 05:22:19.499596 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 242/472] 10.222.0.23 () {56 vars in 1108 bytes} [Tue May 10 05:22:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 05:22:19.500846 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a14f0db-1129-45db-9394-5d6b4ded55a2 None None] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:19.501137 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a14f0db-1129-45db-9394-5d6b4ded55a2 None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:19.501412 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a14f0db-1129-45db-9394-5d6b4ded55a2 None None] PATH_INFO: `/` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:19.503068 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 243/473] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 10 05:22:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 05:22:19.508164 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a14f0db-1129-45db-9394-5d6b4ded55a2 None None] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:22:19.527921 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90627a1-8d06-48c9-ba2a-929027ae33c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:22:19.529041 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90627a1-8d06-48c9-ba2a-929027ae33c1 None admin] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:19.529516 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90627a1-8d06-48c9-ba2a-929027ae33c1 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:19.529997 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90627a1-8d06-48c9-ba2a-929027ae33c1 None admin] PATH_INFO: `/v3/users` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:19.530914 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90627a1-8d06-48c9-ba2a-929027ae33c1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:22:19.532654 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90627a1-8d06-48c9-ba2a-929027ae33c1 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:22:19.558344 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 231/474] 10.222.0.23 () {60 vars in 1132 bytes} [Tue May 10 05:22:19 2022] POST /identity/v3/users => generated 248 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 05:22:19.565075 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6bef1c-a220-4fbe-8697-42dac5ce50a3 None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:19.565831 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6bef1c-a220-4fbe-8697-42dac5ce50a3 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:19.566320 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6bef1c-a220-4fbe-8697-42dac5ce50a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:19.588344 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-cc6bef1c-a220-4fbe-8697-42dac5ce50a3 None None] MFA Rules not processed for user `44883b22532e44049d846938dc2cf423`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:22:19.589935 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-cc6bef1c-a220-4fbe-8697-42dac5ce50a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:22:19.617953 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a14f0db-1129-45db-9394-5d6b4ded55a2 None None] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:22:19.654660 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b765f4-5d60-424c-8454-cb06c5caf43a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:22:19.655340 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b765f4-5d60-424c-8454-cb06c5caf43a None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:19.655639 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b765f4-5d60-424c-8454-cb06c5caf43a None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:19.655913 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b765f4-5d60-424c-8454-cb06c5caf43a None admin] PATH_INFO: `/v3/domains` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:19.656702 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b765f4-5d60-424c-8454-cb06c5caf43a None admin] RBAC: Adding query filter params (name=Default) {{(pid=79879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:22:19.657015 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b765f4-5d60-424c-8454-cb06c5caf43a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:22:19.658575 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b765f4-5d60-424c-8454-cb06c5caf43a None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:22:19.669232 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 232/475] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 10 05:22:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 05:22:19.674265 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 244/476] 10.222.0.23 () {56 vars in 1109 bytes} [Tue May 10 05:22:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:22:19.679707 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6bef1c-a220-4fbe-8697-42dac5ce50a3 None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:22:19.692643 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b765f4-5d60-424c-8454-cb06c5caf43a None admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:22:19.795496 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6bef1c-a220-4fbe-8697-42dac5ce50a3 None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:22:19.821971 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b765f4-5d60-424c-8454-cb06c5caf43a None admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:22:19.837961 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a41da9-b2c9-40fc-9f00-318e218c572a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:22:19.838893 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a41da9-b2c9-40fc-9f00-318e218c572a None admin] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:19.839342 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a41da9-b2c9-40fc-9f00-318e218c572a None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:19.840220 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a41da9-b2c9-40fc-9f00-318e218c572a None admin] PATH_INFO: `/v3/users` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:19.841849 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a41da9-b2c9-40fc-9f00-318e218c572a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:22:19.842551 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a41da9-b2c9-40fc-9f00-318e218c572a None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:22:19.864584 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3fd6e9-5a89-4286-93b5-56552254b00d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:22:19.865297 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3fd6e9-5a89-4286-93b5-56552254b00d None admin] REQUEST_METHOD: `POST` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:19.865574 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3fd6e9-5a89-4286-93b5-56552254b00d None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:19.865844 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3fd6e9-5a89-4286-93b5-56552254b00d None admin] PATH_INFO: `/v3/roles` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:19.866603 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3fd6e9-5a89-4286-93b5-56552254b00d None admin] RBAC: Authorizing `identity:create_role()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:22:19.868167 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 233/477] 10.222.0.23 () {60 vars in 1132 bytes} [Tue May 10 05:22:19 2022] POST /identity/v3/users => generated 249 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 05:22:19.868303 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3fd6e9-5a89-4286-93b5-56552254b00d None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:22:19.878016 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.sql.core [None req-fd3fd6e9-5a89-4286-93b5-56552254b00d None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 10 05:22:19.878016 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] May 10 05:22:19.878016 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [parameters: {'id': '1523155eca4d4c97bf45be0b675d9357', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] May 10 05:22:19.878016 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=79879) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 10 05:22:19.900790 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application [None req-fd3fd6e9-5a89-4286-93b5-56552254b00d None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. May 10 05:22:19.900790 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 05:22:19.900790 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 10 05:22:19.900790 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application self.dialect.do_execute( May 10 05:22:19.900790 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 10 05:22:19.900790 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 10 05:22:19.900790 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 10 05:22:19.900790 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application result = self._query(query) May 10 05:22:19.900790 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 10 05:22:19.900790 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application conn.query(q) May 10 05:22:19.900790 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 10 05:22:19.900790 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 10 05:22:19.900790 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 10 05:22:19.900790 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application result.read() May 10 05:22:19.900790 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 10 05:22:19.901921 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 10 05:22:19.901921 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 10 05:22:19.901921 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application packet.raise_for_error() May 10 05:22:19.901921 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 10 05:22:19.901921 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 10 05:22:19.901921 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 10 05:22:19.901921 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 10 05:22:19.901921 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 10 05:22:19.901921 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application May 10 05:22:19.901921 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 10 05:22:19.901921 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application May 10 05:22:19.901921 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 05:22:19.901921 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 10 05:22:19.901921 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 10 05:22:19.901921 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role May 10 05:22:19.901921 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return ref.to_dict() May 10 05:22:19.901921 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 10 05:22:19.901921 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application next(self.gen) May 10 05:22:19.903060 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 10 05:22:19.903060 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application yield resource May 10 05:22:19.903060 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 10 05:22:19.903060 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application next(self.gen) May 10 05:22:19.903060 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 10 05:22:19.903060 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application self.session.rollback() May 10 05:22:19.903060 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 10 05:22:19.903060 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application self.force_reraise() May 10 05:22:19.903060 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 10 05:22:19.903060 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application raise self.value May 10 05:22:19.903060 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 10 05:22:19.903060 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 10 05:22:19.903060 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 10 05:22:19.903060 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application session.commit() May 10 05:22:19.903060 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 10 05:22:19.903060 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 10 05:22:19.903060 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 10 05:22:19.904408 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application self._prepare_impl() May 10 05:22:19.904408 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 10 05:22:19.904408 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application self.session.flush() May 10 05:22:19.904408 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 10 05:22:19.904408 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application self._flush(objects) May 10 05:22:19.904408 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 10 05:22:19.904408 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 10 05:22:19.904408 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 10 05:22:19.904408 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application compat.raise_( May 10 05:22:19.904408 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 10 05:22:19.904408 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application raise exception May 10 05:22:19.904408 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 10 05:22:19.904408 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application flush_context.execute() May 10 05:22:19.904408 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 10 05:22:19.904408 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application rec.execute(self) May 10 05:22:19.904408 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 10 05:22:19.904408 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 10 05:22:19.905327 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 10 05:22:19.905327 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application _emit_insert_statements( May 10 05:22:19.905327 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements May 10 05:22:19.905327 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application c = connection._execute_20( May 10 05:22:19.905327 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 10 05:22:19.905327 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 10 05:22:19.905327 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 10 05:22:19.905327 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 10 05:22:19.905327 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 10 05:22:19.905327 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application ret = self._execute_context( May 10 05:22:19.905327 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 10 05:22:19.905327 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 10 05:22:19.905327 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 10 05:22:19.905327 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 10 05:22:19.905327 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 10 05:22:19.905327 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application raise exception May 10 05:22:19.906133 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 10 05:22:19.906133 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application self.dialect.do_execute( May 10 05:22:19.906133 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 10 05:22:19.906133 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 10 05:22:19.906133 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 10 05:22:19.906133 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application result = self._query(query) May 10 05:22:19.906133 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 10 05:22:19.906133 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application conn.query(q) May 10 05:22:19.906133 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 10 05:22:19.906133 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 10 05:22:19.906133 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 10 05:22:19.906133 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application result.read() May 10 05:22:19.906133 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 10 05:22:19.906133 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 10 05:22:19.906133 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 10 05:22:19.906133 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application packet.raise_for_error() May 10 05:22:19.906952 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 10 05:22:19.906952 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 10 05:22:19.906952 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 10 05:22:19.906952 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 10 05:22:19.906952 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 10 05:22:19.906952 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] May 10 05:22:19.906952 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application [parameters: {'id': '1523155eca4d4c97bf45be0b675d9357', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] May 10 05:22:19.906952 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 10 05:22:19.906952 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application May 10 05:22:19.906952 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 05:22:19.906952 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application May 10 05:22:19.906952 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 05:22:19.906952 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 05:22:19.906952 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 05:22:19.906952 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 05:22:19.906952 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 05:22:19.907823 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 05:22:19.907823 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 05:22:19.907823 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 05:22:19.907823 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 05:22:19.907823 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 05:22:19.907823 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 05:22:19.907823 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post May 10 05:22:19.907823 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( May 10 05:22:19.907823 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 05:22:19.907823 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 05:22:19.907823 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role May 10 05:22:19.907823 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) May 10 05:22:19.907823 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 10 05:22:19.907823 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 10 05:22:19.907823 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. May 10 05:22:19.907823 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application May 10 05:22:19.908675 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 245/478] 10.222.0.23 () {60 vars in 1131 bytes} [Tue May 10 05:22:19 2022] POST /identity/v3/roles => generated 144 bytes in 211 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) May 10 05:22:19.912783 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a41da9-b2c9-40fc-9f00-318e218c572a None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:22:20.023635 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a41da9-b2c9-40fc-9f00-318e218c572a None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:22:20.059599 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2020220-9b73-4401-b9f6-eefa76a4b742 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:22:20.060380 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2020220-9b73-4401-b9f6-eefa76a4b742 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:20.060664 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2020220-9b73-4401-b9f6-eefa76a4b742 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:20.060946 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2020220-9b73-4401-b9f6-eefa76a4b742 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:20.072623 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2020220-9b73-4401-b9f6-eefa76a4b742 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 05:22:20.081693 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application [None req-d2020220-9b73-4401-b9f6-eefa76a4b742 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 10 05:22:20.081693 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 05:22:20.081693 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 05:22:20.081693 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 05:22:20.081693 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 05:22:20.081693 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 05:22:20.081693 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 05:22:20.081693 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 05:22:20.081693 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 05:22:20.081693 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 05:22:20.081693 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 05:22:20.081693 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 05:22:20.081693 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 05:22:20.081693 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 05:22:20.081693 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 05:22:20.081693 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 05:22:20.083453 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 05:22:20.083453 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 05:22:20.083453 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 05:22:20.083453 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 05:22:20.083453 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 05:22:20.083453 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 05:22:20.083453 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 05:22:20.083453 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 05:22:20.083453 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 05:22:20.083453 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.get_or_create( May 10 05:22:20.083453 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 05:22:20.083453 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application with Lock( May 10 05:22:20.083453 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 05:22:20.083453 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._enter() May 10 05:22:20.083453 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 05:22:20.083453 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 05:22:20.084660 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 05:22:20.084660 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.creator() May 10 05:22:20.084660 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 05:22:20.084660 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application created_value = creator( May 10 05:22:20.084660 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 05:22:20.084660 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 05:22:20.084660 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 05:22:20.084660 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 05:22:20.084660 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 05:22:20.084660 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 05:22:20.084660 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 10 05:22:20.084660 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application May 10 05:22:20.084660 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 234/479] 10.222.0.23 () {56 vars in 1114 bytes} [Tue May 10 05:22:19 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 05:22:20.088061 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3fd6e9-5a89-4286-93b5-56552254b00d None admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:22:20.213966 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3fd6e9-5a89-4286-93b5-56552254b00d None admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:22:20.256459 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bb18b8-4a60-437d-ae50-78dea3b67e4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:22:20.257148 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bb18b8-4a60-437d-ae50-78dea3b67e4b None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:20.257430 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bb18b8-4a60-437d-ae50-78dea3b67e4b None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:20.257704 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bb18b8-4a60-437d-ae50-78dea3b67e4b None admin] PATH_INFO: `/v3/roles` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:20.258468 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2bb18b8-4a60-437d-ae50-78dea3b67e4b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:22:20.258775 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2bb18b8-4a60-437d-ae50-78dea3b67e4b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:22:20.260327 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2bb18b8-4a60-437d-ae50-78dea3b67e4b None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:22:20.270533 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 246/480] 10.222.0.23 () {56 vars in 1111 bytes} [Tue May 10 05:22:20 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 05:22:21.458589 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e97284d-4442-4f66-abe9-542d828043ce None None] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:21.459666 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e97284d-4442-4f66-abe9-542d828043ce None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:21.460194 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e97284d-4442-4f66-abe9-542d828043ce None None] PATH_INFO: `/` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:21.462050 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 235/481] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 10 05:22:21 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 05:22:21.478207 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e921e3a8-5850-474c-8fb3-3a322852dc0d None None] REQUEST_METHOD: `POST` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:21.479160 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e921e3a8-5850-474c-8fb3-3a322852dc0d None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:21.479663 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e921e3a8-5850-474c-8fb3-3a322852dc0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:21.500550 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.auth.core [None req-e921e3a8-5850-474c-8fb3-3a322852dc0d None None] MFA Rules not processed for user `44883b22532e44049d846938dc2cf423`. Rule list: `[]` (Enabled: `True`). {{(pid=79879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:22:21.502074 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-e921e3a8-5850-474c-8fb3-3a322852dc0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:22:21.592092 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 247/482] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 10 05:22:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 05:22:21.635216 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e97284d-4442-4f66-abe9-542d828043ce None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:22:21.753299 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e97284d-4442-4f66-abe9-542d828043ce None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:22:21.795163 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d70a7f4-41bc-4d7e-9204-02754733784e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:22:21.796359 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d70a7f4-41bc-4d7e-9204-02754733784e None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:21.796846 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d70a7f4-41bc-4d7e-9204-02754733784e None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:21.797309 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d70a7f4-41bc-4d7e-9204-02754733784e None admin] PATH_INFO: `/v3/roles/service` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:21.813435 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d70a7f4-41bc-4d7e-9204-02754733784e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 05:22:21.828612 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application [None req-7d70a7f4-41bc-4d7e-9204-02754733784e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 10 05:22:21.828612 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 05:22:21.828612 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 05:22:21.828612 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 05:22:21.828612 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 05:22:21.828612 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 05:22:21.828612 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 05:22:21.828612 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 05:22:21.828612 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 05:22:21.828612 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 05:22:21.828612 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 05:22:21.828612 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 05:22:21.828612 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 05:22:21.828612 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 05:22:21.828612 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 05:22:21.828612 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 05:22:21.829562 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 05:22:21.829562 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 05:22:21.829562 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 05:22:21.829562 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 05:22:21.829562 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 05:22:21.829562 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 05:22:21.829562 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 05:22:21.829562 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 05:22:21.829562 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 05:22:21.829562 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.get_or_create( May 10 05:22:21.829562 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 05:22:21.829562 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application with Lock( May 10 05:22:21.829562 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 05:22:21.829562 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._enter() May 10 05:22:21.829562 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 05:22:21.829562 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 05:22:21.830389 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 05:22:21.830389 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.creator() May 10 05:22:21.830389 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 05:22:21.830389 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application created_value = creator( May 10 05:22:21.830389 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 05:22:21.830389 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 05:22:21.830389 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 05:22:21.830389 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 05:22:21.830389 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 05:22:21.830389 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 05:22:21.830389 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 10 05:22:21.830389 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application May 10 05:22:21.833370 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 236/483] 10.222.0.23 () {56 vars in 1102 bytes} [Tue May 10 05:22:21 2022] GET /identity/v3/roles/service => generated 85 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 05:22:21.838841 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e921e3a8-5850-474c-8fb3-3a322852dc0d None None] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:22:21.966119 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e921e3a8-5850-474c-8fb3-3a322852dc0d None None] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:22:22.012693 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a469f6-96d1-4ec8-a54d-971bcb562f47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:22:22.013284 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a469f6-96d1-4ec8-a54d-971bcb562f47 None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:22.013559 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a469f6-96d1-4ec8-a54d-971bcb562f47 None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:22.013827 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a469f6-96d1-4ec8-a54d-971bcb562f47 None admin] PATH_INFO: `/v3/roles` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:22.014588 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a469f6-96d1-4ec8-a54d-971bcb562f47 None admin] RBAC: Adding query filter params (name=service) {{(pid=79879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:22:22.014889 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a469f6-96d1-4ec8-a54d-971bcb562f47 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:22:22.020421 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a469f6-96d1-4ec8-a54d-971bcb562f47 None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:22:22.029307 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 248/484] 10.222.0.23 () {56 vars in 1103 bytes} [Tue May 10 05:22:21 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:22:22.034537 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d70a7f4-41bc-4d7e-9204-02754733784e None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:22:22.212256 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d70a7f4-41bc-4d7e-9204-02754733784e None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:22:22.253862 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb86e10-f458-41d8-ad7e-2a42d6238af5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:22:22.254791 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb86e10-f458-41d8-ad7e-2a42d6238af5 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:22.255067 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb86e10-f458-41d8-ad7e-2a42d6238af5 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:22.255335 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb86e10-f458-41d8-ad7e-2a42d6238af5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:22.272766 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb86e10-f458-41d8-ad7e-2a42d6238af5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:22:22.274176 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb86e10-f458-41d8-ad7e-2a42d6238af5 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:22:22.294911 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application [None req-9bb86e10-f458-41d8-ad7e-2a42d6238af5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 05:22:22.294911 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 05:22:22.294911 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 05:22:22.294911 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 05:22:22.294911 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 05:22:22.294911 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 05:22:22.294911 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 05:22:22.294911 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 05:22:22.294911 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 05:22:22.294911 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 05:22:22.294911 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 05:22:22.294911 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 05:22:22.294911 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 05:22:22.294911 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 05:22:22.294911 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 05:22:22.295930 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 05:22:22.295930 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 05:22:22.295930 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 05:22:22.295930 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 05:22:22.295930 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 05:22:22.295930 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 05:22:22.295930 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.get_or_create( May 10 05:22:22.295930 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 05:22:22.295930 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application with Lock( May 10 05:22:22.295930 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 05:22:22.295930 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._enter() May 10 05:22:22.295930 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 05:22:22.295930 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 05:22:22.295930 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 05:22:22.295930 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.creator() May 10 05:22:22.295930 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 05:22:22.295930 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application created_value = creator( May 10 05:22:22.296793 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 05:22:22.296793 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 05:22:22.296793 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 05:22:22.296793 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application May 10 05:22:22.296793 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 237/485] 10.222.0.23 () {56 vars in 1108 bytes} [Tue May 10 05:22:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 05:22:22.302131 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a469f6-96d1-4ec8-a54d-971bcb562f47 None admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:22:22.421974 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a469f6-96d1-4ec8-a54d-971bcb562f47 None admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:22:22.454524 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f4d99f-2d80-4261-a97b-5afde84b28ea None None] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:22.454524 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f4d99f-2d80-4261-a97b-5afde84b28ea None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:22.454524 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f4d99f-2d80-4261-a97b-5afde84b28ea None None] PATH_INFO: `/` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:22.454524 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 238/486] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 10 05:22:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 05:22:22.460463 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a50d63d-921f-4934-b15f-5e50856d4e1c None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:22.461015 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a50d63d-921f-4934-b15f-5e50856d4e1c None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:22.461015 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a50d63d-921f-4934-b15f-5e50856d4e1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:22.465288 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998afbbe-41ce-413d-8920-c059bfabf9b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:22:22.465288 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998afbbe-41ce-413d-8920-c059bfabf9b1 None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:22.465519 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998afbbe-41ce-413d-8920-c059bfabf9b1 None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:22.465702 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998afbbe-41ce-413d-8920-c059bfabf9b1 None admin] PATH_INFO: `/v3/domains` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:22.468659 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998afbbe-41ce-413d-8920-c059bfabf9b1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:22:22.468659 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998afbbe-41ce-413d-8920-c059bfabf9b1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:22:22.468659 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998afbbe-41ce-413d-8920-c059bfabf9b1 None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:22:22.481260 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 249/487] 10.222.0.23 () {56 vars in 1109 bytes} [Tue May 10 05:22:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:22:22.489150 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998afbbe-41ce-413d-8920-c059bfabf9b1 None admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:22:22.508666 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-0a50d63d-921f-4934-b15f-5e50856d4e1c None None] MFA Rules not processed for user `44883b22532e44049d846938dc2cf423`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:22:22.510076 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-0a50d63d-921f-4934-b15f-5e50856d4e1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:22:22.590262 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998afbbe-41ce-413d-8920-c059bfabf9b1 None admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:22:22.603326 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 239/488] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 10 05:22:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 05:22:22.604799 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1a0b8c-cb3e-4ca1-bf87-6224567408cb None None] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:22.605094 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1a0b8c-cb3e-4ca1-bf87-6224567408cb None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:22.605375 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1a0b8c-cb3e-4ca1-bf87-6224567408cb None None] PATH_INFO: `/` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:22.606926 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 240/489] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 10 05:22:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 05:22:22.617941 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f48557-86ed-4021-93d8-ddcb3cb6ce20 None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:22.618225 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f48557-86ed-4021-93d8-ddcb3cb6ce20 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:22.618504 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f48557-86ed-4021-93d8-ddcb3cb6ce20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:22.639880 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-83f48557-86ed-4021-93d8-ddcb3cb6ce20 None None] MFA Rules not processed for user `44883b22532e44049d846938dc2cf423`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:22:22.641079 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-83f48557-86ed-4021-93d8-ddcb3cb6ce20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:22:22.642078 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261151a5-9ffe-4f17-b5ef-4d9c96982a45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:22:22.642891 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261151a5-9ffe-4f17-b5ef-4d9c96982a45 None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:22.643170 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261151a5-9ffe-4f17-b5ef-4d9c96982a45 None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:22.643444 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261151a5-9ffe-4f17-b5ef-4d9c96982a45 None admin] PATH_INFO: `/v3/users/nova` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:22.650890 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261151a5-9ffe-4f17-b5ef-4d9c96982a45 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:22:22.652383 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261151a5-9ffe-4f17-b5ef-4d9c96982a45 None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:22:22.668170 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application [None req-261151a5-9ffe-4f17-b5ef-4d9c96982a45 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 10 05:22:22.668170 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 05:22:22.668170 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 05:22:22.668170 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 05:22:22.668170 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 05:22:22.668170 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 05:22:22.668170 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 05:22:22.668170 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 05:22:22.668170 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 05:22:22.668170 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 05:22:22.668170 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 05:22:22.668170 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 05:22:22.668170 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 05:22:22.668170 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 05:22:22.668170 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 05:22:22.668170 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 05:22:22.670269 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 05:22:22.670269 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 05:22:22.670269 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 05:22:22.670269 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 05:22:22.670269 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 05:22:22.670269 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 05:22:22.670269 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 05:22:22.670269 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 05:22:22.670269 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 05:22:22.670269 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.get_or_create( May 10 05:22:22.670269 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 05:22:22.670269 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application with Lock( May 10 05:22:22.670269 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 05:22:22.670269 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self._enter() May 10 05:22:22.670269 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 05:22:22.670269 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 05:22:22.670269 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 05:22:22.670269 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.creator() May 10 05:22:22.672365 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 05:22:22.672365 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application created_value = creator( May 10 05:22:22.672365 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 05:22:22.672365 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 05:22:22.672365 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 05:22:22.672365 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 05:22:22.672365 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 05:22:22.672365 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 05:22:22.672365 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 10 05:22:22.672365 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application May 10 05:22:22.672365 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 250/490] 10.222.0.23 () {56 vars in 1093 bytes} [Tue May 10 05:22:22 2022] GET /identity/v3/users/nova => generated 82 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 05:22:22.672365 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261151a5-9ffe-4f17-b5ef-4d9c96982a45 None admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:22:22.711842 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 241/491] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 10 05:22:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 05:22:22.712769 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f48557-86ed-4021-93d8-ddcb3cb6ce20 None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:22:22.768630 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261151a5-9ffe-4f17-b5ef-4d9c96982a45 None admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:22:22.801637 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbde86a-8d1f-4ad6-8a49-0cf679a30dc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:22:22.802447 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbde86a-8d1f-4ad6-8a49-0cf679a30dc0 None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:22.802730 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbde86a-8d1f-4ad6-8a49-0cf679a30dc0 None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:22.803005 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbde86a-8d1f-4ad6-8a49-0cf679a30dc0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:22.812919 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbde86a-8d1f-4ad6-8a49-0cf679a30dc0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 05:22:22.820823 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application [None req-dbbde86a-8d1f-4ad6-8a49-0cf679a30dc0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 10 05:22:22.820823 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 05:22:22.820823 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 05:22:22.820823 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 05:22:22.820823 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 05:22:22.820823 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 05:22:22.820823 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 05:22:22.820823 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 05:22:22.820823 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 05:22:22.820823 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 05:22:22.820823 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 05:22:22.820823 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 05:22:22.820823 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 05:22:22.820823 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 05:22:22.820823 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 05:22:22.820823 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 05:22:22.821709 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 05:22:22.821709 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 05:22:22.821709 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 05:22:22.821709 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 05:22:22.821709 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 05:22:22.821709 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 05:22:22.821709 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 05:22:22.821709 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 05:22:22.821709 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 05:22:22.821709 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.get_or_create( May 10 05:22:22.821709 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 05:22:22.821709 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application with Lock( May 10 05:22:22.821709 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 05:22:22.821709 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self._enter() May 10 05:22:22.821709 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 05:22:22.821709 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 05:22:22.822494 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 05:22:22.822494 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.creator() May 10 05:22:22.822494 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 05:22:22.822494 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application created_value = creator( May 10 05:22:22.822494 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 05:22:22.822494 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 05:22:22.822494 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 05:22:22.822494 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 05:22:22.822494 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 05:22:22.822494 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 05:22:22.822494 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 10 05:22:22.822494 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application May 10 05:22:22.822494 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 251/492] 10.222.0.23 () {56 vars in 1102 bytes} [Tue May 10 05:22:22 2022] GET /identity/v3/roles/service => generated 85 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 05:22:22.823484 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bc6c3a-df15-4897-9f87-e0bd521de444 None None] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:22.823642 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bc6c3a-df15-4897-9f87-e0bd521de444 None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:22.823921 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bc6c3a-df15-4897-9f87-e0bd521de444 None None] PATH_INFO: `/` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:22.827617 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 252/493] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 10 05:22:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 05:22:22.827617 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bc6c3a-df15-4897-9f87-e0bd521de444 None None] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:22:22.838114 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f48557-86ed-4021-93d8-ddcb3cb6ce20 None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:22:22.876021 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c692f544-6603-4887-a2e3-a6edb292c93e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:22:22.877012 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c692f544-6603-4887-a2e3-a6edb292c93e None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:22.877291 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c692f544-6603-4887-a2e3-a6edb292c93e None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:22.877564 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c692f544-6603-4887-a2e3-a6edb292c93e None admin] PATH_INFO: `/v3/users` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:22.878420 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c692f544-6603-4887-a2e3-a6edb292c93e None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:22:22.878717 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c692f544-6603-4887-a2e3-a6edb292c93e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:22:22.880229 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c692f544-6603-4887-a2e3-a6edb292c93e None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:22:22.915650 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 242/494] 10.222.0.23 () {56 vars in 1133 bytes} [Tue May 10 05:22:22 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:22:22.916309 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c692f544-6603-4887-a2e3-a6edb292c93e None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:22:22.926384 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bc6c3a-df15-4897-9f87-e0bd521de444 None None] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:22:22.958471 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb4e60b-399b-4eb9-a938-4c4c89d6edfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:22:22.959368 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb4e60b-399b-4eb9-a938-4c4c89d6edfb None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:22.959677 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb4e60b-399b-4eb9-a938-4c4c89d6edfb None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:22.959957 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb4e60b-399b-4eb9-a938-4c4c89d6edfb None admin] PATH_INFO: `/v3/roles/service` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:22.971055 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb4e60b-399b-4eb9-a938-4c4c89d6edfb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 05:22:22.978894 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application [None req-bfb4e60b-399b-4eb9-a938-4c4c89d6edfb None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 10 05:22:22.978894 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 05:22:22.978894 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 05:22:22.978894 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 05:22:22.978894 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 05:22:22.978894 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 05:22:22.978894 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 05:22:22.978894 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 05:22:22.978894 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 05:22:22.978894 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 05:22:22.978894 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 05:22:22.978894 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 05:22:22.978894 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 05:22:22.978894 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 05:22:22.978894 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 05:22:22.978894 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 05:22:22.979813 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 05:22:22.979813 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 05:22:22.979813 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 05:22:22.979813 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 05:22:22.979813 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 05:22:22.979813 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 05:22:22.979813 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 05:22:22.979813 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 05:22:22.979813 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 05:22:22.979813 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.get_or_create( May 10 05:22:22.979813 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 05:22:22.979813 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application with Lock( May 10 05:22:22.979813 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 05:22:22.979813 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self._enter() May 10 05:22:22.979813 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 05:22:22.979813 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 05:22:22.980620 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 05:22:22.980620 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.creator() May 10 05:22:22.980620 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 05:22:22.980620 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application created_value = creator( May 10 05:22:22.980620 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 05:22:22.980620 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 05:22:22.980620 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 05:22:22.980620 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 05:22:22.980620 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 05:22:22.980620 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 05:22:22.980620 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 10 05:22:22.980620 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application May 10 05:22:22.980620 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 253/495] 10.222.0.23 () {56 vars in 1102 bytes} [Tue May 10 05:22:22 2022] GET /identity/v3/roles/service => generated 85 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 05:22:22.981761 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbb82b4-7926-4cca-8762-4faa138cbc95 None None] REQUEST_METHOD: `POST` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:22.981761 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbb82b4-7926-4cca-8762-4faa138cbc95 None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:22.981916 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbb82b4-7926-4cca-8762-4faa138cbc95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:23.000443 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.auth.core [None req-afbb82b4-7926-4cca-8762-4faa138cbc95 None None] MFA Rules not processed for user `44883b22532e44049d846938dc2cf423`. Rule list: `[]` (Enabled: `True`). {{(pid=79879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:22:23.001638 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-afbb82b4-7926-4cca-8762-4faa138cbc95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:22:23.017819 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c692f544-6603-4887-a2e3-a6edb292c93e None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:22:23.055743 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c47b819-f172-454d-a3bf-b9957102994c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:22:23.056453 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c47b819-f172-454d-a3bf-b9957102994c None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:23.056733 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c47b819-f172-454d-a3bf-b9957102994c None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:23.056993 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c47b819-f172-454d-a3bf-b9957102994c None admin] PATH_INFO: `/v3/roles` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:23.057749 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c47b819-f172-454d-a3bf-b9957102994c None admin] RBAC: Adding query filter params (name=service) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:22:23.058049 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c47b819-f172-454d-a3bf-b9957102994c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:22:23.059455 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c47b819-f172-454d-a3bf-b9957102994c None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:22:23.072900 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 243/496] 10.222.0.23 () {56 vars in 1103 bytes} [Tue May 10 05:22:22 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:22:23.073069 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 254/497] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 10 05:22:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 05:22:23.073069 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbb82b4-7926-4cca-8762-4faa138cbc95 None None] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:22:23.075917 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c47b819-f172-454d-a3bf-b9957102994c None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:22:23.171810 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c47b819-f172-454d-a3bf-b9957102994c None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:22:23.178738 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbb82b4-7926-4cca-8762-4faa138cbc95 None None] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:22:23.205382 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c04413-447e-4622-8fe9-fe8debd3d50a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:22:23.206036 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c04413-447e-4622-8fe9-fe8debd3d50a None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:23.206320 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c04413-447e-4622-8fe9-fe8debd3d50a None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:23.206587 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c04413-447e-4622-8fe9-fe8debd3d50a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:23.211413 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580a8d5b-328b-49b9-8aef-b1aa9ff7565b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:22:23.212139 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580a8d5b-328b-49b9-8aef-b1aa9ff7565b None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:23.212410 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580a8d5b-328b-49b9-8aef-b1aa9ff7565b None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:23.212683 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580a8d5b-328b-49b9-8aef-b1aa9ff7565b None admin] PATH_INFO: `/v3/roles` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:23.213430 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580a8d5b-328b-49b9-8aef-b1aa9ff7565b None admin] RBAC: Adding query filter params (name=service) {{(pid=79879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:22:23.213731 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580a8d5b-328b-49b9-8aef-b1aa9ff7565b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:22:23.215127 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580a8d5b-328b-49b9-8aef-b1aa9ff7565b None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:22:23.222841 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 255/498] 10.222.0.23 () {56 vars in 1103 bytes} [Tue May 10 05:22:23 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:22:23.223672 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580a8d5b-328b-49b9-8aef-b1aa9ff7565b None admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:22:23.269888 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c04413-447e-4622-8fe9-fe8debd3d50a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:22:23.271376 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c04413-447e-4622-8fe9-fe8debd3d50a None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:22:23.316568 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580a8d5b-328b-49b9-8aef-b1aa9ff7565b None admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:22:23.349188 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3f3b46-d048-4304-851d-b72ff5603252 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:22:23.349966 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3f3b46-d048-4304-851d-b72ff5603252 None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:23.350237 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3f3b46-d048-4304-851d-b72ff5603252 None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:23.350502 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3f3b46-d048-4304-851d-b72ff5603252 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:23.360605 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3f3b46-d048-4304-851d-b72ff5603252 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:22:23.362040 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3f3b46-d048-4304-851d-b72ff5603252 None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:22:23.367523 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 244/499] 10.222.0.23 () {58 vars in 1282 bytes} [Tue May 10 05:22:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 05:22:23.368377 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c04413-447e-4622-8fe9-fe8debd3d50a None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:22:23.378732 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application [None req-fc3f3b46-d048-4304-851d-b72ff5603252 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 05:22:23.378732 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 05:22:23.378732 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 05:22:23.378732 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 05:22:23.378732 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 05:22:23.378732 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 05:22:23.378732 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 05:22:23.378732 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 05:22:23.378732 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 05:22:23.378732 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 05:22:23.378732 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 05:22:23.378732 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 05:22:23.378732 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 05:22:23.378732 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 05:22:23.378732 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 05:22:23.379716 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 05:22:23.379716 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 05:22:23.379716 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 05:22:23.379716 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 05:22:23.379716 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 05:22:23.379716 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 05:22:23.379716 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.get_or_create( May 10 05:22:23.379716 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 05:22:23.379716 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application with Lock( May 10 05:22:23.379716 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 05:22:23.379716 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self._enter() May 10 05:22:23.379716 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 05:22:23.379716 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 05:22:23.379716 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 05:22:23.379716 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.creator() May 10 05:22:23.379716 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 05:22:23.379716 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application created_value = creator( May 10 05:22:23.380755 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 05:22:23.380755 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 05:22:23.380755 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 05:22:23.380755 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application May 10 05:22:23.380755 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 256/500] 10.222.0.23 () {56 vars in 1108 bytes} [Tue May 10 05:22:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 05:22:23.381402 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84259ff-e4dd-40d6-9400-797c4af43d31 None None] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:23.381477 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84259ff-e4dd-40d6-9400-797c4af43d31 None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:23.381717 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84259ff-e4dd-40d6-9400-797c4af43d31 None None] PATH_INFO: `/` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:23.383101 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 257/501] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 10 05:22:23 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 05:22:23.384213 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84259ff-e4dd-40d6-9400-797c4af43d31 None None] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:22:23.471186 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c04413-447e-4622-8fe9-fe8debd3d50a None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:22:23.482434 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84259ff-e4dd-40d6-9400-797c4af43d31 None None] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:22:23.506921 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ea3fca-2bd1-455d-8f86-a3acdbe80f0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:22:23.507758 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ea3fca-2bd1-455d-8f86-a3acdbe80f0f None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:23.508039 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ea3fca-2bd1-455d-8f86-a3acdbe80f0f None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:23.508309 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ea3fca-2bd1-455d-8f86-a3acdbe80f0f None admin] PATH_INFO: `/v3/roles/service` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:23.513991 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafe00ce-7d60-417d-9d19-70e36801011a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:22:23.514777 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafe00ce-7d60-417d-9d19-70e36801011a None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:23.515058 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafe00ce-7d60-417d-9d19-70e36801011a None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:23.515331 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafe00ce-7d60-417d-9d19-70e36801011a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:23.518039 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ea3fca-2bd1-455d-8f86-a3acdbe80f0f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 05:22:23.525822 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application [None req-d6ea3fca-2bd1-455d-8f86-a3acdbe80f0f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 10 05:22:23.525822 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 05:22:23.525822 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 05:22:23.525822 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 05:22:23.525822 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 05:22:23.525822 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 05:22:23.525822 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 05:22:23.525822 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 05:22:23.525822 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 05:22:23.525822 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 05:22:23.525822 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 05:22:23.525822 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 05:22:23.525822 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 05:22:23.525822 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 05:22:23.525822 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 05:22:23.525822 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 05:22:23.526805 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 05:22:23.526805 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 05:22:23.526805 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 05:22:23.526805 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 05:22:23.526805 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 05:22:23.526805 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 05:22:23.526805 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 05:22:23.526805 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 05:22:23.526805 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 05:22:23.526805 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.get_or_create( May 10 05:22:23.526805 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 05:22:23.526805 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application with Lock( May 10 05:22:23.526805 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 05:22:23.526805 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._enter() May 10 05:22:23.526805 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 05:22:23.526805 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 05:22:23.527634 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 05:22:23.527634 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.creator() May 10 05:22:23.527634 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 05:22:23.527634 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application created_value = creator( May 10 05:22:23.527634 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 05:22:23.527634 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 05:22:23.527634 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 05:22:23.527634 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 05:22:23.527634 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 05:22:23.527634 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 05:22:23.527634 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 10 05:22:23.527634 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application May 10 05:22:23.528241 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aafe00ce-7d60-417d-9d19-70e36801011a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:22:23.528310 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 245/502] 10.222.0.23 () {56 vars in 1102 bytes} [Tue May 10 05:22:23 2022] GET /identity/v3/roles/service => generated 85 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 05:22:23.528310 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ea3fca-2bd1-455d-8f86-a3acdbe80f0f None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:22:23.528426 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aafe00ce-7d60-417d-9d19-70e36801011a None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:22:23.545878 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application [None req-aafe00ce-7d60-417d-9d19-70e36801011a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 05:22:23.545878 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 05:22:23.545878 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 05:22:23.545878 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 05:22:23.545878 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 05:22:23.545878 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 05:22:23.545878 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 05:22:23.545878 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 05:22:23.545878 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 05:22:23.545878 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 05:22:23.545878 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 05:22:23.545878 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 05:22:23.545878 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 05:22:23.545878 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 05:22:23.545878 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 05:22:23.546926 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 05:22:23.546926 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 05:22:23.546926 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 05:22:23.546926 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 05:22:23.546926 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 05:22:23.546926 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 05:22:23.546926 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.get_or_create( May 10 05:22:23.546926 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 05:22:23.546926 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application with Lock( May 10 05:22:23.546926 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 05:22:23.546926 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self._enter() May 10 05:22:23.546926 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 05:22:23.546926 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 05:22:23.546926 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 05:22:23.546926 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.creator() May 10 05:22:23.546926 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 05:22:23.546926 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application created_value = creator( May 10 05:22:23.552515 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 05:22:23.552515 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 05:22:23.552515 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 05:22:23.552515 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application May 10 05:22:23.552515 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 258/503] 10.222.0.23 () {56 vars in 1108 bytes} [Tue May 10 05:22:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 05:22:23.552515 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafe00ce-7d60-417d-9d19-70e36801011a None admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:22:23.622000 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ea3fca-2bd1-455d-8f86-a3acdbe80f0f None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:22:23.646529 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafe00ce-7d60-417d-9d19-70e36801011a None admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:22:23.654326 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe80cb17-5e53-46c0-8730-897ee224dc0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:22:23.655136 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe80cb17-5e53-46c0-8730-897ee224dc0e None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:23.655409 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe80cb17-5e53-46c0-8730-897ee224dc0e None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:23.655710 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe80cb17-5e53-46c0-8730-897ee224dc0e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:23.665828 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe80cb17-5e53-46c0-8730-897ee224dc0e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:22:23.667292 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe80cb17-5e53-46c0-8730-897ee224dc0e None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:22:23.679274 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b700c7a-7409-447d-a383-66e277270c04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:22:23.679949 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b700c7a-7409-447d-a383-66e277270c04 None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:23.680231 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b700c7a-7409-447d-a383-66e277270c04 None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:23.680508 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b700c7a-7409-447d-a383-66e277270c04 None admin] PATH_INFO: `/v3/domains` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:23.681237 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b700c7a-7409-447d-a383-66e277270c04 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:22:23.681535 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b700c7a-7409-447d-a383-66e277270c04 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:22:23.682907 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b700c7a-7409-447d-a383-66e277270c04 None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:22:23.683689 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application [None req-fe80cb17-5e53-46c0-8730-897ee224dc0e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 05:22:23.683689 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 05:22:23.683689 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 05:22:23.683689 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 05:22:23.683689 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 05:22:23.683689 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 05:22:23.683689 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 05:22:23.683689 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 05:22:23.683689 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 05:22:23.683689 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 05:22:23.683689 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 05:22:23.683689 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 05:22:23.683689 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 05:22:23.683689 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 05:22:23.683689 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 05:22:23.684552 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 05:22:23.684552 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 05:22:23.684552 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 05:22:23.684552 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 05:22:23.684552 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 05:22:23.684552 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 05:22:23.684552 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.get_or_create( May 10 05:22:23.684552 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 05:22:23.684552 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application with Lock( May 10 05:22:23.684552 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 05:22:23.684552 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._enter() May 10 05:22:23.684552 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 05:22:23.684552 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 05:22:23.684552 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 05:22:23.684552 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.creator() May 10 05:22:23.684552 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 05:22:23.684552 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application created_value = creator( May 10 05:22:23.685787 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 05:22:23.685787 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 05:22:23.685787 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 05:22:23.685787 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application May 10 05:22:23.685787 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 246/504] 10.222.0.23 () {56 vars in 1108 bytes} [Tue May 10 05:22:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 05:22:23.686222 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d80ee3-e75a-4299-adec-1b3079c8b6bd None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:23.686222 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d80ee3-e75a-4299-adec-1b3079c8b6bd None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:23.686528 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d80ee3-e75a-4299-adec-1b3079c8b6bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:23.697123 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 259/505] 10.222.0.23 () {56 vars in 1109 bytes} [Tue May 10 05:22:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:22:23.697864 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b700c7a-7409-447d-a383-66e277270c04 None admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:22:23.702372 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-50d80ee3-e75a-4299-adec-1b3079c8b6bd None None] MFA Rules not processed for user `44883b22532e44049d846938dc2cf423`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:22:23.703606 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-50d80ee3-e75a-4299-adec-1b3079c8b6bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:22:23.767026 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 247/506] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 10 05:22:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 05:22:23.767775 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d80ee3-e75a-4299-adec-1b3079c8b6bd None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:22:23.796193 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b700c7a-7409-447d-a383-66e277270c04 None admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:22:23.830465 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab65587-7272-4191-986a-da2633918565 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:22:23.831227 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab65587-7272-4191-986a-da2633918565 None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:23.831507 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab65587-7272-4191-986a-da2633918565 None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:23.831817 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab65587-7272-4191-986a-da2633918565 None admin] PATH_INFO: `/v3/roles` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:23.832769 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab65587-7272-4191-986a-da2633918565 None admin] RBAC: Adding query filter params (name=service) {{(pid=79879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:22:23.833073 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab65587-7272-4191-986a-da2633918565 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:22:23.834465 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab65587-7272-4191-986a-da2633918565 None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:22:23.842113 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 260/507] 10.222.0.23 () {56 vars in 1103 bytes} [Tue May 10 05:22:23 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:22:23.842881 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab65587-7272-4191-986a-da2633918565 None admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:22:23.857751 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d80ee3-e75a-4299-adec-1b3079c8b6bd None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:22:23.891098 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d80f994-34f5-41bf-868a-9121abd28912 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:22:23.891794 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d80f994-34f5-41bf-868a-9121abd28912 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:23.892078 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d80f994-34f5-41bf-868a-9121abd28912 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:23.892350 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d80f994-34f5-41bf-868a-9121abd28912 None admin] PATH_INFO: `/v3/domains` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:23.893081 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d80f994-34f5-41bf-868a-9121abd28912 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:22:23.893385 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d80f994-34f5-41bf-868a-9121abd28912 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:22:23.894773 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d80f994-34f5-41bf-868a-9121abd28912 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:22:23.905439 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 248/508] 10.222.0.23 () {56 vars in 1109 bytes} [Tue May 10 05:22:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:22:23.905439 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d80f994-34f5-41bf-868a-9121abd28912 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:22:23.941472 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab65587-7272-4191-986a-da2633918565 None admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:22:23.975458 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c84900-1534-4af7-8795-51f15a0ade58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:22:23.976157 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c84900-1534-4af7-8795-51f15a0ade58 None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:23.976437 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c84900-1534-4af7-8795-51f15a0ade58 None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:23.976710 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c84900-1534-4af7-8795-51f15a0ade58 None admin] PATH_INFO: `/v3/domains` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:23.977437 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c84900-1534-4af7-8795-51f15a0ade58 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:22:23.977750 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c84900-1534-4af7-8795-51f15a0ade58 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:22:23.979109 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c84900-1534-4af7-8795-51f15a0ade58 None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:22:23.991624 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 261/509] 10.222.0.23 () {56 vars in 1109 bytes} [Tue May 10 05:22:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:22:23.992296 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c84900-1534-4af7-8795-51f15a0ade58 None admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:22:24.005065 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d80f994-34f5-41bf-868a-9121abd28912 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:22:24.036931 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0296a888-b37a-4d61-90ab-6b5b9c942670 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:22:24.037677 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0296a888-b37a-4d61-90ab-6b5b9c942670 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:24.037967 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0296a888-b37a-4d61-90ab-6b5b9c942670 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:24.038246 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0296a888-b37a-4d61-90ab-6b5b9c942670 None admin] PATH_INFO: `/v3/users/glance` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:24.045555 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0296a888-b37a-4d61-90ab-6b5b9c942670 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:22:24.047007 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0296a888-b37a-4d61-90ab-6b5b9c942670 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:22:24.061940 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application [None req-0296a888-b37a-4d61-90ab-6b5b9c942670 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 10 05:22:24.061940 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 05:22:24.061940 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 05:22:24.061940 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 05:22:24.061940 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 05:22:24.061940 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 05:22:24.061940 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 05:22:24.061940 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 05:22:24.061940 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 05:22:24.061940 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 05:22:24.061940 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 05:22:24.061940 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 05:22:24.061940 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 05:22:24.061940 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 05:22:24.061940 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 05:22:24.061940 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 05:22:24.062869 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 05:22:24.062869 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 05:22:24.062869 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 05:22:24.062869 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 05:22:24.062869 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 05:22:24.062869 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 05:22:24.062869 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 05:22:24.062869 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 05:22:24.062869 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 05:22:24.062869 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.get_or_create( May 10 05:22:24.062869 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 05:22:24.062869 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application with Lock( May 10 05:22:24.062869 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 05:22:24.062869 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._enter() May 10 05:22:24.062869 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 05:22:24.062869 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 05:22:24.062869 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 05:22:24.062869 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.creator() May 10 05:22:24.064038 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 05:22:24.064038 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application created_value = creator( May 10 05:22:24.064038 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 05:22:24.064038 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 05:22:24.064038 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 05:22:24.064038 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 05:22:24.064038 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 05:22:24.064038 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 05:22:24.064038 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 10 05:22:24.064038 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application May 10 05:22:24.064038 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 249/510] 10.222.0.23 () {56 vars in 1099 bytes} [Tue May 10 05:22:23 2022] GET /identity/v3/users/glance => generated 84 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 05:22:24.064603 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0296a888-b37a-4d61-90ab-6b5b9c942670 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:22:24.090477 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c84900-1534-4af7-8795-51f15a0ade58 None admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:22:24.124392 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40baf9e3-85d4-4373-9816-95d02c36cd7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:22:24.125168 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40baf9e3-85d4-4373-9816-95d02c36cd7e None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:24.125451 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40baf9e3-85d4-4373-9816-95d02c36cd7e None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:24.125725 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40baf9e3-85d4-4373-9816-95d02c36cd7e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:24.135511 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40baf9e3-85d4-4373-9816-95d02c36cd7e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:22:24.136996 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40baf9e3-85d4-4373-9816-95d02c36cd7e None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:22:24.153918 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application [None req-40baf9e3-85d4-4373-9816-95d02c36cd7e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 05:22:24.153918 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 05:22:24.153918 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 05:22:24.153918 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 05:22:24.153918 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 05:22:24.153918 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 05:22:24.153918 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 05:22:24.153918 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 05:22:24.153918 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 05:22:24.153918 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 05:22:24.153918 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 05:22:24.153918 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 05:22:24.153918 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 05:22:24.153918 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 05:22:24.153918 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 05:22:24.154878 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 05:22:24.154878 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 05:22:24.154878 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 05:22:24.154878 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 05:22:24.154878 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 05:22:24.154878 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 05:22:24.154878 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.get_or_create( May 10 05:22:24.154878 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 05:22:24.154878 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application with Lock( May 10 05:22:24.154878 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 05:22:24.154878 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self._enter() May 10 05:22:24.154878 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 05:22:24.154878 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 05:22:24.154878 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 05:22:24.154878 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.creator() May 10 05:22:24.154878 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 05:22:24.154878 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application created_value = creator( May 10 05:22:24.155909 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 05:22:24.155909 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 05:22:24.155909 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 05:22:24.155909 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application May 10 05:22:24.155909 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 262/511] 10.222.0.23 () {56 vars in 1108 bytes} [Tue May 10 05:22:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 05:22:24.155909 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40baf9e3-85d4-4373-9816-95d02c36cd7e None admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:22:24.160910 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0296a888-b37a-4d61-90ab-6b5b9c942670 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:22:24.193696 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2bd361-f5b1-4983-8323-cd2f6e901272 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:22:24.194560 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2bd361-f5b1-4983-8323-cd2f6e901272 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:24.194835 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2bd361-f5b1-4983-8323-cd2f6e901272 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:24.195136 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2bd361-f5b1-4983-8323-cd2f6e901272 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:24.205273 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2bd361-f5b1-4983-8323-cd2f6e901272 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:22:24.206737 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2bd361-f5b1-4983-8323-cd2f6e901272 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:22:24.223223 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application [None req-5f2bd361-f5b1-4983-8323-cd2f6e901272 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 05:22:24.223223 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 05:22:24.223223 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 05:22:24.223223 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 05:22:24.223223 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 05:22:24.223223 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 05:22:24.223223 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 05:22:24.223223 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 05:22:24.223223 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 05:22:24.223223 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 05:22:24.223223 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 05:22:24.223223 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 05:22:24.223223 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 05:22:24.223223 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 05:22:24.223223 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 05:22:24.224133 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 05:22:24.224133 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 05:22:24.224133 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 05:22:24.224133 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 05:22:24.224133 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 05:22:24.224133 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 05:22:24.224133 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.get_or_create( May 10 05:22:24.224133 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 05:22:24.224133 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application with Lock( May 10 05:22:24.224133 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 05:22:24.224133 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._enter() May 10 05:22:24.224133 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 05:22:24.224133 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 05:22:24.224133 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 05:22:24.224133 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.creator() May 10 05:22:24.224133 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 05:22:24.224133 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application created_value = creator( May 10 05:22:24.224982 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 05:22:24.224982 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 05:22:24.224982 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 05:22:24.224982 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application May 10 05:22:24.224982 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 250/512] 10.222.0.23 () {56 vars in 1108 bytes} [Tue May 10 05:22:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 05:22:24.225250 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2bd361-f5b1-4983-8323-cd2f6e901272 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:22:24.257653 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40baf9e3-85d4-4373-9816-95d02c36cd7e None admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:22:24.290179 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f212a8-ff93-4901-b6c8-56b9b8a60de6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:22:24.290976 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f212a8-ff93-4901-b6c8-56b9b8a60de6 None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:24.291246 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f212a8-ff93-4901-b6c8-56b9b8a60de6 None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:24.291519 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f212a8-ff93-4901-b6c8-56b9b8a60de6 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:24.298492 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f212a8-ff93-4901-b6c8-56b9b8a60de6 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:22:24.299977 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f212a8-ff93-4901-b6c8-56b9b8a60de6 None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:22:24.314187 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application [None req-96f212a8-ff93-4901-b6c8-56b9b8a60de6 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 10 05:22:24.314187 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 05:22:24.314187 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 05:22:24.314187 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 05:22:24.314187 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 05:22:24.314187 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 05:22:24.314187 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 05:22:24.314187 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 05:22:24.314187 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 05:22:24.314187 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 05:22:24.314187 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 05:22:24.314187 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 05:22:24.314187 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 05:22:24.314187 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 05:22:24.314187 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 05:22:24.314187 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 05:22:24.315167 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 05:22:24.315167 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 05:22:24.315167 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 05:22:24.315167 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 05:22:24.315167 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 05:22:24.315167 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 05:22:24.315167 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 05:22:24.315167 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 05:22:24.315167 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 05:22:24.315167 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.get_or_create( May 10 05:22:24.315167 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 05:22:24.315167 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application with Lock( May 10 05:22:24.315167 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 05:22:24.315167 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self._enter() May 10 05:22:24.315167 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 05:22:24.315167 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 05:22:24.315167 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 05:22:24.315167 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.creator() May 10 05:22:24.316249 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 05:22:24.316249 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application created_value = creator( May 10 05:22:24.316249 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 05:22:24.316249 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 05:22:24.316249 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 05:22:24.316249 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 05:22:24.316249 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 05:22:24.316249 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 05:22:24.316249 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 10 05:22:24.316249 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application May 10 05:22:24.316249 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 263/513] 10.222.0.23 () {56 vars in 1099 bytes} [Tue May 10 05:22:24 2022] GET /identity/v3/users/cinder => generated 84 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 05:22:24.317182 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f212a8-ff93-4901-b6c8-56b9b8a60de6 None admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:22:24.327594 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2bd361-f5b1-4983-8323-cd2f6e901272 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:22:24.359342 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9accf36-af8f-41d9-8fcf-e3bee79ad145 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:22:24.360163 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9accf36-af8f-41d9-8fcf-e3bee79ad145 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:24.360445 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9accf36-af8f-41d9-8fcf-e3bee79ad145 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:24.360716 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9accf36-af8f-41d9-8fcf-e3bee79ad145 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:24.367245 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9accf36-af8f-41d9-8fcf-e3bee79ad145 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:22:24.368738 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9accf36-af8f-41d9-8fcf-e3bee79ad145 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:22:24.383548 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application [None req-f9accf36-af8f-41d9-8fcf-e3bee79ad145 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 05:22:24.383548 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 05:22:24.383548 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 05:22:24.383548 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 05:22:24.383548 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 05:22:24.383548 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 05:22:24.383548 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 05:22:24.383548 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 05:22:24.383548 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 05:22:24.383548 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 05:22:24.383548 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 05:22:24.383548 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 05:22:24.383548 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 05:22:24.383548 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 05:22:24.383548 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 05:22:24.384543 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 05:22:24.384543 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 05:22:24.384543 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 05:22:24.384543 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 05:22:24.384543 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 05:22:24.384543 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 05:22:24.384543 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.get_or_create( May 10 05:22:24.384543 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 05:22:24.384543 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application with Lock( May 10 05:22:24.384543 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 05:22:24.384543 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._enter() May 10 05:22:24.384543 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 05:22:24.384543 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 05:22:24.384543 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 05:22:24.384543 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.creator() May 10 05:22:24.384543 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 05:22:24.384543 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application created_value = creator( May 10 05:22:24.385441 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 05:22:24.385441 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 05:22:24.385441 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 05:22:24.385441 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 05:22:24.385441 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 05:22:24.385441 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 05:22:24.385441 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 05:22:24.385441 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application May 10 05:22:24.385441 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 251/514] 10.222.0.23 () {56 vars in 1111 bytes} [Tue May 10 05:22:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 05:22:24.385903 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9accf36-af8f-41d9-8fcf-e3bee79ad145 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:22:24.419523 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f212a8-ff93-4901-b6c8-56b9b8a60de6 None admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:22:24.454481 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea95e5c-512d-4466-b9a9-6f29441b7593 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:22:24.455149 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea95e5c-512d-4466-b9a9-6f29441b7593 None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:24.455428 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea95e5c-512d-4466-b9a9-6f29441b7593 None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:24.455716 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea95e5c-512d-4466-b9a9-6f29441b7593 None admin] PATH_INFO: `/v3/users` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:24.456565 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea95e5c-512d-4466-b9a9-6f29441b7593 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=79879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:22:24.456870 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea95e5c-512d-4466-b9a9-6f29441b7593 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:22:24.458491 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea95e5c-512d-4466-b9a9-6f29441b7593 None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:22:24.489481 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9accf36-af8f-41d9-8fcf-e3bee79ad145 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:22:24.498099 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 264/515] 10.222.0.23 () {56 vars in 1137 bytes} [Tue May 10 05:22:24 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:22:24.499104 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea95e5c-512d-4466-b9a9-6f29441b7593 None admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:22:24.524705 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae39e128-7310-48c7-bfc5-d4eaca40ccd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:22:24.525369 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae39e128-7310-48c7-bfc5-d4eaca40ccd4 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:24.525647 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae39e128-7310-48c7-bfc5-d4eaca40ccd4 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:24.525912 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae39e128-7310-48c7-bfc5-d4eaca40ccd4 None admin] PATH_INFO: `/v3/domains` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:24.526634 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae39e128-7310-48c7-bfc5-d4eaca40ccd4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:22:24.526956 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae39e128-7310-48c7-bfc5-d4eaca40ccd4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:22:24.528354 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae39e128-7310-48c7-bfc5-d4eaca40ccd4 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:22:24.539157 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 252/516] 10.222.0.23 () {56 vars in 1109 bytes} [Tue May 10 05:22:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:22:24.539979 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae39e128-7310-48c7-bfc5-d4eaca40ccd4 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:22:24.592645 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea95e5c-512d-4466-b9a9-6f29441b7593 None admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:22:24.626151 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17ae5a7-5e30-4ad9-b944-6832cb4d74d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:22:24.626815 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17ae5a7-5e30-4ad9-b944-6832cb4d74d6 None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:24.627097 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17ae5a7-5e30-4ad9-b944-6832cb4d74d6 None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:24.627373 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17ae5a7-5e30-4ad9-b944-6832cb4d74d6 None admin] PATH_INFO: `/v3/domains` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:24.628136 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17ae5a7-5e30-4ad9-b944-6832cb4d74d6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:22:24.628445 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17ae5a7-5e30-4ad9-b944-6832cb4d74d6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:22:24.629854 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17ae5a7-5e30-4ad9-b944-6832cb4d74d6 None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:22:24.634466 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae39e128-7310-48c7-bfc5-d4eaca40ccd4 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:22:24.640791 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 265/517] 10.222.0.23 () {56 vars in 1109 bytes} [Tue May 10 05:22:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:22:24.641564 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17ae5a7-5e30-4ad9-b944-6832cb4d74d6 None admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:22:24.667526 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05661d1d-18db-4902-b3b1-5d8d12deee9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:22:24.668239 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05661d1d-18db-4902-b3b1-5d8d12deee9f None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:24.668521 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05661d1d-18db-4902-b3b1-5d8d12deee9f None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:24.668795 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05661d1d-18db-4902-b3b1-5d8d12deee9f None admin] PATH_INFO: `/v3/users` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:24.669630 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05661d1d-18db-4902-b3b1-5d8d12deee9f None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:22:24.669948 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05661d1d-18db-4902-b3b1-5d8d12deee9f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:22:24.671387 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05661d1d-18db-4902-b3b1-5d8d12deee9f None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:22:24.689171 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 253/518] 10.222.0.23 () {56 vars in 1137 bytes} [Tue May 10 05:22:24 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:22:24.689967 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05661d1d-18db-4902-b3b1-5d8d12deee9f None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:22:24.735278 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17ae5a7-5e30-4ad9-b944-6832cb4d74d6 None admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:22:24.769466 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7df23e6-1950-477d-a51f-82a2cd136872 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:22:24.770122 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7df23e6-1950-477d-a51f-82a2cd136872 None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:24.770411 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7df23e6-1950-477d-a51f-82a2cd136872 None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:24.770688 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7df23e6-1950-477d-a51f-82a2cd136872 None admin] PATH_INFO: `/v3/projects` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:24.771469 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7df23e6-1950-477d-a51f-82a2cd136872 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:22:24.771810 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7df23e6-1950-477d-a51f-82a2cd136872 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:22:24.773263 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7df23e6-1950-477d-a51f-82a2cd136872 None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:22:24.787926 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05661d1d-18db-4902-b3b1-5d8d12deee9f None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:22:24.790216 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 266/519] 10.222.0.23 () {56 vars in 1148 bytes} [Tue May 10 05:22:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:22:24.790998 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7df23e6-1950-477d-a51f-82a2cd136872 None admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:22:24.820349 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef362eaf-f6aa-44d8-b468-2c358d5d7a97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:22:24.820997 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef362eaf-f6aa-44d8-b468-2c358d5d7a97 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:24.821278 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef362eaf-f6aa-44d8-b468-2c358d5d7a97 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:24.821537 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef362eaf-f6aa-44d8-b468-2c358d5d7a97 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:24.884378 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7df23e6-1950-477d-a51f-82a2cd136872 None admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:22:24.885922 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef362eaf-f6aa-44d8-b468-2c358d5d7a97 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:22:24.887368 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef362eaf-f6aa-44d8-b468-2c358d5d7a97 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:22:24.918706 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd6e617-3ab0-4211-91c8-de4d1f122a92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:22:24.919361 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd6e617-3ab0-4211-91c8-de4d1f122a92 None admin] REQUEST_METHOD: `POST` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:24.919676 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd6e617-3ab0-4211-91c8-de4d1f122a92 None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:24.919960 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd6e617-3ab0-4211-91c8-de4d1f122a92 None admin] PATH_INFO: `/v3/users` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:24.920655 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd6e617-3ab0-4211-91c8-de4d1f122a92 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:22:24.922087 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd6e617-3ab0-4211-91c8-de4d1f122a92 None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:22:24.942108 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 267/520] 10.222.0.23 () {60 vars in 1132 bytes} [Tue May 10 05:22:24 2022] POST /identity/v3/users => generated 247 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 05:22:24.943095 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd6e617-3ab0-4211-91c8-de4d1f122a92 None admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:22:24.983498 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 254/521] 10.222.0.23 () {58 vars in 1282 bytes} [Tue May 10 05:22:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 05:22:24.984681 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef362eaf-f6aa-44d8-b468-2c358d5d7a97 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:22:25.049382 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd6e617-3ab0-4211-91c8-de4d1f122a92 None admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:22:25.083170 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca10164-bab3-491e-9675-2ec14ebd6b98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:22:25.084048 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca10164-bab3-491e-9675-2ec14ebd6b98 None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:25.084324 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca10164-bab3-491e-9675-2ec14ebd6b98 None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:25.084599 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca10164-bab3-491e-9675-2ec14ebd6b98 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:25.088878 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef362eaf-f6aa-44d8-b468-2c358d5d7a97 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:22:25.093174 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca10164-bab3-491e-9675-2ec14ebd6b98 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:22:25.094813 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca10164-bab3-491e-9675-2ec14ebd6b98 None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:22:25.110153 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application [None req-cca10164-bab3-491e-9675-2ec14ebd6b98 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 10 05:22:25.110153 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 05:22:25.110153 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 05:22:25.110153 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 05:22:25.110153 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 05:22:25.110153 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 05:22:25.110153 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 05:22:25.110153 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 05:22:25.110153 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 05:22:25.110153 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 05:22:25.110153 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 05:22:25.110153 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 05:22:25.110153 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 05:22:25.110153 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 05:22:25.110153 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 05:22:25.110153 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 05:22:25.111147 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 05:22:25.111147 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 05:22:25.111147 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 05:22:25.111147 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 05:22:25.111147 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 05:22:25.111147 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 05:22:25.111147 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 05:22:25.111147 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 05:22:25.111147 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 05:22:25.111147 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.get_or_create( May 10 05:22:25.111147 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 05:22:25.111147 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application with Lock( May 10 05:22:25.111147 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 05:22:25.111147 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self._enter() May 10 05:22:25.111147 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 05:22:25.111147 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 05:22:25.111147 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 05:22:25.111147 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.creator() May 10 05:22:25.112089 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 05:22:25.112089 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application created_value = creator( May 10 05:22:25.112089 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 05:22:25.112089 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 05:22:25.112089 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 05:22:25.112089 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 05:22:25.112089 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 05:22:25.112089 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 05:22:25.112089 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 10 05:22:25.112089 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application May 10 05:22:25.115747 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 268/522] 10.222.0.23 () {56 vars in 1102 bytes} [Tue May 10 05:22:24 2022] GET /identity/v3/users/neutron => generated 85 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 05:22:25.116979 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca10164-bab3-491e-9675-2ec14ebd6b98 None admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:22:25.125902 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b818be-ebb6-4956-800b-ec4d34dd5d7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:22:25.126569 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b818be-ebb6-4956-800b-ec4d34dd5d7f None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:25.126848 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b818be-ebb6-4956-800b-ec4d34dd5d7f None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:25.127126 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b818be-ebb6-4956-800b-ec4d34dd5d7f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:25.195948 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b818be-ebb6-4956-800b-ec4d34dd5d7f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:22:25.197344 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b818be-ebb6-4956-800b-ec4d34dd5d7f None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:22:25.216130 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca10164-bab3-491e-9675-2ec14ebd6b98 None admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:22:25.249657 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aead607-0f27-4962-b6ab-76ca82c1fdfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:22:25.250324 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aead607-0f27-4962-b6ab-76ca82c1fdfb None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:25.250606 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aead607-0f27-4962-b6ab-76ca82c1fdfb None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:25.250882 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aead607-0f27-4962-b6ab-76ca82c1fdfb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:25.251800 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aead607-0f27-4962-b6ab-76ca82c1fdfb None admin] RBAC: Adding query filter params (role.id=8a02b9040d1d4fccababc1eb4dac80e7, scope.project.id=5f23435f783540199d6dcfd0417c090e, user.id=7f50f224ca944983aecfde86375473da) {{(pid=79879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:22:25.252116 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aead607-0f27-4962-b6ab-76ca82c1fdfb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:22:25.253569 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aead607-0f27-4962-b6ab-76ca82c1fdfb None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:22:25.267928 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 269/523] 10.222.0.23 () {56 vars in 1374 bytes} [Tue May 10 05:22:25 2022] GET /identity/v3/role_assignments?user.id=7f50f224ca944983aecfde86375473da&scope.project.id=5f23435f783540199d6dcfd0417c090e&role.id=8a02b9040d1d4fccababc1eb4dac80e7 => generated 259 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:22:25.267928 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aead607-0f27-4962-b6ab-76ca82c1fdfb None admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:22:25.294023 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 255/524] 10.222.0.23 () {58 vars in 1282 bytes} [Tue May 10 05:22:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 05:22:25.294914 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b818be-ebb6-4956-800b-ec4d34dd5d7f None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:22:25.402263 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aead607-0f27-4962-b6ab-76ca82c1fdfb None admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:22:25.411147 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b818be-ebb6-4956-800b-ec4d34dd5d7f None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:22:25.437960 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948a3bd4-cbba-4bdf-8636-8cf2cbb0af64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:22:25.438791 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948a3bd4-cbba-4bdf-8636-8cf2cbb0af64 None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:25.439066 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948a3bd4-cbba-4bdf-8636-8cf2cbb0af64 None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:25.439340 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948a3bd4-cbba-4bdf-8636-8cf2cbb0af64 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:25.450988 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948a3bd4-cbba-4bdf-8636-8cf2cbb0af64 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:22:25.452445 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948a3bd4-cbba-4bdf-8636-8cf2cbb0af64 None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:22:25.454040 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0368a865-942f-42ed-81d6-2e92778b24c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:22:25.455432 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0368a865-942f-42ed-81d6-2e92778b24c3 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:25.455887 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0368a865-942f-42ed-81d6-2e92778b24c3 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:25.456323 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0368a865-942f-42ed-81d6-2e92778b24c3 None admin] PATH_INFO: `/v3/users` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:25.457381 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0368a865-942f-42ed-81d6-2e92778b24c3 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:22:25.457973 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0368a865-942f-42ed-81d6-2e92778b24c3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:22:25.460178 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0368a865-942f-42ed-81d6-2e92778b24c3 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:22:25.472136 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application [None req-948a3bd4-cbba-4bdf-8636-8cf2cbb0af64 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 05:22:25.472136 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 05:22:25.472136 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 05:22:25.472136 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 05:22:25.472136 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 05:22:25.472136 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 05:22:25.472136 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 05:22:25.472136 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 05:22:25.472136 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 05:22:25.472136 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 05:22:25.472136 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 05:22:25.472136 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 05:22:25.472136 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 05:22:25.472136 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 05:22:25.472136 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 05:22:25.472910 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 05:22:25.472910 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 05:22:25.472910 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 05:22:25.472910 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 05:22:25.472910 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 05:22:25.472910 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 05:22:25.472910 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.get_or_create( May 10 05:22:25.472910 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 05:22:25.472910 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application with Lock( May 10 05:22:25.472910 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 05:22:25.472910 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self._enter() May 10 05:22:25.472910 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 05:22:25.472910 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 05:22:25.472910 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 05:22:25.472910 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.creator() May 10 05:22:25.472910 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 05:22:25.472910 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application created_value = creator( May 10 05:22:25.479095 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 05:22:25.479095 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 05:22:25.479095 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 05:22:25.479095 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application May 10 05:22:25.479095 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 270/525] 10.222.0.23 () {56 vars in 1108 bytes} [Tue May 10 05:22:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 05:22:25.479747 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948a3bd4-cbba-4bdf-8636-8cf2cbb0af64 None admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:22:25.483798 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 256/526] 10.222.0.23 () {56 vars in 1139 bytes} [Tue May 10 05:22:25 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:22:25.484828 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0368a865-942f-42ed-81d6-2e92778b24c3 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:22:25.593380 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948a3bd4-cbba-4bdf-8636-8cf2cbb0af64 None admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:22:25.603865 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0368a865-942f-42ed-81d6-2e92778b24c3 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:22:25.627052 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81dcb8b-5e77-4e48-adf5-f04f2e98e59e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:22:25.627887 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81dcb8b-5e77-4e48-adf5-f04f2e98e59e None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:25.628168 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81dcb8b-5e77-4e48-adf5-f04f2e98e59e None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:25.628536 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81dcb8b-5e77-4e48-adf5-f04f2e98e59e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:25.637465 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eadf582-1f81-4a19-997f-304cc0e5d798 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:22:25.638139 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eadf582-1f81-4a19-997f-304cc0e5d798 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:25.638420 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eadf582-1f81-4a19-997f-304cc0e5d798 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:25.638689 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eadf582-1f81-4a19-997f-304cc0e5d798 None admin] PATH_INFO: `/v3/domains` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:25.639350 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81dcb8b-5e77-4e48-adf5-f04f2e98e59e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:22:25.639454 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eadf582-1f81-4a19-997f-304cc0e5d798 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:22:25.639753 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eadf582-1f81-4a19-997f-304cc0e5d798 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:22:25.640874 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81dcb8b-5e77-4e48-adf5-f04f2e98e59e None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:22:25.641101 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eadf582-1f81-4a19-997f-304cc0e5d798 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:22:25.657224 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 257/527] 10.222.0.23 () {56 vars in 1109 bytes} [Tue May 10 05:22:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:22:25.658107 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eadf582-1f81-4a19-997f-304cc0e5d798 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:22:25.658373 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application [None req-a81dcb8b-5e77-4e48-adf5-f04f2e98e59e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 05:22:25.658373 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 05:22:25.658373 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 05:22:25.658373 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 05:22:25.658373 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 05:22:25.658373 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 05:22:25.658373 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 05:22:25.658373 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 05:22:25.658373 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 05:22:25.658373 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 05:22:25.658373 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 05:22:25.658373 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 05:22:25.658373 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 05:22:25.658373 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 05:22:25.658373 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 05:22:25.659195 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 05:22:25.659195 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 05:22:25.659195 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 05:22:25.659195 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 05:22:25.659195 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 05:22:25.659195 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 05:22:25.659195 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.get_or_create( May 10 05:22:25.659195 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 05:22:25.659195 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application with Lock( May 10 05:22:25.659195 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 05:22:25.659195 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self._enter() May 10 05:22:25.659195 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 05:22:25.659195 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 05:22:25.659195 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 05:22:25.659195 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.creator() May 10 05:22:25.659195 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 05:22:25.659195 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application created_value = creator( May 10 05:22:25.660079 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 05:22:25.660079 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 05:22:25.660079 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 05:22:25.660079 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application May 10 05:22:25.660079 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 271/528] 10.222.0.23 () {56 vars in 1108 bytes} [Tue May 10 05:22:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 05:22:25.660907 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81dcb8b-5e77-4e48-adf5-f04f2e98e59e None admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:22:25.759120 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81dcb8b-5e77-4e48-adf5-f04f2e98e59e None admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:22:25.762442 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eadf582-1f81-4a19-997f-304cc0e5d798 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:22:25.795690 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57521f2-dfca-465d-8a9c-94221692ae31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:22:25.796597 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57521f2-dfca-465d-8a9c-94221692ae31 None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:25.796944 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57521f2-dfca-465d-8a9c-94221692ae31 None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:25.797279 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57521f2-dfca-465d-8a9c-94221692ae31 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:25.801004 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15f11a4-6880-413e-9400-5d26ebe171a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:22:25.801703 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15f11a4-6880-413e-9400-5d26ebe171a8 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:25.801986 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15f11a4-6880-413e-9400-5d26ebe171a8 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:25.802258 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15f11a4-6880-413e-9400-5d26ebe171a8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:25.807674 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57521f2-dfca-465d-8a9c-94221692ae31 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:22:25.809133 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57521f2-dfca-465d-8a9c-94221692ae31 None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:22:25.825093 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application [None req-e57521f2-dfca-465d-8a9c-94221692ae31 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 05:22:25.825093 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 05:22:25.825093 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 05:22:25.825093 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 05:22:25.825093 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 05:22:25.825093 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 05:22:25.825093 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 05:22:25.825093 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 05:22:25.825093 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 05:22:25.825093 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 05:22:25.825093 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 05:22:25.825093 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 05:22:25.825093 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 05:22:25.825093 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 05:22:25.825093 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 05:22:25.827036 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 05:22:25.827036 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 05:22:25.827036 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 05:22:25.827036 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 05:22:25.827036 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 05:22:25.827036 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 05:22:25.827036 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.get_or_create( May 10 05:22:25.827036 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 05:22:25.827036 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application with Lock( May 10 05:22:25.827036 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 05:22:25.827036 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self._enter() May 10 05:22:25.827036 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 05:22:25.827036 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 05:22:25.827036 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 05:22:25.827036 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.creator() May 10 05:22:25.827036 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 05:22:25.827036 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application created_value = creator( May 10 05:22:25.828579 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 05:22:25.828579 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 05:22:25.828579 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 05:22:25.828579 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 05:22:25.828579 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 05:22:25.828579 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 05:22:25.828579 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 05:22:25.828579 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application May 10 05:22:25.828579 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 272/529] 10.222.0.23 () {56 vars in 1111 bytes} [Tue May 10 05:22:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 05:22:25.828579 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57521f2-dfca-465d-8a9c-94221692ae31 None admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:22:25.880476 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15f11a4-6880-413e-9400-5d26ebe171a8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:22:25.882086 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15f11a4-6880-413e-9400-5d26ebe171a8 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:22:25.954933 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57521f2-dfca-465d-8a9c-94221692ae31 None admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:22:25.977592 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 258/530] 10.222.0.23 () {58 vars in 1282 bytes} [Tue May 10 05:22:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 05:22:25.978692 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15f11a4-6880-413e-9400-5d26ebe171a8 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:22:25.999372 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026a4491-4dfa-4eb5-a8ea-e96feb0a6bb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:22:26.000518 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026a4491-4dfa-4eb5-a8ea-e96feb0a6bb1 None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:26.000808 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026a4491-4dfa-4eb5-a8ea-e96feb0a6bb1 None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:26.001488 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026a4491-4dfa-4eb5-a8ea-e96feb0a6bb1 None admin] PATH_INFO: `/v3/domains` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:26.002091 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026a4491-4dfa-4eb5-a8ea-e96feb0a6bb1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:22:26.002560 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026a4491-4dfa-4eb5-a8ea-e96feb0a6bb1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:22:26.004589 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026a4491-4dfa-4eb5-a8ea-e96feb0a6bb1 None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:22:26.018901 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 273/531] 10.222.0.23 () {56 vars in 1109 bytes} [Tue May 10 05:22:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:22:26.024935 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026a4491-4dfa-4eb5-a8ea-e96feb0a6bb1 None admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:22:26.089109 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15f11a4-6880-413e-9400-5d26ebe171a8 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:22:26.126117 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026a4491-4dfa-4eb5-a8ea-e96feb0a6bb1 None admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:22:26.135601 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35410910-5f71-4888-8c45-4a8ddb0281f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:22:26.135601 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35410910-5f71-4888-8c45-4a8ddb0281f3 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:26.135601 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35410910-5f71-4888-8c45-4a8ddb0281f3 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:26.135601 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35410910-5f71-4888-8c45-4a8ddb0281f3 None admin] PATH_INFO: `/v3/projects` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:26.136357 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35410910-5f71-4888-8c45-4a8ddb0281f3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:22:26.136357 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35410910-5f71-4888-8c45-4a8ddb0281f3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:22:26.136357 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35410910-5f71-4888-8c45-4a8ddb0281f3 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:22:26.163770 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 259/532] 10.222.0.23 () {56 vars in 1148 bytes} [Tue May 10 05:22:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:22:26.164673 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35410910-5f71-4888-8c45-4a8ddb0281f3 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:22:26.169469 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf038ede-df7b-411f-b3c9-9827119f954a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:22:26.170285 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf038ede-df7b-411f-b3c9-9827119f954a None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:26.170567 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf038ede-df7b-411f-b3c9-9827119f954a None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:26.170840 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf038ede-df7b-411f-b3c9-9827119f954a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:26.186999 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf038ede-df7b-411f-b3c9-9827119f954a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:22:26.189525 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf038ede-df7b-411f-b3c9-9827119f954a None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:22:26.210910 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application [None req-cf038ede-df7b-411f-b3c9-9827119f954a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 05:22:26.210910 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 05:22:26.210910 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 05:22:26.210910 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 05:22:26.210910 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 05:22:26.210910 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 05:22:26.210910 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 05:22:26.210910 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 05:22:26.210910 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 05:22:26.210910 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 05:22:26.210910 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 05:22:26.210910 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 05:22:26.210910 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 05:22:26.210910 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 05:22:26.210910 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 05:22:26.211823 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 05:22:26.211823 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 05:22:26.211823 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 05:22:26.211823 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 05:22:26.211823 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 05:22:26.211823 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 05:22:26.211823 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.get_or_create( May 10 05:22:26.211823 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 05:22:26.211823 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application with Lock( May 10 05:22:26.211823 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 05:22:26.211823 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self._enter() May 10 05:22:26.211823 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 05:22:26.211823 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 05:22:26.211823 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 05:22:26.211823 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.creator() May 10 05:22:26.211823 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 05:22:26.211823 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application created_value = creator( May 10 05:22:26.212659 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 05:22:26.212659 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 05:22:26.212659 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 05:22:26.212659 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application May 10 05:22:26.214859 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 274/533] 10.222.0.23 () {56 vars in 1108 bytes} [Tue May 10 05:22:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 05:22:26.215956 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf038ede-df7b-411f-b3c9-9827119f954a None admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:22:26.281520 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35410910-5f71-4888-8c45-4a8ddb0281f3 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:22:26.320257 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf038ede-df7b-411f-b3c9-9827119f954a None admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:22:26.322278 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bb9e37-236a-4004-ad7d-ad65866c16c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:22:26.323967 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bb9e37-236a-4004-ad7d-ad65866c16c8 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:26.324251 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bb9e37-236a-4004-ad7d-ad65866c16c8 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:26.324519 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bb9e37-236a-4004-ad7d-ad65866c16c8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:26.332555 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7bb9e37-236a-4004-ad7d-ad65866c16c8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:22:26.334533 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7bb9e37-236a-4004-ad7d-ad65866c16c8 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:22:26.351750 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application [None req-d7bb9e37-236a-4004-ad7d-ad65866c16c8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 05:22:26.351750 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 05:22:26.351750 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 05:22:26.351750 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 05:22:26.351750 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 05:22:26.351750 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 05:22:26.351750 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 05:22:26.351750 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 05:22:26.351750 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 05:22:26.351750 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 05:22:26.351750 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 05:22:26.351750 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 05:22:26.351750 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 05:22:26.351750 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 05:22:26.351750 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 05:22:26.352586 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 05:22:26.352586 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 05:22:26.352586 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 05:22:26.352586 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 05:22:26.352586 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 05:22:26.352586 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 05:22:26.352586 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.get_or_create( May 10 05:22:26.352586 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 05:22:26.352586 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application with Lock( May 10 05:22:26.352586 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 05:22:26.352586 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._enter() May 10 05:22:26.352586 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 05:22:26.352586 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 05:22:26.352586 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 05:22:26.352586 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.creator() May 10 05:22:26.352586 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 05:22:26.352586 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application created_value = creator( May 10 05:22:26.353431 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 05:22:26.353431 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 05:22:26.353431 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 05:22:26.353431 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 05:22:26.353431 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 05:22:26.353431 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 05:22:26.353431 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 05:22:26.353431 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application May 10 05:22:26.353431 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 260/534] 10.222.0.23 () {56 vars in 1111 bytes} [Tue May 10 05:22:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 05:22:26.353891 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bb9e37-236a-4004-ad7d-ad65866c16c8 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:22:26.362994 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d829283-35a3-4c95-8cc9-9353fec1462d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:22:26.363719 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d829283-35a3-4c95-8cc9-9353fec1462d None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:26.363998 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d829283-35a3-4c95-8cc9-9353fec1462d None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:26.364271 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d829283-35a3-4c95-8cc9-9353fec1462d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:26.365118 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d829283-35a3-4c95-8cc9-9353fec1462d None admin] RBAC: Adding query filter params (role.id=8a02b9040d1d4fccababc1eb4dac80e7, scope.project.id=5f23435f783540199d6dcfd0417c090e, user.id=a5b56aedcfd74914938b0b9cdd102f48) {{(pid=79879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:22:26.365427 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d829283-35a3-4c95-8cc9-9353fec1462d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:22:26.366872 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d829283-35a3-4c95-8cc9-9353fec1462d None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:22:26.373310 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 275/535] 10.222.0.23 () {56 vars in 1374 bytes} [Tue May 10 05:22:26 2022] GET /identity/v3/role_assignments?user.id=a5b56aedcfd74914938b0b9cdd102f48&scope.project.id=5f23435f783540199d6dcfd0417c090e&role.id=8a02b9040d1d4fccababc1eb4dac80e7 => generated 259 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:22:26.374157 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d829283-35a3-4c95-8cc9-9353fec1462d None admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:22:26.460231 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bb9e37-236a-4004-ad7d-ad65866c16c8 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:22:26.480424 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d829283-35a3-4c95-8cc9-9353fec1462d None admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:22:26.497847 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b5b837-38f9-4109-9870-4a5846217434 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:22:26.498569 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b5b837-38f9-4109-9870-4a5846217434 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:26.498851 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b5b837-38f9-4109-9870-4a5846217434 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:26.499128 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b5b837-38f9-4109-9870-4a5846217434 None admin] PATH_INFO: `/v3/domains` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:26.499927 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b5b837-38f9-4109-9870-4a5846217434 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:22:26.500232 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b5b837-38f9-4109-9870-4a5846217434 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:22:26.501630 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b5b837-38f9-4109-9870-4a5846217434 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:22:26.514271 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 261/536] 10.222.0.23 () {56 vars in 1109 bytes} [Tue May 10 05:22:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:22:26.520042 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b5b837-38f9-4109-9870-4a5846217434 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:22:26.539134 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17594252-7aa4-4fdf-ab79-60f0c7053993 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:22:26.539866 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17594252-7aa4-4fdf-ab79-60f0c7053993 None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:26.540144 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17594252-7aa4-4fdf-ab79-60f0c7053993 None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:26.540423 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17594252-7aa4-4fdf-ab79-60f0c7053993 None admin] PATH_INFO: `/v3/projects` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:26.542412 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17594252-7aa4-4fdf-ab79-60f0c7053993 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:22:26.542732 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17594252-7aa4-4fdf-ab79-60f0c7053993 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:22:26.548042 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17594252-7aa4-4fdf-ab79-60f0c7053993 None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:22:26.590122 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 276/537] 10.222.0.23 () {56 vars in 1148 bytes} [Tue May 10 05:22:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:22:26.610173 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17594252-7aa4-4fdf-ab79-60f0c7053993 None admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:22:26.661371 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b5b837-38f9-4109-9870-4a5846217434 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:22:26.704227 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a5719f-d9a7-46ef-a082-52ce4afd280f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:22:26.705322 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a5719f-d9a7-46ef-a082-52ce4afd280f None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:26.705595 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a5719f-d9a7-46ef-a082-52ce4afd280f None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:26.705869 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a5719f-d9a7-46ef-a082-52ce4afd280f None admin] PATH_INFO: `/v3/projects/service` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:26.714237 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a5719f-d9a7-46ef-a082-52ce4afd280f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:22:26.715768 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a5719f-d9a7-46ef-a082-52ce4afd280f None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:22:26.731591 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application [None req-92a5719f-d9a7-46ef-a082-52ce4afd280f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 05:22:26.731591 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 05:22:26.731591 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 05:22:26.731591 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 05:22:26.731591 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 05:22:26.731591 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 05:22:26.731591 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 05:22:26.731591 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 05:22:26.731591 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 05:22:26.731591 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 05:22:26.731591 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 05:22:26.731591 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 05:22:26.731591 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 05:22:26.731591 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 05:22:26.731591 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 05:22:26.733586 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 05:22:26.733586 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 05:22:26.733586 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 05:22:26.733586 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 05:22:26.733586 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 05:22:26.733586 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 05:22:26.733586 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.get_or_create( May 10 05:22:26.733586 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 05:22:26.733586 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application with Lock( May 10 05:22:26.733586 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 05:22:26.733586 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._enter() May 10 05:22:26.733586 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 05:22:26.733586 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 05:22:26.733586 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 05:22:26.733586 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.creator() May 10 05:22:26.733586 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 05:22:26.733586 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application created_value = creator( May 10 05:22:26.735672 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 05:22:26.735672 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 05:22:26.735672 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 05:22:26.735672 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 05:22:26.735672 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 05:22:26.735672 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 05:22:26.735672 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 05:22:26.735672 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application May 10 05:22:26.735672 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 262/538] 10.222.0.23 () {56 vars in 1111 bytes} [Tue May 10 05:22:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 05:22:26.744400 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a5719f-d9a7-46ef-a082-52ce4afd280f None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:22:26.752198 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17594252-7aa4-4fdf-ab79-60f0c7053993 None admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:22:26.796402 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8d3fdd-0522-4705-8b0a-ae29bb762091 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:22:26.796983 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8d3fdd-0522-4705-8b0a-ae29bb762091 None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:26.797258 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8d3fdd-0522-4705-8b0a-ae29bb762091 None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:26.803621 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8d3fdd-0522-4705-8b0a-ae29bb762091 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:26.803621 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8d3fdd-0522-4705-8b0a-ae29bb762091 None admin] RBAC: Adding query filter params (role.id=8a02b9040d1d4fccababc1eb4dac80e7, scope.project.id=5f23435f783540199d6dcfd0417c090e, user.id=355be413675540a39ccb00e1a0722316) {{(pid=79879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:22:26.803621 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8d3fdd-0522-4705-8b0a-ae29bb762091 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:22:26.804656 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8d3fdd-0522-4705-8b0a-ae29bb762091 None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:22:26.817686 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 277/539] 10.222.0.23 () {56 vars in 1374 bytes} [Tue May 10 05:22:26 2022] GET /identity/v3/role_assignments?user.id=355be413675540a39ccb00e1a0722316&scope.project.id=5f23435f783540199d6dcfd0417c090e&role.id=8a02b9040d1d4fccababc1eb4dac80e7 => generated 259 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 05:22:26.880949 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a5719f-d9a7-46ef-a082-52ce4afd280f None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:22:26.915110 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816af7c9-e9d9-4b4e-a277-2907571145d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:22:26.915780 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816af7c9-e9d9-4b4e-a277-2907571145d1 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:26.916058 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816af7c9-e9d9-4b4e-a277-2907571145d1 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:26.916323 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816af7c9-e9d9-4b4e-a277-2907571145d1 None admin] PATH_INFO: `/v3/projects` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:26.917114 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816af7c9-e9d9-4b4e-a277-2907571145d1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:22:26.917418 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816af7c9-e9d9-4b4e-a277-2907571145d1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:22:26.918858 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816af7c9-e9d9-4b4e-a277-2907571145d1 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:22:26.932278 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 263/540] 10.222.0.23 () {56 vars in 1148 bytes} [Tue May 10 05:22:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:22:26.938222 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8d3fdd-0522-4705-8b0a-ae29bb762091 None admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:22:27.041030 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8d3fdd-0522-4705-8b0a-ae29bb762091 None admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:22:27.076965 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d259be0-dd21-486c-b1d3-67d8ad2cd1ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:22:27.077526 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d259be0-dd21-486c-b1d3-67d8ad2cd1ff None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:27.077803 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d259be0-dd21-486c-b1d3-67d8ad2cd1ff None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:27.078071 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d259be0-dd21-486c-b1d3-67d8ad2cd1ff None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:27.078932 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d259be0-dd21-486c-b1d3-67d8ad2cd1ff None admin] RBAC: Adding query filter params (role.id=8a02b9040d1d4fccababc1eb4dac80e7, scope.project.id=5f23435f783540199d6dcfd0417c090e, user.id=3c8461cfdd9648b8abcaf8d34b7a102a) {{(pid=79879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:22:27.079239 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d259be0-dd21-486c-b1d3-67d8ad2cd1ff None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:22:27.080769 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d259be0-dd21-486c-b1d3-67d8ad2cd1ff None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:22:27.087375 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 278/541] 10.222.0.23 () {56 vars in 1374 bytes} [Tue May 10 05:22:26 2022] GET /identity/v3/role_assignments?user.id=3c8461cfdd9648b8abcaf8d34b7a102a&scope.project.id=5f23435f783540199d6dcfd0417c090e&role.id=8a02b9040d1d4fccababc1eb4dac80e7 => generated 259 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:22:27.348273 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6050191-800b-49ac-bee7-545c6184fdcb None None] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:27.348940 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6050191-800b-49ac-bee7-545c6184fdcb None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:27.349450 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6050191-800b-49ac-bee7-545c6184fdcb None None] PATH_INFO: `/` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:27.351337 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 264/542] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 10 05:22:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 05:22:27.357455 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2af0e8-e859-4dd8-94de-5b655c2f787b None None] REQUEST_METHOD: `POST` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:27.358054 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2af0e8-e859-4dd8-94de-5b655c2f787b None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:27.358514 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2af0e8-e859-4dd8-94de-5b655c2f787b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:27.376112 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.auth.core [None req-fd2af0e8-e859-4dd8-94de-5b655c2f787b None None] MFA Rules not processed for user `44883b22532e44049d846938dc2cf423`. Rule list: `[]` (Enabled: `True`). {{(pid=79879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:22:27.377586 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-fd2af0e8-e859-4dd8-94de-5b655c2f787b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:22:27.445486 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 279/543] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 10 05:22:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 10 05:22:27.468499 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6050191-800b-49ac-bee7-545c6184fdcb None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:22:27.573156 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6050191-800b-49ac-bee7-545c6184fdcb None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:22:27.606001 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70eda36-2d5f-45b1-a9e7-631c42b7d151 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:22:27.606726 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70eda36-2d5f-45b1-a9e7-631c42b7d151 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:27.606998 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70eda36-2d5f-45b1-a9e7-631c42b7d151 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:27.607264 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70eda36-2d5f-45b1-a9e7-631c42b7d151 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:27.617617 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70eda36-2d5f-45b1-a9e7-631c42b7d151 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 05:22:27.625656 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application [None req-c70eda36-2d5f-45b1-a9e7-631c42b7d151 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 10 05:22:27.625656 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 05:22:27.625656 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 05:22:27.625656 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 05:22:27.625656 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 05:22:27.625656 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 05:22:27.625656 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 05:22:27.625656 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 05:22:27.625656 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 05:22:27.625656 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 05:22:27.625656 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 05:22:27.625656 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 05:22:27.625656 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 05:22:27.625656 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 05:22:27.625656 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 05:22:27.625656 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 05:22:27.627742 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 05:22:27.627742 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 05:22:27.627742 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 05:22:27.627742 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 05:22:27.627742 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 05:22:27.627742 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 05:22:27.627742 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 05:22:27.627742 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 05:22:27.627742 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 05:22:27.627742 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.get_or_create( May 10 05:22:27.627742 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 05:22:27.627742 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application with Lock( May 10 05:22:27.627742 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 05:22:27.627742 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._enter() May 10 05:22:27.627742 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 05:22:27.627742 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 05:22:27.629764 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 05:22:27.629764 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.creator() May 10 05:22:27.629764 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 05:22:27.629764 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application created_value = creator( May 10 05:22:27.629764 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 05:22:27.629764 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 05:22:27.629764 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 05:22:27.629764 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 05:22:27.629764 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 05:22:27.629764 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 05:22:27.629764 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 10 05:22:27.629764 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application May 10 05:22:27.629764 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 265/544] 10.222.0.23 () {56 vars in 1102 bytes} [Tue May 10 05:22:27 2022] GET /identity/v3/roles/service => generated 85 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 05:22:27.633118 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2af0e8-e859-4dd8-94de-5b655c2f787b None None] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:22:27.728300 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2af0e8-e859-4dd8-94de-5b655c2f787b None None] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:22:27.761676 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6630aca-63fb-4741-a7b1-a68a2f915d2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:22:27.762361 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6630aca-63fb-4741-a7b1-a68a2f915d2f None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:27.762631 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6630aca-63fb-4741-a7b1-a68a2f915d2f None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:27.762902 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6630aca-63fb-4741-a7b1-a68a2f915d2f None admin] PATH_INFO: `/v3/roles` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:27.763676 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6630aca-63fb-4741-a7b1-a68a2f915d2f None admin] RBAC: Adding query filter params (name=service) {{(pid=79879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:22:27.763976 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6630aca-63fb-4741-a7b1-a68a2f915d2f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:22:27.765338 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6630aca-63fb-4741-a7b1-a68a2f915d2f None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:22:27.773762 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 280/545] 10.222.0.23 () {56 vars in 1103 bytes} [Tue May 10 05:22:27 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:22:27.779238 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70eda36-2d5f-45b1-a9e7-631c42b7d151 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:22:27.814704 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca097b7b-c6fe-4aeb-8e60-709e5be4f720 None None] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:27.815357 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca097b7b-c6fe-4aeb-8e60-709e5be4f720 None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:27.815697 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca097b7b-c6fe-4aeb-8e60-709e5be4f720 None None] PATH_INFO: `/` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:27.817796 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 281/546] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 10 05:22:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 05:22:27.824772 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f381484-cf4f-4c21-a5b7-5f9e08e56eec None None] REQUEST_METHOD: `POST` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:27.825085 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f381484-cf4f-4c21-a5b7-5f9e08e56eec None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:27.825323 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f381484-cf4f-4c21-a5b7-5f9e08e56eec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:27.846309 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.auth.core [None req-3f381484-cf4f-4c21-a5b7-5f9e08e56eec None None] MFA Rules not processed for user `44883b22532e44049d846938dc2cf423`. Rule list: `[]` (Enabled: `True`). {{(pid=79879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:22:27.847883 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-3f381484-cf4f-4c21-a5b7-5f9e08e56eec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:22:27.920975 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 282/547] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 10 05:22:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 10 05:22:27.943339 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f381484-cf4f-4c21-a5b7-5f9e08e56eec None None] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:22:27.966369 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70eda36-2d5f-45b1-a9e7-631c42b7d151 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:22:28.047236 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f381484-cf4f-4c21-a5b7-5f9e08e56eec None None] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:22:28.048870 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f1af90-9d71-4f58-9a34-1a1ab85b9478 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:22:28.049692 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f1af90-9d71-4f58-9a34-1a1ab85b9478 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:28.049973 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f1af90-9d71-4f58-9a34-1a1ab85b9478 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:28.050250 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f1af90-9d71-4f58-9a34-1a1ab85b9478 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:28.076611 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f1af90-9d71-4f58-9a34-1a1ab85b9478 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:22:28.078081 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f1af90-9d71-4f58-9a34-1a1ab85b9478 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:22:28.080562 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5b6659-ddd9-483a-a151-b0a123aa78b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:22:28.081375 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5b6659-ddd9-483a-a151-b0a123aa78b2 None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:28.081652 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5b6659-ddd9-483a-a151-b0a123aa78b2 None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:28.081927 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5b6659-ddd9-483a-a151-b0a123aa78b2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:28.091919 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5b6659-ddd9-483a-a151-b0a123aa78b2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 05:22:28.099662 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application [None req-ad5b6659-ddd9-483a-a151-b0a123aa78b2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 10 05:22:28.099662 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 05:22:28.099662 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 05:22:28.099662 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 05:22:28.099662 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 05:22:28.099662 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 05:22:28.099662 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 05:22:28.099662 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 05:22:28.099662 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 05:22:28.099662 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 05:22:28.099662 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 05:22:28.099662 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 05:22:28.099662 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 05:22:28.099662 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 05:22:28.099662 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 05:22:28.099662 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 05:22:28.101808 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 05:22:28.101808 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 05:22:28.101808 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 05:22:28.101808 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 05:22:28.101808 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 05:22:28.101808 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 05:22:28.101808 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 05:22:28.101808 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 05:22:28.101808 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 05:22:28.101808 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.get_or_create( May 10 05:22:28.101808 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 05:22:28.101808 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application with Lock( May 10 05:22:28.101808 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 05:22:28.101808 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self._enter() May 10 05:22:28.101808 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 05:22:28.101808 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 05:22:28.103847 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 05:22:28.103847 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.creator() May 10 05:22:28.103847 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 05:22:28.103847 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application created_value = creator( May 10 05:22:28.103847 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 05:22:28.103847 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 05:22:28.103847 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 05:22:28.103847 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 05:22:28.103847 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 05:22:28.103847 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 05:22:28.103847 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 10 05:22:28.103847 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application May 10 05:22:28.103847 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 283/548] 10.222.0.23 () {56 vars in 1102 bytes} [Tue May 10 05:22:27 2022] GET /identity/v3/roles/service => generated 85 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 05:22:28.107611 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5b6659-ddd9-483a-a151-b0a123aa78b2 None admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:22:28.119840 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application [None req-53f1af90-9d71-4f58-9a34-1a1ab85b9478 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 05:22:28.119840 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 05:22:28.119840 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 05:22:28.119840 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 05:22:28.119840 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 05:22:28.119840 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 05:22:28.119840 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 05:22:28.119840 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 05:22:28.119840 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 05:22:28.119840 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 05:22:28.119840 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 05:22:28.119840 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 05:22:28.119840 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 05:22:28.119840 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 05:22:28.119840 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 05:22:28.122206 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 05:22:28.122206 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 05:22:28.122206 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 05:22:28.122206 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 05:22:28.122206 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 05:22:28.122206 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 05:22:28.122206 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.get_or_create( May 10 05:22:28.122206 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 05:22:28.122206 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application with Lock( May 10 05:22:28.122206 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 05:22:28.122206 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._enter() May 10 05:22:28.122206 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 05:22:28.122206 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 05:22:28.122206 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 05:22:28.122206 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.creator() May 10 05:22:28.122206 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 05:22:28.122206 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application created_value = creator( May 10 05:22:28.125902 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 05:22:28.125902 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 05:22:28.125902 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 05:22:28.125902 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application May 10 05:22:28.125902 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 266/549] 10.222.0.23 () {56 vars in 1108 bytes} [Tue May 10 05:22:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 343 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 05:22:28.132463 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f1af90-9d71-4f58-9a34-1a1ab85b9478 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:22:28.214797 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5b6659-ddd9-483a-a151-b0a123aa78b2 None admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:22:28.246115 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ad875e-a0cd-4c59-be54-ee664cf09c3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:22:28.246806 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ad875e-a0cd-4c59-be54-ee664cf09c3a None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:28.247082 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ad875e-a0cd-4c59-be54-ee664cf09c3a None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:28.247351 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ad875e-a0cd-4c59-be54-ee664cf09c3a None admin] PATH_INFO: `/v3/roles` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:28.248162 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ad875e-a0cd-4c59-be54-ee664cf09c3a None admin] RBAC: Adding query filter params (name=service) {{(pid=79879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:22:28.248467 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ad875e-a0cd-4c59-be54-ee664cf09c3a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:22:28.249840 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ad875e-a0cd-4c59-be54-ee664cf09c3a None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:22:28.258475 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 284/550] 10.222.0.23 () {56 vars in 1103 bytes} [Tue May 10 05:22:28 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:22:28.264012 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ad875e-a0cd-4c59-be54-ee664cf09c3a None admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:22:28.362378 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ad875e-a0cd-4c59-be54-ee664cf09c3a None admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:22:28.390360 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f1af90-9d71-4f58-9a34-1a1ab85b9478 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:22:28.429494 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0160c9c9-9770-4695-bb15-db70f7d796f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:22:28.430684 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0160c9c9-9770-4695-bb15-db70f7d796f8 None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:28.431194 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0160c9c9-9770-4695-bb15-db70f7d796f8 None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:28.431707 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0160c9c9-9770-4695-bb15-db70f7d796f8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:28.453041 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0160c9c9-9770-4695-bb15-db70f7d796f8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:22:28.455347 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0160c9c9-9770-4695-bb15-db70f7d796f8 None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:22:28.458308 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ff3145-b919-4686-8e44-a5ea9ef69a22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:22:28.460177 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ff3145-b919-4686-8e44-a5ea9ef69a22 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:28.460662 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ff3145-b919-4686-8e44-a5ea9ef69a22 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:28.461899 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ff3145-b919-4686-8e44-a5ea9ef69a22 None admin] PATH_INFO: `/v3/domains` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:28.473547 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ff3145-b919-4686-8e44-a5ea9ef69a22 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:22:28.477330 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ff3145-b919-4686-8e44-a5ea9ef69a22 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:22:28.478991 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ff3145-b919-4686-8e44-a5ea9ef69a22 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:22:28.500750 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 267/551] 10.222.0.23 () {56 vars in 1109 bytes} [Tue May 10 05:22:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 369 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:22:28.504305 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application [None req-0160c9c9-9770-4695-bb15-db70f7d796f8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 05:22:28.504305 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 05:22:28.504305 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 05:22:28.504305 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 05:22:28.504305 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 05:22:28.504305 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 05:22:28.504305 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 05:22:28.504305 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 05:22:28.504305 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 05:22:28.504305 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 05:22:28.504305 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 05:22:28.504305 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 05:22:28.504305 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 05:22:28.504305 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 05:22:28.504305 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 05:22:28.505147 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 05:22:28.505147 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 05:22:28.505147 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 05:22:28.505147 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 05:22:28.505147 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 05:22:28.505147 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 05:22:28.505147 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.get_or_create( May 10 05:22:28.505147 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 05:22:28.505147 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application with Lock( May 10 05:22:28.505147 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 05:22:28.505147 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self._enter() May 10 05:22:28.505147 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 05:22:28.505147 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 05:22:28.505147 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 05:22:28.505147 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.creator() May 10 05:22:28.505147 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 05:22:28.505147 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application created_value = creator( May 10 05:22:28.505992 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 05:22:28.505992 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 05:22:28.505992 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 05:22:28.505992 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application May 10 05:22:28.507515 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ff3145-b919-4686-8e44-a5ea9ef69a22 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:22:28.511360 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 285/552] 10.222.0.23 () {56 vars in 1108 bytes} [Tue May 10 05:22:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 05:22:28.514898 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0160c9c9-9770-4695-bb15-db70f7d796f8 None admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:22:28.609604 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ff3145-b919-4686-8e44-a5ea9ef69a22 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:22:28.645074 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0cef7c-f69a-430e-81f5-53343ede1719 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:22:28.646285 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0cef7c-f69a-430e-81f5-53343ede1719 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:28.646767 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0cef7c-f69a-430e-81f5-53343ede1719 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:28.647257 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0cef7c-f69a-430e-81f5-53343ede1719 None admin] PATH_INFO: `/v3/users/swift` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:28.662346 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0cef7c-f69a-430e-81f5-53343ede1719 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:22:28.667446 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0cef7c-f69a-430e-81f5-53343ede1719 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:22:28.696163 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application [None req-ed0cef7c-f69a-430e-81f5-53343ede1719 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 10 05:22:28.696163 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 05:22:28.696163 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 05:22:28.696163 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 05:22:28.696163 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 05:22:28.696163 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 05:22:28.696163 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 05:22:28.696163 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 05:22:28.696163 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 05:22:28.696163 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 05:22:28.696163 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 05:22:28.696163 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 05:22:28.696163 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 05:22:28.696163 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 05:22:28.696163 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 05:22:28.696163 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 05:22:28.697108 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 05:22:28.697108 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 05:22:28.697108 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 05:22:28.697108 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 05:22:28.697108 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 05:22:28.697108 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 05:22:28.697108 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 05:22:28.697108 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 05:22:28.697108 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 05:22:28.697108 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.get_or_create( May 10 05:22:28.697108 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 05:22:28.697108 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application with Lock( May 10 05:22:28.697108 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 05:22:28.697108 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._enter() May 10 05:22:28.697108 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 05:22:28.697108 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 05:22:28.697108 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 05:22:28.697108 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.creator() May 10 05:22:28.698004 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 05:22:28.698004 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application created_value = creator( May 10 05:22:28.698004 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 05:22:28.698004 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 05:22:28.698004 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 05:22:28.698004 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 05:22:28.698004 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 05:22:28.698004 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 05:22:28.698004 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 10 05:22:28.698004 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application May 10 05:22:28.707595 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 268/553] 10.222.0.23 () {56 vars in 1096 bytes} [Tue May 10 05:22:28 2022] GET /identity/v3/users/swift => generated 83 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 05:22:28.707595 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0cef7c-f69a-430e-81f5-53343ede1719 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:22:28.741833 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0160c9c9-9770-4695-bb15-db70f7d796f8 None admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:22:28.812623 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0cef7c-f69a-430e-81f5-53343ede1719 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:22:28.829497 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47ba864-bab3-4611-b9fb-441c13dac12f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:22:28.830229 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47ba864-bab3-4611-b9fb-441c13dac12f None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:28.831007 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47ba864-bab3-4611-b9fb-441c13dac12f None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:28.831007 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47ba864-bab3-4611-b9fb-441c13dac12f None admin] PATH_INFO: `/v3/domains` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:28.831535 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47ba864-bab3-4611-b9fb-441c13dac12f None admin] RBAC: Adding query filter params (name=Default) {{(pid=79879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:22:28.831871 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47ba864-bab3-4611-b9fb-441c13dac12f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:22:28.833483 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47ba864-bab3-4611-b9fb-441c13dac12f None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:22:28.854328 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48d43b1-eac4-4194-ac84-26da0acfcedf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:22:28.855488 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48d43b1-eac4-4194-ac84-26da0acfcedf None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:28.855991 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48d43b1-eac4-4194-ac84-26da0acfcedf None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:28.856543 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48d43b1-eac4-4194-ac84-26da0acfcedf None admin] PATH_INFO: `/v3/users` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:28.857606 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48d43b1-eac4-4194-ac84-26da0acfcedf None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:22:28.858154 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48d43b1-eac4-4194-ac84-26da0acfcedf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:22:28.859875 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48d43b1-eac4-4194-ac84-26da0acfcedf None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:22:28.866335 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 286/554] 10.222.0.23 () {56 vars in 1109 bytes} [Tue May 10 05:22:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 352 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:22:28.871673 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47ba864-bab3-4611-b9fb-441c13dac12f None admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:22:28.880323 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 269/555] 10.222.0.23 () {56 vars in 1135 bytes} [Tue May 10 05:22:28 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:22:28.885438 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48d43b1-eac4-4194-ac84-26da0acfcedf None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:22:28.987177 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48d43b1-eac4-4194-ac84-26da0acfcedf None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:22:29.022149 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548110f5-490c-474b-849b-b1b0e8f722ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:22:29.023169 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548110f5-490c-474b-849b-b1b0e8f722ec None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:29.023681 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548110f5-490c-474b-849b-b1b0e8f722ec None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:29.024152 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548110f5-490c-474b-849b-b1b0e8f722ec None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:29.074594 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47ba864-bab3-4611-b9fb-441c13dac12f None admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:22:29.092020 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548110f5-490c-474b-849b-b1b0e8f722ec None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:22:29.093800 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548110f5-490c-474b-849b-b1b0e8f722ec None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:22:29.113050 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e630b8-20f5-41dc-a4b0-b279f6e0936d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:22:29.114116 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e630b8-20f5-41dc-a4b0-b279f6e0936d None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:29.114978 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e630b8-20f5-41dc-a4b0-b279f6e0936d None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:29.115398 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e630b8-20f5-41dc-a4b0-b279f6e0936d None admin] PATH_INFO: `/v3/users/nova` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:29.125535 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e630b8-20f5-41dc-a4b0-b279f6e0936d None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:22:29.128146 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e630b8-20f5-41dc-a4b0-b279f6e0936d None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:22:29.146164 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application [None req-69e630b8-20f5-41dc-a4b0-b279f6e0936d None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 10 05:22:29.146164 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 05:22:29.146164 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 05:22:29.146164 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 05:22:29.146164 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 05:22:29.146164 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 05:22:29.146164 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 05:22:29.146164 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 05:22:29.146164 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 05:22:29.146164 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 05:22:29.146164 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 05:22:29.146164 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 05:22:29.146164 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 05:22:29.146164 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 05:22:29.146164 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 05:22:29.146164 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 05:22:29.147311 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 05:22:29.147311 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 05:22:29.147311 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 05:22:29.147311 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 05:22:29.147311 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 05:22:29.147311 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 05:22:29.147311 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 05:22:29.147311 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 05:22:29.147311 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 05:22:29.147311 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.get_or_create( May 10 05:22:29.147311 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 05:22:29.147311 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application with Lock( May 10 05:22:29.147311 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 05:22:29.147311 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self._enter() May 10 05:22:29.147311 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 05:22:29.147311 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 05:22:29.147311 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 05:22:29.147311 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.creator() May 10 05:22:29.148542 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 05:22:29.148542 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application created_value = creator( May 10 05:22:29.148542 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 05:22:29.148542 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 05:22:29.148542 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 05:22:29.148542 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 05:22:29.148542 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 05:22:29.148542 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 05:22:29.148542 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 10 05:22:29.148542 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application May 10 05:22:29.151526 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 287/556] 10.222.0.23 () {56 vars in 1093 bytes} [Tue May 10 05:22:28 2022] GET /identity/v3/users/nova => generated 82 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 05:22:29.153348 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253e7f2b-c4d2-4123-9e2e-0e333324fe02 None None] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:29.154054 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253e7f2b-c4d2-4123-9e2e-0e333324fe02 None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:29.154757 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253e7f2b-c4d2-4123-9e2e-0e333324fe02 None None] PATH_INFO: `/` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:29.156989 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 288/557] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 10 05:22:29 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 05:22:29.157951 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253e7f2b-c4d2-4123-9e2e-0e333324fe02 None None] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:22:29.197362 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 270/558] 10.222.0.23 () {58 vars in 1282 bytes} [Tue May 10 05:22:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 05:22:29.199025 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ebf132-a24f-4b8f-b9d6-309116d801e0 None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:29.199478 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ebf132-a24f-4b8f-b9d6-309116d801e0 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:29.199961 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ebf132-a24f-4b8f-b9d6-309116d801e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:29.216407 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-b8ebf132-a24f-4b8f-b9d6-309116d801e0 None None] MFA Rules not processed for user `44883b22532e44049d846938dc2cf423`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:22:29.217870 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-b8ebf132-a24f-4b8f-b9d6-309116d801e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:22:29.291719 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253e7f2b-c4d2-4123-9e2e-0e333324fe02 None None] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:22:29.292131 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 271/559] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 10 05:22:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 05:22:29.293058 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ebf132-a24f-4b8f-b9d6-309116d801e0 None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:22:29.333827 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e89add-e5ed-40ba-ab2d-a8351dfb44fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:22:29.335187 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e89add-e5ed-40ba-ab2d-a8351dfb44fb None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:29.335695 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e89add-e5ed-40ba-ab2d-a8351dfb44fb None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:29.336165 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e89add-e5ed-40ba-ab2d-a8351dfb44fb None admin] PATH_INFO: `/v3/users` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:29.337422 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e89add-e5ed-40ba-ab2d-a8351dfb44fb None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:22:29.338873 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e89add-e5ed-40ba-ab2d-a8351dfb44fb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:22:29.340744 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e89add-e5ed-40ba-ab2d-a8351dfb44fb None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:22:29.367197 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 289/560] 10.222.0.23 () {56 vars in 1133 bytes} [Tue May 10 05:22:29 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:22:29.368721 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e89add-e5ed-40ba-ab2d-a8351dfb44fb None admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:22:29.407723 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ebf132-a24f-4b8f-b9d6-309116d801e0 None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:22:29.445120 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b06c41-0a17-4360-acc3-626830163543 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:22:29.446035 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b06c41-0a17-4360-acc3-626830163543 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:29.446407 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b06c41-0a17-4360-acc3-626830163543 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:29.446717 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b06c41-0a17-4360-acc3-626830163543 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:29.457281 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b06c41-0a17-4360-acc3-626830163543 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:22:29.458919 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b06c41-0a17-4360-acc3-626830163543 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:22:29.487007 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e89add-e5ed-40ba-ab2d-a8351dfb44fb None admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:22:29.487215 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application [None req-31b06c41-0a17-4360-acc3-626830163543 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 05:22:29.487215 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 05:22:29.487215 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 05:22:29.487215 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 05:22:29.487215 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 05:22:29.487215 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 05:22:29.487215 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 05:22:29.487215 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 05:22:29.487215 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 05:22:29.487215 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 05:22:29.487215 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 05:22:29.487215 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 05:22:29.487215 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 05:22:29.487215 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 05:22:29.487215 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 05:22:29.488059 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 05:22:29.488059 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 05:22:29.488059 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 05:22:29.488059 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 05:22:29.488059 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 05:22:29.488059 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 05:22:29.488059 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.get_or_create( May 10 05:22:29.488059 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 05:22:29.488059 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application with Lock( May 10 05:22:29.488059 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 05:22:29.488059 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._enter() May 10 05:22:29.488059 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 05:22:29.488059 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 05:22:29.488059 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 05:22:29.488059 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.creator() May 10 05:22:29.488059 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 05:22:29.488059 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application created_value = creator( May 10 05:22:29.489105 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 05:22:29.489105 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 05:22:29.489105 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 05:22:29.489105 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application May 10 05:22:29.489105 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 272/561] 10.222.0.23 () {56 vars in 1108 bytes} [Tue May 10 05:22:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 05:22:29.490215 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b06c41-0a17-4360-acc3-626830163543 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:22:29.531876 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1d6275-888a-4f1f-8e9c-bbe834d7bd5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:22:29.533352 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1d6275-888a-4f1f-8e9c-bbe834d7bd5e None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:29.534204 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1d6275-888a-4f1f-8e9c-bbe834d7bd5e None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:29.534484 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1d6275-888a-4f1f-8e9c-bbe834d7bd5e None admin] PATH_INFO: `/v3/roles/service` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:29.547940 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1d6275-888a-4f1f-8e9c-bbe834d7bd5e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 05:22:29.556414 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application [None req-fc1d6275-888a-4f1f-8e9c-bbe834d7bd5e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 10 05:22:29.556414 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 05:22:29.556414 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 05:22:29.556414 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 05:22:29.556414 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 05:22:29.556414 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 05:22:29.556414 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 05:22:29.556414 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 05:22:29.556414 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 05:22:29.556414 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 05:22:29.556414 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 05:22:29.556414 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 05:22:29.556414 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 05:22:29.556414 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 05:22:29.556414 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 05:22:29.556414 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 05:22:29.557333 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 05:22:29.557333 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 05:22:29.557333 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 05:22:29.557333 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 05:22:29.557333 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 05:22:29.557333 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 05:22:29.557333 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 05:22:29.557333 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 05:22:29.557333 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 05:22:29.557333 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.get_or_create( May 10 05:22:29.557333 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 05:22:29.557333 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application with Lock( May 10 05:22:29.557333 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 05:22:29.557333 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self._enter() May 10 05:22:29.557333 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 05:22:29.557333 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 05:22:29.558674 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 05:22:29.558674 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.creator() May 10 05:22:29.558674 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 05:22:29.558674 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application created_value = creator( May 10 05:22:29.558674 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 05:22:29.558674 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 05:22:29.558674 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 05:22:29.558674 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 05:22:29.558674 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 05:22:29.558674 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 05:22:29.558674 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 10 05:22:29.558674 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application May 10 05:22:29.562471 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 290/562] 10.222.0.23 () {56 vars in 1102 bytes} [Tue May 10 05:22:29 2022] GET /identity/v3/roles/service => generated 85 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 05:22:29.563341 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1d6275-888a-4f1f-8e9c-bbe834d7bd5e None admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:22:29.594776 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b06c41-0a17-4360-acc3-626830163543 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:22:29.629742 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27b36da-52b7-4cf3-945e-de5e1d3f1347 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:22:29.630543 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27b36da-52b7-4cf3-945e-de5e1d3f1347 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:29.630820 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27b36da-52b7-4cf3-945e-de5e1d3f1347 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:29.631078 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27b36da-52b7-4cf3-945e-de5e1d3f1347 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:29.641795 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27b36da-52b7-4cf3-945e-de5e1d3f1347 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:22:29.643248 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27b36da-52b7-4cf3-945e-de5e1d3f1347 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:22:29.662780 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application [None req-e27b36da-52b7-4cf3-945e-de5e1d3f1347 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 05:22:29.662780 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 05:22:29.662780 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 05:22:29.662780 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 05:22:29.662780 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 05:22:29.662780 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 05:22:29.662780 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 05:22:29.662780 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 05:22:29.662780 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 05:22:29.662780 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 05:22:29.662780 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 05:22:29.662780 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 05:22:29.662780 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 05:22:29.662780 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 05:22:29.662780 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 05:22:29.663740 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 05:22:29.663740 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 05:22:29.663740 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 05:22:29.663740 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 05:22:29.663740 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 05:22:29.663740 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 05:22:29.663740 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.get_or_create( May 10 05:22:29.663740 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 05:22:29.663740 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application with Lock( May 10 05:22:29.663740 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 05:22:29.663740 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._enter() May 10 05:22:29.663740 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 05:22:29.663740 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 05:22:29.663740 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 05:22:29.663740 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.creator() May 10 05:22:29.663740 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 05:22:29.663740 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application created_value = creator( May 10 05:22:29.669447 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 05:22:29.669447 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 05:22:29.669447 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 05:22:29.669447 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application May 10 05:22:29.669447 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 273/563] 10.222.0.23 () {56 vars in 1108 bytes} [Tue May 10 05:22:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 05:22:29.669447 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac1d483-cf79-49a3-83ce-06e5ae578847 None None] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:29.669447 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac1d483-cf79-49a3-83ce-06e5ae578847 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:29.669447 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac1d483-cf79-49a3-83ce-06e5ae578847 None None] PATH_INFO: `/` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:29.669447 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 274/564] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 10 05:22:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 05:22:29.669944 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac1d483-cf79-49a3-83ce-06e5ae578847 None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:22:29.680776 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1d6275-888a-4f1f-8e9c-bbe834d7bd5e None admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:22:29.713390 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceef3cae-5bba-4d4b-a580-eb62330d9f1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:22:29.714056 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceef3cae-5bba-4d4b-a580-eb62330d9f1a None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:29.714332 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceef3cae-5bba-4d4b-a580-eb62330d9f1a None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:29.714601 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceef3cae-5bba-4d4b-a580-eb62330d9f1a None admin] PATH_INFO: `/v3/domains` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:29.715338 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceef3cae-5bba-4d4b-a580-eb62330d9f1a None admin] RBAC: Adding query filter params (name=Default) {{(pid=79879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:22:29.715666 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceef3cae-5bba-4d4b-a580-eb62330d9f1a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:22:29.717072 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceef3cae-5bba-4d4b-a580-eb62330d9f1a None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:22:29.733297 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 291/565] 10.222.0.23 () {56 vars in 1109 bytes} [Tue May 10 05:22:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:22:29.733297 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceef3cae-5bba-4d4b-a580-eb62330d9f1a None admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:22:29.786341 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac1d483-cf79-49a3-83ce-06e5ae578847 None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:22:29.825188 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8145ef-8ba8-4764-afe3-72bc57e8b085 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:22:29.827367 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8145ef-8ba8-4764-afe3-72bc57e8b085 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:29.827896 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8145ef-8ba8-4764-afe3-72bc57e8b085 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:29.828477 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8145ef-8ba8-4764-afe3-72bc57e8b085 None admin] PATH_INFO: `/v3/roles` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:29.829468 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8145ef-8ba8-4764-afe3-72bc57e8b085 None admin] RBAC: Adding query filter params (name=service) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:22:29.830053 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8145ef-8ba8-4764-afe3-72bc57e8b085 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:22:29.832599 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8145ef-8ba8-4764-afe3-72bc57e8b085 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:22:29.843635 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 275/566] 10.222.0.23 () {56 vars in 1103 bytes} [Tue May 10 05:22:29 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:22:29.843635 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2957baa-fd3b-4162-bc2f-539ff5c73a02 None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:29.843635 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2957baa-fd3b-4162-bc2f-539ff5c73a02 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:29.843635 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2957baa-fd3b-4162-bc2f-539ff5c73a02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:29.861498 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-e2957baa-fd3b-4162-bc2f-539ff5c73a02 None None] MFA Rules not processed for user `44883b22532e44049d846938dc2cf423`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:22:29.862696 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-e2957baa-fd3b-4162-bc2f-539ff5c73a02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:22:29.868509 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceef3cae-5bba-4d4b-a580-eb62330d9f1a None admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:22:29.912907 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a879aa4b-d1c4-430a-846c-988714cf5e76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:22:29.913943 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a879aa4b-d1c4-430a-846c-988714cf5e76 None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:29.914444 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a879aa4b-d1c4-430a-846c-988714cf5e76 None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:29.915353 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a879aa4b-d1c4-430a-846c-988714cf5e76 None admin] PATH_INFO: `/v3/domains` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:29.916632 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a879aa4b-d1c4-430a-846c-988714cf5e76 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:22:29.917144 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a879aa4b-d1c4-430a-846c-988714cf5e76 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:22:29.919439 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a879aa4b-d1c4-430a-846c-988714cf5e76 None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:22:29.939597 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 276/567] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 10 05:22:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 05:22:29.939597 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2957baa-fd3b-4162-bc2f-539ff5c73a02 None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:22:29.948081 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 292/568] 10.222.0.23 () {56 vars in 1109 bytes} [Tue May 10 05:22:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:22:29.948986 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a879aa4b-d1c4-430a-846c-988714cf5e76 None admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:22:30.044224 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2957baa-fd3b-4162-bc2f-539ff5c73a02 None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:22:30.065885 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a879aa4b-d1c4-430a-846c-988714cf5e76 None admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:22:30.081783 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71786207-3e27-4fe6-ade8-b85ef9deae4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:22:30.082567 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71786207-3e27-4fe6-ade8-b85ef9deae4a None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:30.082843 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71786207-3e27-4fe6-ade8-b85ef9deae4a None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:30.083318 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71786207-3e27-4fe6-ade8-b85ef9deae4a None admin] PATH_INFO: `/v3/projects/service` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:30.089797 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71786207-3e27-4fe6-ade8-b85ef9deae4a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:22:30.091236 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71786207-3e27-4fe6-ade8-b85ef9deae4a None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:22:30.099434 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b605abed-9ac5-4b9b-977d-2d7c9cd1e899 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:22:30.100313 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b605abed-9ac5-4b9b-977d-2d7c9cd1e899 None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:30.100595 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b605abed-9ac5-4b9b-977d-2d7c9cd1e899 None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:30.100870 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b605abed-9ac5-4b9b-977d-2d7c9cd1e899 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:30.104496 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application [None req-71786207-3e27-4fe6-ade8-b85ef9deae4a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 05:22:30.104496 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 05:22:30.104496 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 05:22:30.104496 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 05:22:30.104496 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 05:22:30.104496 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 05:22:30.104496 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 05:22:30.104496 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 05:22:30.104496 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 05:22:30.104496 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 05:22:30.104496 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 05:22:30.104496 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 05:22:30.104496 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 05:22:30.104496 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 05:22:30.104496 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 05:22:30.105384 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 05:22:30.105384 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 05:22:30.105384 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 05:22:30.105384 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 05:22:30.105384 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 05:22:30.105384 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 05:22:30.105384 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.get_or_create( May 10 05:22:30.105384 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 05:22:30.105384 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application with Lock( May 10 05:22:30.105384 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 05:22:30.105384 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._enter() May 10 05:22:30.105384 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 05:22:30.105384 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 05:22:30.105384 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 05:22:30.105384 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.creator() May 10 05:22:30.105384 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 05:22:30.105384 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application created_value = creator( May 10 05:22:30.106255 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 05:22:30.106255 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 05:22:30.106255 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 05:22:30.106255 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 05:22:30.106255 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 05:22:30.106255 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 05:22:30.106255 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 05:22:30.106255 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application May 10 05:22:30.110629 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 277/569] 10.222.0.23 () {56 vars in 1111 bytes} [Tue May 10 05:22:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 05:22:30.111658 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b605abed-9ac5-4b9b-977d-2d7c9cd1e899 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:22:30.112017 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396a7121-8cf3-40b6-8895-d50d71c2748d None None] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:30.112303 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396a7121-8cf3-40b6-8895-d50d71c2748d None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:30.112577 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396a7121-8cf3-40b6-8895-d50d71c2748d None None] PATH_INFO: `/` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:30.113473 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b605abed-9ac5-4b9b-977d-2d7c9cd1e899 None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:22:30.115636 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 278/570] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 10 05:22:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 05:22:30.115636 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396a7121-8cf3-40b6-8895-d50d71c2748d None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:22:30.135075 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application [None req-b605abed-9ac5-4b9b-977d-2d7c9cd1e899 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 05:22:30.135075 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 05:22:30.135075 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 05:22:30.135075 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 05:22:30.135075 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 05:22:30.135075 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 05:22:30.135075 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 05:22:30.135075 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 05:22:30.135075 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 05:22:30.135075 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 05:22:30.135075 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 05:22:30.135075 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 05:22:30.135075 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 05:22:30.135075 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 05:22:30.135075 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 05:22:30.136164 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 05:22:30.136164 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 05:22:30.136164 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 05:22:30.136164 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 05:22:30.136164 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 05:22:30.136164 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 05:22:30.136164 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.get_or_create( May 10 05:22:30.136164 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 05:22:30.136164 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application with Lock( May 10 05:22:30.136164 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 05:22:30.136164 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self._enter() May 10 05:22:30.136164 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 05:22:30.136164 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 05:22:30.136164 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 05:22:30.136164 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.creator() May 10 05:22:30.136164 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 05:22:30.136164 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application created_value = creator( May 10 05:22:30.137534 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 05:22:30.137534 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 05:22:30.137534 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 05:22:30.137534 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application May 10 05:22:30.137534 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 293/571] 10.222.0.23 () {56 vars in 1108 bytes} [Tue May 10 05:22:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 05:22:30.137534 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b605abed-9ac5-4b9b-977d-2d7c9cd1e899 None admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:22:30.218649 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396a7121-8cf3-40b6-8895-d50d71c2748d None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:22:30.230507 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b605abed-9ac5-4b9b-977d-2d7c9cd1e899 None admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:22:30.252056 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7761a0e7-850a-460a-9636-0bcbe5afd74c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:22:30.252865 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7761a0e7-850a-460a-9636-0bcbe5afd74c None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:30.253145 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7761a0e7-850a-460a-9636-0bcbe5afd74c None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:30.253416 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7761a0e7-850a-460a-9636-0bcbe5afd74c None admin] PATH_INFO: `/v3/projects/service` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:30.260035 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7761a0e7-850a-460a-9636-0bcbe5afd74c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:22:30.261494 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7761a0e7-850a-460a-9636-0bcbe5afd74c None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:22:30.261721 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30671c66-5f93-4f21-b28c-fae3bfb1997a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:22:30.262518 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30671c66-5f93-4f21-b28c-fae3bfb1997a None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:30.262798 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30671c66-5f93-4f21-b28c-fae3bfb1997a None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:30.263072 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30671c66-5f93-4f21-b28c-fae3bfb1997a None admin] PATH_INFO: `/v3/roles/service` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:30.272592 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30671c66-5f93-4f21-b28c-fae3bfb1997a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 05:22:30.275404 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application [None req-7761a0e7-850a-460a-9636-0bcbe5afd74c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 05:22:30.275404 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 05:22:30.275404 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 05:22:30.275404 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 05:22:30.275404 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 05:22:30.275404 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 05:22:30.275404 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 05:22:30.275404 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 05:22:30.275404 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 05:22:30.275404 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 05:22:30.275404 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 05:22:30.275404 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 05:22:30.275404 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 05:22:30.275404 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 05:22:30.275404 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 05:22:30.276326 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 05:22:30.276326 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 05:22:30.276326 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 05:22:30.276326 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 05:22:30.276326 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 05:22:30.276326 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 05:22:30.276326 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.get_or_create( May 10 05:22:30.276326 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 05:22:30.276326 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application with Lock( May 10 05:22:30.276326 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 05:22:30.276326 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._enter() May 10 05:22:30.276326 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 05:22:30.276326 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 05:22:30.276326 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 05:22:30.276326 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.creator() May 10 05:22:30.276326 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 05:22:30.276326 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application created_value = creator( May 10 05:22:30.277224 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 05:22:30.277224 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 05:22:30.277224 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 05:22:30.277224 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 05:22:30.277224 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 05:22:30.277224 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 05:22:30.277224 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 05:22:30.277224 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application May 10 05:22:30.277224 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 279/572] 10.222.0.23 () {56 vars in 1111 bytes} [Tue May 10 05:22:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 05:22:30.277937 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7761a0e7-850a-460a-9636-0bcbe5afd74c None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:22:30.280191 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application [None req-30671c66-5f93-4f21-b28c-fae3bfb1997a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 10 05:22:30.280191 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 05:22:30.280191 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 05:22:30.280191 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 05:22:30.280191 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 05:22:30.280191 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 05:22:30.280191 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 05:22:30.280191 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 05:22:30.280191 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 05:22:30.280191 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 05:22:30.280191 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 05:22:30.280191 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 05:22:30.280191 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 05:22:30.280191 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 05:22:30.280191 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 05:22:30.280191 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 05:22:30.281446 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 05:22:30.281446 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 05:22:30.281446 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 05:22:30.281446 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 05:22:30.281446 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 05:22:30.281446 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 05:22:30.281446 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 05:22:30.281446 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 05:22:30.281446 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 05:22:30.281446 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.get_or_create( May 10 05:22:30.281446 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 05:22:30.281446 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application with Lock( May 10 05:22:30.281446 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 05:22:30.281446 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self._enter() May 10 05:22:30.281446 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 05:22:30.281446 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 05:22:30.282631 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 05:22:30.282631 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.creator() May 10 05:22:30.282631 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 05:22:30.282631 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application created_value = creator( May 10 05:22:30.282631 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 05:22:30.282631 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 05:22:30.282631 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 05:22:30.282631 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 05:22:30.282631 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 05:22:30.282631 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 05:22:30.282631 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 10 05:22:30.282631 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application May 10 05:22:30.282631 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 294/573] 10.222.0.23 () {56 vars in 1102 bytes} [Tue May 10 05:22:30 2022] GET /identity/v3/roles/service => generated 85 bytes in 145 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 05:22:30.283325 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182ae2ee-d329-40d4-a4ed-c2551655f49a None None] REQUEST_METHOD: `POST` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:30.283325 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182ae2ee-d329-40d4-a4ed-c2551655f49a None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:30.283325 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182ae2ee-d329-40d4-a4ed-c2551655f49a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:30.301225 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.auth.core [None req-182ae2ee-d329-40d4-a4ed-c2551655f49a None None] MFA Rules not processed for user `44883b22532e44049d846938dc2cf423`. Rule list: `[]` (Enabled: `True`). {{(pid=79879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:22:30.302404 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-182ae2ee-d329-40d4-a4ed-c2551655f49a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:22:30.379688 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 295/574] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 10 05:22:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 05:22:30.379688 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182ae2ee-d329-40d4-a4ed-c2551655f49a None None] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:22:30.379930 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7761a0e7-850a-460a-9636-0bcbe5afd74c None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:22:30.414730 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73268a40-7dbc-4d18-90a9-0c9723bb2cff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:22:30.415394 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73268a40-7dbc-4d18-90a9-0c9723bb2cff None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:30.415699 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73268a40-7dbc-4d18-90a9-0c9723bb2cff None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:30.415978 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73268a40-7dbc-4d18-90a9-0c9723bb2cff None admin] PATH_INFO: `/v3/projects` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:30.416773 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73268a40-7dbc-4d18-90a9-0c9723bb2cff None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:22:30.417079 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73268a40-7dbc-4d18-90a9-0c9723bb2cff None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:22:30.418516 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73268a40-7dbc-4d18-90a9-0c9723bb2cff None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:22:30.430178 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 280/575] 10.222.0.23 () {56 vars in 1148 bytes} [Tue May 10 05:22:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:22:30.430853 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73268a40-7dbc-4d18-90a9-0c9723bb2cff None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:22:30.473667 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182ae2ee-d329-40d4-a4ed-c2551655f49a None None] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:22:30.507101 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92d08b1-5bcf-43e0-9a59-e392983fe2bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:22:30.507800 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92d08b1-5bcf-43e0-9a59-e392983fe2bb None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:30.508081 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92d08b1-5bcf-43e0-9a59-e392983fe2bb None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:30.508358 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92d08b1-5bcf-43e0-9a59-e392983fe2bb None admin] PATH_INFO: `/v3/domains` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:30.509091 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92d08b1-5bcf-43e0-9a59-e392983fe2bb None admin] RBAC: Adding query filter params (name=Default) {{(pid=79879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:22:30.509405 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92d08b1-5bcf-43e0-9a59-e392983fe2bb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:22:30.510803 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92d08b1-5bcf-43e0-9a59-e392983fe2bb None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:22:30.521985 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 296/576] 10.222.0.23 () {56 vars in 1109 bytes} [Tue May 10 05:22:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:22:30.522752 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92d08b1-5bcf-43e0-9a59-e392983fe2bb None admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:22:30.522901 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73268a40-7dbc-4d18-90a9-0c9723bb2cff None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:22:30.556003 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a5ea80-b042-4dc8-aa1b-04a34a9fd3bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:22:30.556643 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a5ea80-b042-4dc8-aa1b-04a34a9fd3bd None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:30.556915 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a5ea80-b042-4dc8-aa1b-04a34a9fd3bd None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:30.557183 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a5ea80-b042-4dc8-aa1b-04a34a9fd3bd None admin] PATH_INFO: `/v3/projects` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:30.557983 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a5ea80-b042-4dc8-aa1b-04a34a9fd3bd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:22:30.558286 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a5ea80-b042-4dc8-aa1b-04a34a9fd3bd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:22:30.559740 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a5ea80-b042-4dc8-aa1b-04a34a9fd3bd None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:22:30.571234 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 281/577] 10.222.0.23 () {56 vars in 1148 bytes} [Tue May 10 05:22:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:22:30.572038 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a5ea80-b042-4dc8-aa1b-04a34a9fd3bd None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:22:30.617396 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92d08b1-5bcf-43e0-9a59-e392983fe2bb None admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:22:30.650025 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328022fc-8d67-4480-8f9b-6a6258eb7870 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:22:30.650625 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328022fc-8d67-4480-8f9b-6a6258eb7870 None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:30.650908 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328022fc-8d67-4480-8f9b-6a6258eb7870 None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:30.651188 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328022fc-8d67-4480-8f9b-6a6258eb7870 None admin] PATH_INFO: `/v3/roles` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:30.651980 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328022fc-8d67-4480-8f9b-6a6258eb7870 None admin] RBAC: Adding query filter params (name=service) {{(pid=79879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:22:30.652291 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328022fc-8d67-4480-8f9b-6a6258eb7870 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:22:30.653680 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328022fc-8d67-4480-8f9b-6a6258eb7870 None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:22:30.661424 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 297/578] 10.222.0.23 () {56 vars in 1103 bytes} [Tue May 10 05:22:30 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:22:30.661563 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a5ea80-b042-4dc8-aa1b-04a34a9fd3bd None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:22:30.662193 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328022fc-8d67-4480-8f9b-6a6258eb7870 None admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:22:30.694033 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57777c21-c9ae-471a-890c-5bc850a55c62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:22:30.694823 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57777c21-c9ae-471a-890c-5bc850a55c62 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:30.695105 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57777c21-c9ae-471a-890c-5bc850a55c62 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:30.695380 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57777c21-c9ae-471a-890c-5bc850a55c62 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:30.706030 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57777c21-c9ae-471a-890c-5bc850a55c62 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 05:22:30.713833 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application [None req-57777c21-c9ae-471a-890c-5bc850a55c62 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 10 05:22:30.713833 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 05:22:30.713833 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 05:22:30.713833 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 05:22:30.713833 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 05:22:30.713833 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 05:22:30.713833 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 05:22:30.713833 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 05:22:30.713833 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 05:22:30.713833 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 05:22:30.713833 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 05:22:30.713833 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 05:22:30.713833 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 05:22:30.713833 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 05:22:30.713833 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 05:22:30.713833 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 05:22:30.714834 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 05:22:30.714834 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 05:22:30.714834 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 05:22:30.714834 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 05:22:30.714834 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 05:22:30.714834 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 05:22:30.714834 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 05:22:30.714834 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 05:22:30.714834 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 05:22:30.714834 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.get_or_create( May 10 05:22:30.714834 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 05:22:30.714834 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application with Lock( May 10 05:22:30.714834 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 05:22:30.714834 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._enter() May 10 05:22:30.714834 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 05:22:30.714834 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 05:22:30.715959 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 05:22:30.715959 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.creator() May 10 05:22:30.715959 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 05:22:30.715959 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application created_value = creator( May 10 05:22:30.715959 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 05:22:30.715959 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 05:22:30.715959 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 05:22:30.715959 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 05:22:30.715959 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 05:22:30.715959 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 05:22:30.715959 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 10 05:22:30.715959 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application May 10 05:22:30.715959 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 282/579] 10.222.0.23 () {56 vars in 1102 bytes} [Tue May 10 05:22:30 2022] GET /identity/v3/roles/service => generated 85 bytes in 143 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 05:22:30.715959 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57777c21-c9ae-471a-890c-5bc850a55c62 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:22:30.765032 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328022fc-8d67-4480-8f9b-6a6258eb7870 None admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:22:30.795888 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06843b38-0fb5-4c1e-b4f4-1de652b2a974 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:22:30.796520 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06843b38-0fb5-4c1e-b4f4-1de652b2a974 None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:30.796839 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06843b38-0fb5-4c1e-b4f4-1de652b2a974 None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:30.797119 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06843b38-0fb5-4c1e-b4f4-1de652b2a974 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:30.797964 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06843b38-0fb5-4c1e-b4f4-1de652b2a974 None admin] RBAC: Adding query filter params (role.id=8a02b9040d1d4fccababc1eb4dac80e7, scope.project.id=5f23435f783540199d6dcfd0417c090e, user.id=fd31dacf30804395bd029037b407c12a) {{(pid=79879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:22:30.798274 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06843b38-0fb5-4c1e-b4f4-1de652b2a974 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:22:30.799759 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06843b38-0fb5-4c1e-b4f4-1de652b2a974 None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:22:30.805417 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 298/580] 10.222.0.23 () {56 vars in 1374 bytes} [Tue May 10 05:22:30 2022] GET /identity/v3/role_assignments?user.id=fd31dacf30804395bd029037b407c12a&scope.project.id=5f23435f783540199d6dcfd0417c090e&role.id=8a02b9040d1d4fccababc1eb4dac80e7 => generated 259 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:22:30.806258 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06843b38-0fb5-4c1e-b4f4-1de652b2a974 None admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:22:30.813338 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57777c21-c9ae-471a-890c-5bc850a55c62 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:22:30.851379 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb0bbd5-ce78-4031-9e31-f828aa21f6fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:22:30.852219 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb0bbd5-ce78-4031-9e31-f828aa21f6fc None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:30.852590 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb0bbd5-ce78-4031-9e31-f828aa21f6fc None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:30.852858 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb0bbd5-ce78-4031-9e31-f828aa21f6fc None admin] PATH_INFO: `/v3/users/glance` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:30.861479 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb0bbd5-ce78-4031-9e31-f828aa21f6fc None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:22:30.862992 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb0bbd5-ce78-4031-9e31-f828aa21f6fc None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:22:30.878676 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application [None req-7bb0bbd5-ce78-4031-9e31-f828aa21f6fc None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 10 05:22:30.878676 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 05:22:30.878676 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 05:22:30.878676 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 05:22:30.878676 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 05:22:30.878676 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 05:22:30.878676 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 05:22:30.878676 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 05:22:30.878676 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 05:22:30.878676 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 05:22:30.878676 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 05:22:30.878676 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 05:22:30.878676 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 05:22:30.878676 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 05:22:30.878676 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 05:22:30.878676 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 05:22:30.879857 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 05:22:30.879857 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 05:22:30.879857 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 05:22:30.879857 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 05:22:30.879857 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 05:22:30.879857 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 05:22:30.879857 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 05:22:30.879857 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 05:22:30.879857 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 05:22:30.879857 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.get_or_create( May 10 05:22:30.879857 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 05:22:30.879857 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application with Lock( May 10 05:22:30.879857 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 05:22:30.879857 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._enter() May 10 05:22:30.879857 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 05:22:30.879857 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 05:22:30.879857 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 05:22:30.879857 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.creator() May 10 05:22:30.880824 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 05:22:30.880824 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application created_value = creator( May 10 05:22:30.880824 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 05:22:30.880824 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 05:22:30.880824 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 05:22:30.880824 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 05:22:30.880824 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 05:22:30.880824 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 05:22:30.880824 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 10 05:22:30.880824 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application May 10 05:22:30.880824 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 283/581] 10.222.0.23 () {56 vars in 1099 bytes} [Tue May 10 05:22:30 2022] GET /identity/v3/users/glance => generated 84 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 05:22:30.880824 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb0bbd5-ce78-4031-9e31-f828aa21f6fc None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:22:30.914035 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06843b38-0fb5-4c1e-b4f4-1de652b2a974 None admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:22:30.948203 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab5e392-65e6-4250-a15c-f6c757e9e4b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:22:30.949129 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab5e392-65e6-4250-a15c-f6c757e9e4b6 None admin] REQUEST_METHOD: `PUT` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:30.949410 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab5e392-65e6-4250-a15c-f6c757e9e4b6 None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:30.949684 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab5e392-65e6-4250-a15c-f6c757e9e4b6 None admin] PATH_INFO: `/v3/projects/5f23435f783540199d6dcfd0417c090e/users/7f50f224ca944983aecfde86375473da/roles/8a02b9040d1d4fccababc1eb4dac80e7` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:30.965556 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab5e392-65e6-4250-a15c-f6c757e9e4b6 None admin] RBAC: Authorizing `identity:create_grant(project_id=5f23435f783540199d6dcfd0417c090e, user_id=7f50f224ca944983aecfde86375473da, role_id=8a02b9040d1d4fccababc1eb4dac80e7)` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:22:30.967027 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab5e392-65e6-4250-a15c-f6c757e9e4b6 None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:22:30.980286 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 299/582] 10.222.0.23 () {58 vars in 1439 bytes} [Tue May 10 05:22:30 2022] PUT /identity/v3/projects/5f23435f783540199d6dcfd0417c090e/users/7f50f224ca944983aecfde86375473da/roles/8a02b9040d1d4fccababc1eb4dac80e7 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 05:22:30.981129 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab5e392-65e6-4250-a15c-f6c757e9e4b6 None admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:22:31.000964 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb0bbd5-ce78-4031-9e31-f828aa21f6fc None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:22:31.048222 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d87c076-c19b-404c-9770-442cb632fa09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:22:31.049048 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d87c076-c19b-404c-9770-442cb632fa09 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:31.049371 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d87c076-c19b-404c-9770-442cb632fa09 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:31.049644 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d87c076-c19b-404c-9770-442cb632fa09 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:31.063172 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d87c076-c19b-404c-9770-442cb632fa09 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:22:31.064724 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d87c076-c19b-404c-9770-442cb632fa09 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:22:31.084218 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application [None req-8d87c076-c19b-404c-9770-442cb632fa09 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 05:22:31.084218 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 05:22:31.084218 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 05:22:31.084218 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 05:22:31.084218 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 05:22:31.084218 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 05:22:31.084218 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 05:22:31.084218 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 05:22:31.084218 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 05:22:31.084218 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 05:22:31.084218 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 05:22:31.084218 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 05:22:31.084218 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 05:22:31.084218 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 05:22:31.084218 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 05:22:31.085215 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 05:22:31.085215 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 05:22:31.085215 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 05:22:31.085215 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 05:22:31.085215 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 05:22:31.085215 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 05:22:31.085215 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.get_or_create( May 10 05:22:31.085215 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 05:22:31.085215 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application with Lock( May 10 05:22:31.085215 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 05:22:31.085215 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._enter() May 10 05:22:31.085215 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 05:22:31.085215 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 05:22:31.085215 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 05:22:31.085215 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.creator() May 10 05:22:31.085215 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 05:22:31.085215 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application created_value = creator( May 10 05:22:31.086560 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 05:22:31.086560 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 05:22:31.086560 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 05:22:31.086560 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application May 10 05:22:31.086560 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 284/583] 10.222.0.23 () {56 vars in 1108 bytes} [Tue May 10 05:22:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 05:22:31.086909 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d87c076-c19b-404c-9770-442cb632fa09 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:22:31.096688 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab5e392-65e6-4250-a15c-f6c757e9e4b6 None admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:22:31.134670 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4770a9cc-d131-44d7-9659-e59768eb525e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:22:31.135864 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4770a9cc-d131-44d7-9659-e59768eb525e None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:31.136700 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4770a9cc-d131-44d7-9659-e59768eb525e None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:31.137131 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4770a9cc-d131-44d7-9659-e59768eb525e None admin] PATH_INFO: `/v3/roles` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:31.138301 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4770a9cc-d131-44d7-9659-e59768eb525e None admin] RBAC: Adding query filter params (name=service) {{(pid=79879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:22:31.138953 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4770a9cc-d131-44d7-9659-e59768eb525e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:22:31.140872 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4770a9cc-d131-44d7-9659-e59768eb525e None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:22:31.153561 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 300/584] 10.222.0.23 () {56 vars in 1103 bytes} [Tue May 10 05:22:30 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:22:31.154810 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4770a9cc-d131-44d7-9659-e59768eb525e None admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:22:31.197932 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d87c076-c19b-404c-9770-442cb632fa09 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:22:31.246266 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b641cbf1-8cab-4c92-a458-d97ca7b691a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:22:31.247604 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b641cbf1-8cab-4c92-a458-d97ca7b691a7 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:31.248084 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b641cbf1-8cab-4c92-a458-d97ca7b691a7 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:31.248543 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b641cbf1-8cab-4c92-a458-d97ca7b691a7 None admin] PATH_INFO: `/v3/users` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:31.250110 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b641cbf1-8cab-4c92-a458-d97ca7b691a7 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:22:31.250977 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b641cbf1-8cab-4c92-a458-d97ca7b691a7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:22:31.253077 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b641cbf1-8cab-4c92-a458-d97ca7b691a7 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:22:31.270277 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4770a9cc-d131-44d7-9659-e59768eb525e None admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:22:31.273724 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 285/585] 10.222.0.23 () {56 vars in 1137 bytes} [Tue May 10 05:22:31 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:22:31.274385 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b641cbf1-8cab-4c92-a458-d97ca7b691a7 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:22:31.316335 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a751ba7-01d3-4784-9a6f-d3aa72bc6cbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:22:31.317721 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a751ba7-01d3-4784-9a6f-d3aa72bc6cbb None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:31.318377 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a751ba7-01d3-4784-9a6f-d3aa72bc6cbb None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:31.318883 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a751ba7-01d3-4784-9a6f-d3aa72bc6cbb None admin] PATH_INFO: `/v3/domains` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:31.320435 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a751ba7-01d3-4784-9a6f-d3aa72bc6cbb None admin] RBAC: Adding query filter params (name=Default) {{(pid=79879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:22:31.320997 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a751ba7-01d3-4784-9a6f-d3aa72bc6cbb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:22:31.323076 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a751ba7-01d3-4784-9a6f-d3aa72bc6cbb None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:22:31.340129 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 301/586] 10.222.0.23 () {56 vars in 1109 bytes} [Tue May 10 05:22:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:22:31.342228 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a751ba7-01d3-4784-9a6f-d3aa72bc6cbb None admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:22:31.371285 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b641cbf1-8cab-4c92-a458-d97ca7b691a7 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:22:31.404589 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63bc74f-0502-402f-904e-588c07416af4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:22:31.405404 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63bc74f-0502-402f-904e-588c07416af4 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:31.405684 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63bc74f-0502-402f-904e-588c07416af4 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:31.406255 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63bc74f-0502-402f-904e-588c07416af4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:31.416201 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63bc74f-0502-402f-904e-588c07416af4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:22:31.417716 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63bc74f-0502-402f-904e-588c07416af4 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:22:31.435436 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application [None req-a63bc74f-0502-402f-904e-588c07416af4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 05:22:31.435436 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 05:22:31.435436 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 05:22:31.435436 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 05:22:31.435436 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 05:22:31.435436 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 05:22:31.435436 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 05:22:31.435436 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 05:22:31.435436 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 05:22:31.435436 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 05:22:31.435436 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 05:22:31.435436 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 05:22:31.435436 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 05:22:31.435436 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 05:22:31.435436 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 05:22:31.436412 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 05:22:31.436412 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 05:22:31.436412 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 05:22:31.436412 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 05:22:31.436412 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 05:22:31.436412 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 05:22:31.436412 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.get_or_create( May 10 05:22:31.436412 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 05:22:31.436412 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application with Lock( May 10 05:22:31.436412 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 05:22:31.436412 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._enter() May 10 05:22:31.436412 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 05:22:31.436412 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 05:22:31.436412 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 05:22:31.436412 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.creator() May 10 05:22:31.436412 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 05:22:31.436412 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application created_value = creator( May 10 05:22:31.437321 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 05:22:31.437321 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 05:22:31.437321 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 05:22:31.437321 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application May 10 05:22:31.441329 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 286/587] 10.222.0.23 () {56 vars in 1108 bytes} [Tue May 10 05:22:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 05:22:31.442308 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63bc74f-0502-402f-904e-588c07416af4 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:22:31.461887 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a751ba7-01d3-4784-9a6f-d3aa72bc6cbb None admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:22:31.504503 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0de1da-ef86-4815-b5b7-d5d46c9ac45d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:22:31.505314 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0de1da-ef86-4815-b5b7-d5d46c9ac45d None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:31.505595 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0de1da-ef86-4815-b5b7-d5d46c9ac45d None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:31.505871 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0de1da-ef86-4815-b5b7-d5d46c9ac45d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:31.515986 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0de1da-ef86-4815-b5b7-d5d46c9ac45d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:22:31.517699 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0de1da-ef86-4815-b5b7-d5d46c9ac45d None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:22:31.535872 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application [None req-0b0de1da-ef86-4815-b5b7-d5d46c9ac45d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 05:22:31.535872 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 05:22:31.535872 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 05:22:31.535872 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 05:22:31.535872 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 05:22:31.535872 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 05:22:31.535872 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 05:22:31.535872 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 05:22:31.535872 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 05:22:31.535872 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 05:22:31.535872 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 05:22:31.535872 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 05:22:31.535872 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 05:22:31.535872 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 05:22:31.535872 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 05:22:31.536817 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 05:22:31.536817 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 05:22:31.536817 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 05:22:31.536817 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 05:22:31.536817 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 05:22:31.536817 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 05:22:31.536817 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.get_or_create( May 10 05:22:31.536817 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 05:22:31.536817 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application with Lock( May 10 05:22:31.536817 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 05:22:31.536817 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self._enter() May 10 05:22:31.536817 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 05:22:31.536817 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 05:22:31.536817 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 05:22:31.536817 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.creator() May 10 05:22:31.536817 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 05:22:31.536817 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application created_value = creator( May 10 05:22:31.537706 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 05:22:31.537706 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 05:22:31.537706 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 05:22:31.537706 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application May 10 05:22:31.537706 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 302/588] 10.222.0.23 () {56 vars in 1108 bytes} [Tue May 10 05:22:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 05:22:31.538421 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0de1da-ef86-4815-b5b7-d5d46c9ac45d None admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:22:31.572992 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63bc74f-0502-402f-904e-588c07416af4 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:22:31.614736 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb8a85d-90a5-4adf-9b3b-f3ee72a0e68a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:22:31.615974 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb8a85d-90a5-4adf-9b3b-f3ee72a0e68a None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:31.616503 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb8a85d-90a5-4adf-9b3b-f3ee72a0e68a None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:31.616974 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb8a85d-90a5-4adf-9b3b-f3ee72a0e68a None admin] PATH_INFO: `/v3/users/cinder` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:31.627591 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb8a85d-90a5-4adf-9b3b-f3ee72a0e68a None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:22:31.629433 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb8a85d-90a5-4adf-9b3b-f3ee72a0e68a None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:22:31.642256 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0de1da-ef86-4815-b5b7-d5d46c9ac45d None admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:22:31.651502 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application [None req-fcb8a85d-90a5-4adf-9b3b-f3ee72a0e68a None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 10 05:22:31.651502 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 05:22:31.651502 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 05:22:31.651502 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 05:22:31.651502 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 05:22:31.651502 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 05:22:31.651502 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 05:22:31.651502 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 05:22:31.651502 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 05:22:31.651502 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 05:22:31.651502 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 05:22:31.651502 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 05:22:31.651502 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 05:22:31.651502 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 05:22:31.651502 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 05:22:31.651502 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 05:22:31.652511 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 05:22:31.652511 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 05:22:31.652511 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 05:22:31.652511 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 05:22:31.652511 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 05:22:31.652511 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 05:22:31.652511 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 05:22:31.652511 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 05:22:31.652511 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 05:22:31.652511 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.get_or_create( May 10 05:22:31.652511 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 05:22:31.652511 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application with Lock( May 10 05:22:31.652511 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 05:22:31.652511 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._enter() May 10 05:22:31.652511 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 05:22:31.652511 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 05:22:31.652511 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 05:22:31.652511 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.creator() May 10 05:22:31.653439 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 05:22:31.653439 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application created_value = creator( May 10 05:22:31.653439 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 05:22:31.653439 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 05:22:31.653439 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 05:22:31.653439 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 05:22:31.653439 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 05:22:31.653439 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 05:22:31.653439 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 10 05:22:31.653439 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application May 10 05:22:31.656187 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 287/589] 10.222.0.23 () {56 vars in 1099 bytes} [Tue May 10 05:22:31 2022] GET /identity/v3/users/cinder => generated 84 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 05:22:31.658004 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb8a85d-90a5-4adf-9b3b-f3ee72a0e68a None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:22:31.685412 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299c5485-c6a2-4a1d-aca9-0e35baaffe8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:22:31.686046 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299c5485-c6a2-4a1d-aca9-0e35baaffe8a None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:31.686331 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299c5485-c6a2-4a1d-aca9-0e35baaffe8a None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:31.686605 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299c5485-c6a2-4a1d-aca9-0e35baaffe8a None admin] PATH_INFO: `/v3/domains` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:31.687339 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299c5485-c6a2-4a1d-aca9-0e35baaffe8a None admin] RBAC: Adding query filter params (name=Default) {{(pid=79879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:22:31.687688 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299c5485-c6a2-4a1d-aca9-0e35baaffe8a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:22:31.689078 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299c5485-c6a2-4a1d-aca9-0e35baaffe8a None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:22:31.700974 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 303/590] 10.222.0.23 () {56 vars in 1109 bytes} [Tue May 10 05:22:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:22:31.705950 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299c5485-c6a2-4a1d-aca9-0e35baaffe8a None admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:22:31.762495 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb8a85d-90a5-4adf-9b3b-f3ee72a0e68a None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:22:31.796306 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2aa3653-fa70-411d-8fdf-4fa462667538 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:22:31.797359 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2aa3653-fa70-411d-8fdf-4fa462667538 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:31.797875 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2aa3653-fa70-411d-8fdf-4fa462667538 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:31.798342 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2aa3653-fa70-411d-8fdf-4fa462667538 None admin] PATH_INFO: `/v3/domains` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:31.799302 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2aa3653-fa70-411d-8fdf-4fa462667538 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:22:31.799836 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2aa3653-fa70-411d-8fdf-4fa462667538 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:22:31.801461 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2aa3653-fa70-411d-8fdf-4fa462667538 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:22:31.807494 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299c5485-c6a2-4a1d-aca9-0e35baaffe8a None admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:22:31.813488 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 288/591] 10.222.0.23 () {56 vars in 1109 bytes} [Tue May 10 05:22:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:22:31.814548 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2aa3653-fa70-411d-8fdf-4fa462667538 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:22:31.842175 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0a74ff-8aa7-4a00-aa7f-34917a40235a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:22:31.842853 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0a74ff-8aa7-4a00-aa7f-34917a40235a None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:31.843332 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0a74ff-8aa7-4a00-aa7f-34917a40235a None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:31.844779 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0a74ff-8aa7-4a00-aa7f-34917a40235a None admin] PATH_INFO: `/v3/users` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:31.845648 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0a74ff-8aa7-4a00-aa7f-34917a40235a None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=79879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:22:31.846795 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0a74ff-8aa7-4a00-aa7f-34917a40235a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:22:31.848626 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0a74ff-8aa7-4a00-aa7f-34917a40235a None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:22:31.868151 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 304/592] 10.222.0.23 () {56 vars in 1137 bytes} [Tue May 10 05:22:31 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:22:31.869000 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0a74ff-8aa7-4a00-aa7f-34917a40235a None admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:22:31.918497 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2aa3653-fa70-411d-8fdf-4fa462667538 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:22:31.953415 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38beb50-865a-45f2-8232-66dcd6854f07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:22:31.954604 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38beb50-865a-45f2-8232-66dcd6854f07 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:31.955236 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38beb50-865a-45f2-8232-66dcd6854f07 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:31.955772 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38beb50-865a-45f2-8232-66dcd6854f07 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:31.964021 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38beb50-865a-45f2-8232-66dcd6854f07 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:22:31.965840 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38beb50-865a-45f2-8232-66dcd6854f07 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:22:31.970305 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0a74ff-8aa7-4a00-aa7f-34917a40235a None admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:22:31.983355 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application [None req-e38beb50-865a-45f2-8232-66dcd6854f07 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 10 05:22:31.983355 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 05:22:31.983355 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 05:22:31.983355 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 05:22:31.983355 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 05:22:31.983355 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 05:22:31.983355 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 05:22:31.983355 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 05:22:31.983355 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 05:22:31.983355 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 05:22:31.983355 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 05:22:31.983355 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 05:22:31.983355 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 05:22:31.983355 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 05:22:31.983355 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 05:22:31.983355 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 05:22:31.984373 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 05:22:31.984373 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 05:22:31.984373 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 05:22:31.984373 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 05:22:31.984373 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 05:22:31.984373 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 05:22:31.984373 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 05:22:31.984373 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 05:22:31.984373 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 05:22:31.984373 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.get_or_create( May 10 05:22:31.984373 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 05:22:31.984373 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application with Lock( May 10 05:22:31.984373 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 05:22:31.984373 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._enter() May 10 05:22:31.984373 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 05:22:31.984373 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 05:22:31.984373 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 05:22:31.984373 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.creator() May 10 05:22:31.985310 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 05:22:31.985310 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application created_value = creator( May 10 05:22:31.985310 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 05:22:31.985310 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 05:22:31.985310 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 05:22:31.985310 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 05:22:31.985310 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 05:22:31.985310 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 05:22:31.985310 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 10 05:22:31.985310 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application May 10 05:22:31.992546 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 289/593] 10.222.0.23 () {56 vars in 1102 bytes} [Tue May 10 05:22:31 2022] GET /identity/v3/users/neutron => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 05:22:31.993771 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38beb50-865a-45f2-8232-66dcd6854f07 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:22:32.009077 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc8a4f8-1217-4860-9364-12fe0e89cefe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:22:32.009940 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc8a4f8-1217-4860-9364-12fe0e89cefe None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:32.011637 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc8a4f8-1217-4860-9364-12fe0e89cefe None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:32.011916 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc8a4f8-1217-4860-9364-12fe0e89cefe None admin] PATH_INFO: `/v3/projects/service` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:32.021547 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc8a4f8-1217-4860-9364-12fe0e89cefe None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:22:32.023039 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc8a4f8-1217-4860-9364-12fe0e89cefe None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:22:32.042284 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application [None req-2cc8a4f8-1217-4860-9364-12fe0e89cefe None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 05:22:32.042284 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 05:22:32.042284 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 05:22:32.042284 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 05:22:32.042284 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 05:22:32.042284 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 05:22:32.042284 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 05:22:32.042284 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 05:22:32.042284 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 05:22:32.042284 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 05:22:32.042284 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 05:22:32.042284 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 05:22:32.042284 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 05:22:32.042284 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 05:22:32.042284 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 05:22:32.043260 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 05:22:32.043260 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 05:22:32.043260 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 05:22:32.043260 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 05:22:32.043260 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 05:22:32.043260 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 05:22:32.043260 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.get_or_create( May 10 05:22:32.043260 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 05:22:32.043260 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application with Lock( May 10 05:22:32.043260 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 05:22:32.043260 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self._enter() May 10 05:22:32.043260 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 05:22:32.043260 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 05:22:32.043260 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 05:22:32.043260 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.creator() May 10 05:22:32.043260 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 05:22:32.043260 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application created_value = creator( May 10 05:22:32.044730 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 05:22:32.044730 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 05:22:32.044730 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 05:22:32.044730 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 05:22:32.044730 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 05:22:32.044730 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 05:22:32.044730 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 05:22:32.044730 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application May 10 05:22:32.044730 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 305/594] 10.222.0.23 () {56 vars in 1111 bytes} [Tue May 10 05:22:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 05:22:32.047208 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc8a4f8-1217-4860-9364-12fe0e89cefe None admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:22:32.105095 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38beb50-865a-45f2-8232-66dcd6854f07 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:22:32.138909 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaddb310-9e2f-4794-8e7e-1561e9358005 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:22:32.140096 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaddb310-9e2f-4794-8e7e-1561e9358005 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:32.140577 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaddb310-9e2f-4794-8e7e-1561e9358005 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:32.141044 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaddb310-9e2f-4794-8e7e-1561e9358005 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:32.147434 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc8a4f8-1217-4860-9364-12fe0e89cefe None admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:22:32.152179 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaddb310-9e2f-4794-8e7e-1561e9358005 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:22:32.153854 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaddb310-9e2f-4794-8e7e-1561e9358005 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:22:32.171390 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application [None req-eaddb310-9e2f-4794-8e7e-1561e9358005 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 05:22:32.171390 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 05:22:32.171390 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 05:22:32.171390 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 05:22:32.171390 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 05:22:32.171390 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 05:22:32.171390 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 05:22:32.171390 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 05:22:32.171390 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 05:22:32.171390 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 05:22:32.171390 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 05:22:32.171390 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 05:22:32.171390 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 05:22:32.171390 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 05:22:32.171390 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 05:22:32.172336 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 05:22:32.172336 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 05:22:32.172336 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 05:22:32.172336 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 05:22:32.172336 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 05:22:32.172336 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 05:22:32.172336 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.get_or_create( May 10 05:22:32.172336 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 05:22:32.172336 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application with Lock( May 10 05:22:32.172336 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 05:22:32.172336 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._enter() May 10 05:22:32.172336 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 05:22:32.172336 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 05:22:32.172336 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 05:22:32.172336 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.creator() May 10 05:22:32.172336 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 05:22:32.172336 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application created_value = creator( May 10 05:22:32.173219 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 05:22:32.173219 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 05:22:32.173219 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 05:22:32.173219 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application May 10 05:22:32.175157 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 290/595] 10.222.0.23 () {56 vars in 1108 bytes} [Tue May 10 05:22:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 05:22:32.176231 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaddb310-9e2f-4794-8e7e-1561e9358005 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:22:32.181295 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31c39b1-4269-40a5-a8b4-7c2ec048f464 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:22:32.182057 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31c39b1-4269-40a5-a8b4-7c2ec048f464 None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:32.182343 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31c39b1-4269-40a5-a8b4-7c2ec048f464 None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:32.182624 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31c39b1-4269-40a5-a8b4-7c2ec048f464 None admin] PATH_INFO: `/v3/users` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:32.183544 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31c39b1-4269-40a5-a8b4-7c2ec048f464 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=79879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:22:32.183892 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31c39b1-4269-40a5-a8b4-7c2ec048f464 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:22:32.185384 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31c39b1-4269-40a5-a8b4-7c2ec048f464 None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:22:32.209951 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 306/596] 10.222.0.23 () {56 vars in 1139 bytes} [Tue May 10 05:22:32 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:22:32.209951 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31c39b1-4269-40a5-a8b4-7c2ec048f464 None admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:22:32.282030 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaddb310-9e2f-4794-8e7e-1561e9358005 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:22:32.305260 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31c39b1-4269-40a5-a8b4-7c2ec048f464 None admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:22:32.315425 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f76454-1d85-45e5-8e1f-401545376ab7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:22:32.316433 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f76454-1d85-45e5-8e1f-401545376ab7 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:32.316988 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f76454-1d85-45e5-8e1f-401545376ab7 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:32.317457 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f76454-1d85-45e5-8e1f-401545376ab7 None admin] PATH_INFO: `/v3/projects` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:32.318449 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f76454-1d85-45e5-8e1f-401545376ab7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:22:32.318969 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f76454-1d85-45e5-8e1f-401545376ab7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:22:32.326360 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f76454-1d85-45e5-8e1f-401545376ab7 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:22:32.340305 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 291/597] 10.222.0.23 () {56 vars in 1148 bytes} [Tue May 10 05:22:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:22:32.341405 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f76454-1d85-45e5-8e1f-401545376ab7 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:22:32.344069 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff1d9ae-82d2-4577-b910-743e8fdcfd54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:22:32.344723 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff1d9ae-82d2-4577-b910-743e8fdcfd54 None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:32.345007 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff1d9ae-82d2-4577-b910-743e8fdcfd54 None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:32.345581 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff1d9ae-82d2-4577-b910-743e8fdcfd54 None admin] PATH_INFO: `/v3/domains` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:32.346556 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff1d9ae-82d2-4577-b910-743e8fdcfd54 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:22:32.346674 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff1d9ae-82d2-4577-b910-743e8fdcfd54 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:22:32.348195 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff1d9ae-82d2-4577-b910-743e8fdcfd54 None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:22:32.360672 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 307/598] 10.222.0.23 () {56 vars in 1109 bytes} [Tue May 10 05:22:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:22:32.361498 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff1d9ae-82d2-4577-b910-743e8fdcfd54 None admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:22:32.439876 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f76454-1d85-45e5-8e1f-401545376ab7 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:22:32.460424 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff1d9ae-82d2-4577-b910-743e8fdcfd54 None admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:22:32.485519 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e905e0-6023-4329-a2c5-155630bf2956 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:22:32.486636 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e905e0-6023-4329-a2c5-155630bf2956 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:32.487124 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e905e0-6023-4329-a2c5-155630bf2956 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:32.487650 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e905e0-6023-4329-a2c5-155630bf2956 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:32.494302 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ff1014-2483-42ed-9044-a1a4c46abc22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:22:32.495202 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ff1014-2483-42ed-9044-a1a4c46abc22 None admin] REQUEST_METHOD: `PUT` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:32.495486 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ff1014-2483-42ed-9044-a1a4c46abc22 None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:32.496163 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ff1014-2483-42ed-9044-a1a4c46abc22 None admin] PATH_INFO: `/v3/projects/5f23435f783540199d6dcfd0417c090e/users/a5b56aedcfd74914938b0b9cdd102f48/roles/8a02b9040d1d4fccababc1eb4dac80e7` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:32.499411 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e905e0-6023-4329-a2c5-155630bf2956 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:22:32.501130 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e905e0-6023-4329-a2c5-155630bf2956 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:22:32.510934 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ff1014-2483-42ed-9044-a1a4c46abc22 None admin] RBAC: Authorizing `identity:create_grant(project_id=5f23435f783540199d6dcfd0417c090e, user_id=a5b56aedcfd74914938b0b9cdd102f48, role_id=8a02b9040d1d4fccababc1eb4dac80e7)` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:22:32.512472 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ff1014-2483-42ed-9044-a1a4c46abc22 None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:22:32.519640 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application [None req-d8e905e0-6023-4329-a2c5-155630bf2956 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 05:22:32.519640 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 05:22:32.519640 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 05:22:32.519640 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 05:22:32.519640 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 05:22:32.519640 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 05:22:32.519640 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 05:22:32.519640 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 05:22:32.519640 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 05:22:32.519640 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 05:22:32.519640 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 05:22:32.519640 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 05:22:32.519640 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 05:22:32.519640 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 05:22:32.519640 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 05:22:32.520985 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 05:22:32.520985 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 05:22:32.520985 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 05:22:32.520985 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 05:22:32.520985 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 05:22:32.520985 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 05:22:32.520985 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.get_or_create( May 10 05:22:32.520985 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 05:22:32.520985 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application with Lock( May 10 05:22:32.520985 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 05:22:32.520985 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._enter() May 10 05:22:32.520985 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 05:22:32.520985 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 05:22:32.520985 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 05:22:32.520985 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.creator() May 10 05:22:32.520985 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 05:22:32.520985 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application created_value = creator( May 10 05:22:32.521995 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 05:22:32.521995 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 05:22:32.521995 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 05:22:32.521995 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application May 10 05:22:32.526049 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 292/599] 10.222.0.23 () {56 vars in 1108 bytes} [Tue May 10 05:22:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 05:22:32.526966 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e905e0-6023-4329-a2c5-155630bf2956 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:22:32.533750 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 308/600] 10.222.0.23 () {58 vars in 1439 bytes} [Tue May 10 05:22:32 2022] PUT /identity/v3/projects/5f23435f783540199d6dcfd0417c090e/users/a5b56aedcfd74914938b0b9cdd102f48/roles/8a02b9040d1d4fccababc1eb4dac80e7 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 05:22:32.535013 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ff1014-2483-42ed-9044-a1a4c46abc22 None admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:22:32.630288 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e905e0-6023-4329-a2c5-155630bf2956 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:22:32.644240 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ff1014-2483-42ed-9044-a1a4c46abc22 None admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:22:32.666085 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53407a21-f076-4554-8c7e-96b3bc3255df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:22:32.667008 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53407a21-f076-4554-8c7e-96b3bc3255df None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:32.667353 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53407a21-f076-4554-8c7e-96b3bc3255df None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:32.667722 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53407a21-f076-4554-8c7e-96b3bc3255df None admin] PATH_INFO: `/v3/projects/service` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:32.675074 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53407a21-f076-4554-8c7e-96b3bc3255df None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:22:32.676738 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53407a21-f076-4554-8c7e-96b3bc3255df None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:22:32.683555 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bcea94-f648-4a7f-b622-15da6ed725d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:22:32.684588 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bcea94-f648-4a7f-b622-15da6ed725d7 None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:32.685065 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bcea94-f648-4a7f-b622-15da6ed725d7 None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:32.685526 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bcea94-f648-4a7f-b622-15da6ed725d7 None admin] PATH_INFO: `/v3/domains` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:32.686483 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4bcea94-f648-4a7f-b622-15da6ed725d7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:22:32.687039 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4bcea94-f648-4a7f-b622-15da6ed725d7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:22:32.688706 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4bcea94-f648-4a7f-b622-15da6ed725d7 None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:22:32.692013 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application [None req-53407a21-f076-4554-8c7e-96b3bc3255df None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 05:22:32.692013 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 05:22:32.692013 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 05:22:32.692013 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 05:22:32.692013 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 05:22:32.692013 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 05:22:32.692013 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 05:22:32.692013 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 05:22:32.692013 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 05:22:32.692013 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 05:22:32.692013 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 05:22:32.692013 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 05:22:32.692013 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 05:22:32.692013 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 05:22:32.692013 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 05:22:32.692911 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 05:22:32.692911 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 05:22:32.692911 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 05:22:32.692911 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 05:22:32.692911 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 05:22:32.692911 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 05:22:32.692911 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.get_or_create( May 10 05:22:32.692911 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 05:22:32.692911 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application with Lock( May 10 05:22:32.692911 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 05:22:32.692911 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._enter() May 10 05:22:32.692911 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 05:22:32.692911 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 05:22:32.692911 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 05:22:32.692911 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.creator() May 10 05:22:32.692911 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 05:22:32.692911 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application created_value = creator( May 10 05:22:32.693812 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 05:22:32.693812 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 05:22:32.693812 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 05:22:32.693812 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 05:22:32.693812 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 05:22:32.693812 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 05:22:32.693812 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 05:22:32.693812 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application May 10 05:22:32.693812 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 293/601] 10.222.0.23 () {56 vars in 1111 bytes} [Tue May 10 05:22:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 05:22:32.698829 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53407a21-f076-4554-8c7e-96b3bc3255df None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:22:32.705375 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 309/602] 10.222.0.23 () {56 vars in 1109 bytes} [Tue May 10 05:22:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:22:32.713230 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bcea94-f648-4a7f-b622-15da6ed725d7 None admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:22:32.863253 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bcea94-f648-4a7f-b622-15da6ed725d7 None admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:22:32.873813 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53407a21-f076-4554-8c7e-96b3bc3255df None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:22:32.911924 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b080a8-c149-4584-afea-f1f3bdd3680e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:22:32.913162 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b080a8-c149-4584-afea-f1f3bdd3680e None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:32.913657 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b080a8-c149-4584-afea-f1f3bdd3680e None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:32.914139 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b080a8-c149-4584-afea-f1f3bdd3680e None admin] PATH_INFO: `/v3/projects/service` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:32.917883 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d75cd11-0dcf-4181-87a6-b84c597497ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:22:32.918589 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d75cd11-0dcf-4181-87a6-b84c597497ce None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:32.919159 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d75cd11-0dcf-4181-87a6-b84c597497ce None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:32.919159 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d75cd11-0dcf-4181-87a6-b84c597497ce None admin] PATH_INFO: `/v3/projects` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:32.920027 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d75cd11-0dcf-4181-87a6-b84c597497ce None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:22:32.920338 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d75cd11-0dcf-4181-87a6-b84c597497ce None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:22:32.921850 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d75cd11-0dcf-4181-87a6-b84c597497ce None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:22:32.924554 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b080a8-c149-4584-afea-f1f3bdd3680e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:22:32.926468 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b080a8-c149-4584-afea-f1f3bdd3680e None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:22:32.936264 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 294/603] 10.222.0.23 () {56 vars in 1148 bytes} [Tue May 10 05:22:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:22:32.945527 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application [None req-e3b080a8-c149-4584-afea-f1f3bdd3680e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 05:22:32.945527 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 05:22:32.945527 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 05:22:32.945527 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 05:22:32.945527 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 05:22:32.945527 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 05:22:32.945527 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 05:22:32.945527 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 05:22:32.945527 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 05:22:32.945527 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 05:22:32.945527 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 05:22:32.945527 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 05:22:32.945527 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 05:22:32.945527 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 05:22:32.945527 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 05:22:32.946477 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 05:22:32.946477 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 05:22:32.946477 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 05:22:32.946477 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 05:22:32.946477 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 05:22:32.946477 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 05:22:32.946477 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.get_or_create( May 10 05:22:32.946477 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 05:22:32.946477 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application with Lock( May 10 05:22:32.946477 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 05:22:32.946477 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self._enter() May 10 05:22:32.946477 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 05:22:32.946477 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 05:22:32.946477 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 05:22:32.946477 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.creator() May 10 05:22:32.946477 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 05:22:32.946477 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application created_value = creator( May 10 05:22:32.947369 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 05:22:32.947369 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 05:22:32.947369 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 05:22:32.947369 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 05:22:32.947369 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 05:22:32.947369 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 05:22:32.947369 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 05:22:32.947369 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application May 10 05:22:32.947847 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d75cd11-0dcf-4181-87a6-b84c597497ce None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:22:32.947931 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 310/604] 10.222.0.23 () {56 vars in 1111 bytes} [Tue May 10 05:22:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 05:22:32.957263 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b080a8-c149-4584-afea-f1f3bdd3680e None admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:22:33.049454 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d75cd11-0dcf-4181-87a6-b84c597497ce None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:22:33.057915 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b080a8-c149-4584-afea-f1f3bdd3680e None admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:22:33.091002 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e205fd34-cf87-403a-8afa-63f6b59db51b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:22:33.091947 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e205fd34-cf87-403a-8afa-63f6b59db51b None admin] REQUEST_METHOD: `PUT` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:33.092233 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e205fd34-cf87-403a-8afa-63f6b59db51b None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:33.092506 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e205fd34-cf87-403a-8afa-63f6b59db51b None admin] PATH_INFO: `/v3/projects/5f23435f783540199d6dcfd0417c090e/users/355be413675540a39ccb00e1a0722316/roles/8a02b9040d1d4fccababc1eb4dac80e7` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:33.093704 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d506d2a-7500-458d-b175-ff6aa8df7767 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:22:33.094591 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d506d2a-7500-458d-b175-ff6aa8df7767 None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:33.095091 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d506d2a-7500-458d-b175-ff6aa8df7767 None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:33.095591 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d506d2a-7500-458d-b175-ff6aa8df7767 None admin] PATH_INFO: `/v3/projects` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:33.096601 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d506d2a-7500-458d-b175-ff6aa8df7767 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:22:33.097121 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d506d2a-7500-458d-b175-ff6aa8df7767 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:22:33.098827 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d506d2a-7500-458d-b175-ff6aa8df7767 None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:22:33.111127 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 311/605] 10.222.0.23 () {56 vars in 1148 bytes} [Tue May 10 05:22:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:22:33.117390 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d506d2a-7500-458d-b175-ff6aa8df7767 None admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:22:33.124283 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e205fd34-cf87-403a-8afa-63f6b59db51b None admin] RBAC: Authorizing `identity:create_grant(project_id=5f23435f783540199d6dcfd0417c090e, user_id=355be413675540a39ccb00e1a0722316, role_id=8a02b9040d1d4fccababc1eb4dac80e7)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:22:33.125758 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e205fd34-cf87-403a-8afa-63f6b59db51b None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:22:33.163473 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 295/606] 10.222.0.23 () {58 vars in 1439 bytes} [Tue May 10 05:22:32 2022] PUT /identity/v3/projects/5f23435f783540199d6dcfd0417c090e/users/355be413675540a39ccb00e1a0722316/roles/8a02b9040d1d4fccababc1eb4dac80e7 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 05:22:33.171836 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273f35c7-ae0c-4e6e-aba2-7c2a293e0c53 None None] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:33.171836 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273f35c7-ae0c-4e6e-aba2-7c2a293e0c53 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:33.171836 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273f35c7-ae0c-4e6e-aba2-7c2a293e0c53 None None] PATH_INFO: `/` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:33.171836 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 296/607] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 10 05:22:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 05:22:33.174661 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c6df09-31b0-4cc6-9900-c809ad25c434 None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:33.174956 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c6df09-31b0-4cc6-9900-c809ad25c434 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:33.175322 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c6df09-31b0-4cc6-9900-c809ad25c434 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:33.192757 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-04c6df09-31b0-4cc6-9900-c809ad25c434 None None] MFA Rules not processed for user `44883b22532e44049d846938dc2cf423`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:22:33.194071 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-04c6df09-31b0-4cc6-9900-c809ad25c434 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:22:33.298149 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d506d2a-7500-458d-b175-ff6aa8df7767 None admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:22:33.349758 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 297/608] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 10 05:22:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 05:22:33.352334 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c81d46-2c8d-4551-a95b-08246ba985c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:22:33.353326 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c81d46-2c8d-4551-a95b-08246ba985c3 None admin] REQUEST_METHOD: `PUT` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:33.353604 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c81d46-2c8d-4551-a95b-08246ba985c3 None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:33.353874 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c81d46-2c8d-4551-a95b-08246ba985c3 None admin] PATH_INFO: `/v3/projects/5f23435f783540199d6dcfd0417c090e/users/3c8461cfdd9648b8abcaf8d34b7a102a/roles/8a02b9040d1d4fccababc1eb4dac80e7` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:33.371382 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c81d46-2c8d-4551-a95b-08246ba985c3 None admin] RBAC: Authorizing `identity:create_grant(project_id=5f23435f783540199d6dcfd0417c090e, user_id=3c8461cfdd9648b8abcaf8d34b7a102a, role_id=8a02b9040d1d4fccababc1eb4dac80e7)` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:22:33.371913 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c81d46-2c8d-4551-a95b-08246ba985c3 None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:22:33.386607 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c6df09-31b0-4cc6-9900-c809ad25c434 None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:22:33.393511 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 312/609] 10.222.0.23 () {58 vars in 1439 bytes} [Tue May 10 05:22:33 2022] PUT /identity/v3/projects/5f23435f783540199d6dcfd0417c090e/users/3c8461cfdd9648b8abcaf8d34b7a102a/roles/8a02b9040d1d4fccababc1eb4dac80e7 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 05:22:33.508401 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c6df09-31b0-4cc6-9900-c809ad25c434 None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:22:33.551656 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261ed9a2-a7c0-4eb9-9371-a0e25fdd7cc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:22:33.552510 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261ed9a2-a7c0-4eb9-9371-a0e25fdd7cc2 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:33.552789 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261ed9a2-a7c0-4eb9-9371-a0e25fdd7cc2 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:33.553056 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261ed9a2-a7c0-4eb9-9371-a0e25fdd7cc2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:33.559357 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a4a8a9-925e-43f2-b637-7b7730f2680e None None] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:33.559744 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a4a8a9-925e-43f2-b637-7b7730f2680e None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:33.559953 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a4a8a9-925e-43f2-b637-7b7730f2680e None None] PATH_INFO: `/` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:33.561544 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 313/610] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 10 05:22:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 05:22:33.568540 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cec8acc-88ad-4165-a90e-8773202db653 None None] REQUEST_METHOD: `POST` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:33.568881 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cec8acc-88ad-4165-a90e-8773202db653 None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:33.569121 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cec8acc-88ad-4165-a90e-8773202db653 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:33.570153 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261ed9a2-a7c0-4eb9-9371-a0e25fdd7cc2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 05:22:33.578276 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application [None req-261ed9a2-a7c0-4eb9-9371-a0e25fdd7cc2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 10 05:22:33.578276 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 05:22:33.578276 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 05:22:33.578276 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 05:22:33.578276 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 05:22:33.578276 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 05:22:33.578276 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 05:22:33.578276 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 05:22:33.578276 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 05:22:33.578276 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 05:22:33.578276 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 05:22:33.578276 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 05:22:33.578276 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 05:22:33.578276 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 05:22:33.578276 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 05:22:33.578276 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 05:22:33.579473 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 05:22:33.579473 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 05:22:33.579473 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 05:22:33.579473 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 05:22:33.579473 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 05:22:33.579473 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 05:22:33.579473 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 05:22:33.579473 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 05:22:33.579473 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 05:22:33.579473 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.get_or_create( May 10 05:22:33.579473 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 05:22:33.579473 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application with Lock( May 10 05:22:33.579473 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 05:22:33.579473 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._enter() May 10 05:22:33.579473 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 05:22:33.579473 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 05:22:33.580547 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 05:22:33.580547 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.creator() May 10 05:22:33.580547 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 05:22:33.580547 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application created_value = creator( May 10 05:22:33.580547 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 05:22:33.580547 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 05:22:33.580547 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 05:22:33.580547 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 05:22:33.580547 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 05:22:33.580547 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 05:22:33.580547 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 10 05:22:33.580547 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application May 10 05:22:33.583088 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 298/611] 10.222.0.23 () {56 vars in 1102 bytes} [Tue May 10 05:22:33 2022] GET /identity/v3/roles/service => generated 85 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 05:22:33.596240 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261ed9a2-a7c0-4eb9-9371-a0e25fdd7cc2 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:22:33.604780 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.auth.core [None req-8cec8acc-88ad-4165-a90e-8773202db653 None None] MFA Rules not processed for user `44883b22532e44049d846938dc2cf423`. Rule list: `[]` (Enabled: `True`). {{(pid=79879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:22:33.606010 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-8cec8acc-88ad-4165-a90e-8773202db653 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:22:33.714518 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 314/612] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 10 05:22:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 10 05:22:33.736984 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cec8acc-88ad-4165-a90e-8773202db653 None None] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:22:33.737545 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261ed9a2-a7c0-4eb9-9371-a0e25fdd7cc2 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:22:33.798237 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a7aee0-c459-442b-bd16-774b500eb3b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:22:33.798917 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a7aee0-c459-442b-bd16-774b500eb3b4 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:33.799192 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a7aee0-c459-442b-bd16-774b500eb3b4 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:33.799462 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a7aee0-c459-442b-bd16-774b500eb3b4 None admin] PATH_INFO: `/v3/roles` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:33.800254 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a7aee0-c459-442b-bd16-774b500eb3b4 None admin] RBAC: Adding query filter params (name=service) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:22:33.800558 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a7aee0-c459-442b-bd16-774b500eb3b4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:22:33.801992 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a7aee0-c459-442b-bd16-774b500eb3b4 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:22:33.832962 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 299/613] 10.222.0.23 () {56 vars in 1103 bytes} [Tue May 10 05:22:33 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 05:22:33.836886 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a7aee0-c459-442b-bd16-774b500eb3b4 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:22:33.891434 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cec8acc-88ad-4165-a90e-8773202db653 None None] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:22:33.953437 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acee676-84de-4432-8a50-550f4362ee57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:22:33.953683 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acee676-84de-4432-8a50-550f4362ee57 None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:33.953905 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acee676-84de-4432-8a50-550f4362ee57 None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:33.954108 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acee676-84de-4432-8a50-550f4362ee57 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:33.977718 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3acee676-84de-4432-8a50-550f4362ee57 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 05:22:33.989974 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application [None req-3acee676-84de-4432-8a50-550f4362ee57 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 10 05:22:33.989974 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 05:22:33.989974 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 05:22:33.989974 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 05:22:33.989974 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 05:22:33.989974 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 05:22:33.989974 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 05:22:33.989974 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 05:22:33.989974 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 05:22:33.989974 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 05:22:33.989974 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 05:22:33.989974 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 05:22:33.989974 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 05:22:33.989974 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 05:22:33.989974 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 05:22:33.989974 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 05:22:33.991041 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 05:22:33.991041 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 05:22:33.991041 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 05:22:33.991041 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 05:22:33.991041 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 05:22:33.991041 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 05:22:33.991041 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 05:22:33.991041 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 05:22:33.991041 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 05:22:33.991041 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.get_or_create( May 10 05:22:33.991041 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 05:22:33.991041 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application with Lock( May 10 05:22:33.991041 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 05:22:33.991041 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self._enter() May 10 05:22:33.991041 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 05:22:33.991041 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 05:22:33.992223 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 05:22:33.992223 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.creator() May 10 05:22:33.992223 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 05:22:33.992223 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application created_value = creator( May 10 05:22:33.992223 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 05:22:33.992223 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 05:22:33.992223 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 05:22:33.992223 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 05:22:33.992223 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 05:22:33.992223 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 05:22:33.992223 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 10 05:22:33.992223 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application May 10 05:22:33.992223 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 315/614] 10.222.0.23 () {56 vars in 1102 bytes} [Tue May 10 05:22:33 2022] GET /identity/v3/roles/service => generated 85 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 05:22:33.998075 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acee676-84de-4432-8a50-550f4362ee57 None admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:22:34.022638 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a7aee0-c459-442b-bd16-774b500eb3b4 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:22:34.082402 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66eef0d6-0beb-4a42-bd46-baefc95f6fba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:22:34.083268 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66eef0d6-0beb-4a42-bd46-baefc95f6fba None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:34.083552 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66eef0d6-0beb-4a42-bd46-baefc95f6fba None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:34.083849 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66eef0d6-0beb-4a42-bd46-baefc95f6fba None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:34.102310 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66eef0d6-0beb-4a42-bd46-baefc95f6fba None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:22:34.103796 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66eef0d6-0beb-4a42-bd46-baefc95f6fba None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:22:34.134621 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application [None req-66eef0d6-0beb-4a42-bd46-baefc95f6fba None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 05:22:34.134621 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 05:22:34.134621 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 05:22:34.134621 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 05:22:34.134621 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 05:22:34.134621 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 05:22:34.134621 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 05:22:34.134621 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 05:22:34.134621 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 05:22:34.134621 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 05:22:34.134621 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 05:22:34.134621 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 05:22:34.134621 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 05:22:34.134621 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 05:22:34.134621 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 05:22:34.135597 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 05:22:34.135597 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 05:22:34.135597 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 05:22:34.135597 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 05:22:34.135597 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 05:22:34.135597 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 05:22:34.135597 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.get_or_create( May 10 05:22:34.135597 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 05:22:34.135597 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application with Lock( May 10 05:22:34.135597 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 05:22:34.135597 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._enter() May 10 05:22:34.135597 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 05:22:34.135597 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 05:22:34.135597 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 05:22:34.135597 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.creator() May 10 05:22:34.135597 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 05:22:34.135597 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application created_value = creator( May 10 05:22:34.136491 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 05:22:34.136491 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 05:22:34.136491 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 05:22:34.136491 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application May 10 05:22:34.143713 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 300/615] 10.222.0.23 () {56 vars in 1108 bytes} [Tue May 10 05:22:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 301 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 05:22:34.150149 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66eef0d6-0beb-4a42-bd46-baefc95f6fba None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:22:34.185160 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acee676-84de-4432-8a50-550f4362ee57 None admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:22:34.236014 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5d057b-d2e4-44f2-aeeb-95d0534308fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:22:34.236632 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5d057b-d2e4-44f2-aeeb-95d0534308fc None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:34.236911 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5d057b-d2e4-44f2-aeeb-95d0534308fc None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:34.237194 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5d057b-d2e4-44f2-aeeb-95d0534308fc None admin] PATH_INFO: `/v3/roles` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:34.237953 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5d057b-d2e4-44f2-aeeb-95d0534308fc None admin] RBAC: Adding query filter params (name=service) {{(pid=79879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:22:34.238263 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5d057b-d2e4-44f2-aeeb-95d0534308fc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:22:34.244330 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5d057b-d2e4-44f2-aeeb-95d0534308fc None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:22:34.260190 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 316/616] 10.222.0.23 () {56 vars in 1103 bytes} [Tue May 10 05:22:33 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:22:34.263973 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5d057b-d2e4-44f2-aeeb-95d0534308fc None admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:22:34.357651 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66eef0d6-0beb-4a42-bd46-baefc95f6fba None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:22:34.373776 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5d057b-d2e4-44f2-aeeb-95d0534308fc None admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:22:34.411882 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c1af8b-ab41-44bb-b1c6-b386d40de1e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:22:34.412699 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c1af8b-ab41-44bb-b1c6-b386d40de1e6 None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:34.412976 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c1af8b-ab41-44bb-b1c6-b386d40de1e6 None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:34.413244 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c1af8b-ab41-44bb-b1c6-b386d40de1e6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:34.434157 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b525a4-72b0-4015-997e-6147fcb33d9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:22:34.434837 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b525a4-72b0-4015-997e-6147fcb33d9c None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:34.435116 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b525a4-72b0-4015-997e-6147fcb33d9c None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:34.435388 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b525a4-72b0-4015-997e-6147fcb33d9c None admin] PATH_INFO: `/v3/domains` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:34.436988 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c1af8b-ab41-44bb-b1c6-b386d40de1e6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:22:34.438259 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b525a4-72b0-4015-997e-6147fcb33d9c None admin] RBAC: Adding query filter params (name=Default) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:22:34.438568 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b525a4-72b0-4015-997e-6147fcb33d9c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:22:34.440093 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c1af8b-ab41-44bb-b1c6-b386d40de1e6 None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:22:34.441047 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b525a4-72b0-4015-997e-6147fcb33d9c None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:22:34.476564 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 301/617] 10.222.0.23 () {56 vars in 1109 bytes} [Tue May 10 05:22:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 332 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 05:22:34.481769 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application [None req-e5c1af8b-ab41-44bb-b1c6-b386d40de1e6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 05:22:34.481769 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 05:22:34.481769 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 05:22:34.481769 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 05:22:34.481769 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 05:22:34.481769 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 05:22:34.481769 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 05:22:34.481769 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 05:22:34.481769 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 05:22:34.481769 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 05:22:34.481769 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 05:22:34.481769 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 05:22:34.481769 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 05:22:34.481769 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 05:22:34.481769 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 05:22:34.482634 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 05:22:34.482634 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 05:22:34.482634 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 05:22:34.482634 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 05:22:34.482634 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 05:22:34.482634 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 05:22:34.482634 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.get_or_create( May 10 05:22:34.482634 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 05:22:34.482634 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application with Lock( May 10 05:22:34.482634 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 05:22:34.482634 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self._enter() May 10 05:22:34.482634 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 05:22:34.482634 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 05:22:34.482634 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 05:22:34.482634 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.creator() May 10 05:22:34.482634 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 05:22:34.482634 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application created_value = creator( May 10 05:22:34.483512 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 05:22:34.483512 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 05:22:34.483512 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 05:22:34.483512 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application May 10 05:22:34.483512 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 317/618] 10.222.0.23 () {56 vars in 1108 bytes} [Tue May 10 05:22:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 05:22:34.484397 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b525a4-72b0-4015-997e-6147fcb33d9c None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:22:34.489972 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c1af8b-ab41-44bb-b1c6-b386d40de1e6 None admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:22:34.667410 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c1af8b-ab41-44bb-b1c6-b386d40de1e6 None admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:22:34.703997 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b525a4-72b0-4015-997e-6147fcb33d9c None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:22:34.704562 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc36fbd6-c3c0-45aa-9dfc-a007b765af86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:22:34.705560 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc36fbd6-c3c0-45aa-9dfc-a007b765af86 None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:34.705995 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc36fbd6-c3c0-45aa-9dfc-a007b765af86 None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:34.706411 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc36fbd6-c3c0-45aa-9dfc-a007b765af86 None admin] PATH_INFO: `/v3/domains` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:34.707343 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc36fbd6-c3c0-45aa-9dfc-a007b765af86 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:22:34.707831 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc36fbd6-c3c0-45aa-9dfc-a007b765af86 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:22:34.709360 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc36fbd6-c3c0-45aa-9dfc-a007b765af86 None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:22:34.723757 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 318/619] 10.222.0.23 () {56 vars in 1109 bytes} [Tue May 10 05:22:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:22:34.730845 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc36fbd6-c3c0-45aa-9dfc-a007b765af86 None admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:22:34.776386 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd30bbf-fa2b-4ae5-bccd-b09a3036b921 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:22:34.777484 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd30bbf-fa2b-4ae5-bccd-b09a3036b921 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:34.777934 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd30bbf-fa2b-4ae5-bccd-b09a3036b921 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:34.778367 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd30bbf-fa2b-4ae5-bccd-b09a3036b921 None admin] PATH_INFO: `/v3/users/swift` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:34.786356 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd30bbf-fa2b-4ae5-bccd-b09a3036b921 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:22:34.788080 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd30bbf-fa2b-4ae5-bccd-b09a3036b921 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:22:34.811187 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application [None req-2fd30bbf-fa2b-4ae5-bccd-b09a3036b921 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 10 05:22:34.811187 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 05:22:34.811187 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 05:22:34.811187 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 05:22:34.811187 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 05:22:34.811187 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 05:22:34.811187 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 05:22:34.811187 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 05:22:34.811187 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 05:22:34.811187 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 05:22:34.811187 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 05:22:34.811187 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 05:22:34.811187 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 05:22:34.811187 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 05:22:34.811187 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 05:22:34.811187 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 05:22:34.812229 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 05:22:34.812229 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 05:22:34.812229 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 05:22:34.812229 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 05:22:34.812229 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 05:22:34.812229 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 05:22:34.812229 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 05:22:34.812229 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 05:22:34.812229 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 05:22:34.812229 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.get_or_create( May 10 05:22:34.812229 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 05:22:34.812229 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application with Lock( May 10 05:22:34.812229 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 05:22:34.812229 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._enter() May 10 05:22:34.812229 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 05:22:34.812229 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 05:22:34.812229 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 05:22:34.812229 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.creator() May 10 05:22:34.813209 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 05:22:34.813209 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application created_value = creator( May 10 05:22:34.813209 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 05:22:34.813209 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 05:22:34.813209 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 05:22:34.813209 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 05:22:34.813209 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 05:22:34.813209 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 05:22:34.813209 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 10 05:22:34.813209 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application May 10 05:22:34.815912 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 302/620] 10.222.0.23 () {56 vars in 1096 bytes} [Tue May 10 05:22:34 2022] GET /identity/v3/users/swift => generated 83 bytes in 332 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 05:22:34.824572 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd30bbf-fa2b-4ae5-bccd-b09a3036b921 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:22:34.902235 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc36fbd6-c3c0-45aa-9dfc-a007b765af86 None admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:22:34.941379 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30358374-b968-434e-bb53-7e573b06d45f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:22:34.942218 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30358374-b968-434e-bb53-7e573b06d45f None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:34.942500 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30358374-b968-434e-bb53-7e573b06d45f None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:34.942770 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30358374-b968-434e-bb53-7e573b06d45f None admin] PATH_INFO: `/v3/users/nova` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:34.955297 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30358374-b968-434e-bb53-7e573b06d45f None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:22:34.956790 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30358374-b968-434e-bb53-7e573b06d45f None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:22:34.982391 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application [None req-30358374-b968-434e-bb53-7e573b06d45f None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 10 05:22:34.982391 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 05:22:34.982391 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 05:22:34.982391 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 05:22:34.982391 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 05:22:34.982391 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 05:22:34.982391 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 05:22:34.982391 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 05:22:34.982391 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 05:22:34.982391 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 05:22:34.982391 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 05:22:34.982391 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 05:22:34.982391 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 05:22:34.982391 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 05:22:34.982391 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 05:22:34.982391 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 05:22:34.983427 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 05:22:34.983427 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 05:22:34.983427 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 05:22:34.983427 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 05:22:34.983427 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 05:22:34.983427 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 05:22:34.983427 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 05:22:34.983427 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 05:22:34.983427 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 05:22:34.983427 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.get_or_create( May 10 05:22:34.983427 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 05:22:34.983427 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application with Lock( May 10 05:22:34.983427 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 05:22:34.983427 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self._enter() May 10 05:22:34.983427 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 05:22:34.983427 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 05:22:34.983427 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 05:22:34.983427 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.creator() May 10 05:22:34.984437 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 05:22:34.984437 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application created_value = creator( May 10 05:22:34.984437 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 05:22:34.984437 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 05:22:34.984437 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 05:22:34.984437 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 05:22:34.984437 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 05:22:34.984437 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 05:22:34.984437 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 10 05:22:34.984437 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application May 10 05:22:34.986478 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 319/621] 10.222.0.23 () {56 vars in 1093 bytes} [Tue May 10 05:22:34 2022] GET /identity/v3/users/nova => generated 82 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 05:22:34.992494 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30358374-b968-434e-bb53-7e573b06d45f None admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:22:35.005837 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd30bbf-fa2b-4ae5-bccd-b09a3036b921 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:22:35.049871 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861cb35d-bc07-41d8-b828-8df7582738ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:22:35.050685 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861cb35d-bc07-41d8-b828-8df7582738ba None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:35.050854 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861cb35d-bc07-41d8-b828-8df7582738ba None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:35.051174 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861cb35d-bc07-41d8-b828-8df7582738ba None admin] PATH_INFO: `/v3/users` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:35.052084 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861cb35d-bc07-41d8-b828-8df7582738ba None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:22:35.052392 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861cb35d-bc07-41d8-b828-8df7582738ba None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:22:35.053892 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861cb35d-bc07-41d8-b828-8df7582738ba None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:22:35.091620 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 303/622] 10.222.0.23 () {56 vars in 1135 bytes} [Tue May 10 05:22:34 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:22:35.097248 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861cb35d-bc07-41d8-b828-8df7582738ba None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:22:35.106004 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30358374-b968-434e-bb53-7e573b06d45f None admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:22:35.148948 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2473fc4b-9700-43a0-8f29-a9427f7399df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:22:35.150063 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2473fc4b-9700-43a0-8f29-a9427f7399df None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:35.150555 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2473fc4b-9700-43a0-8f29-a9427f7399df None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:35.151030 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2473fc4b-9700-43a0-8f29-a9427f7399df None admin] PATH_INFO: `/v3/users` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:35.152204 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2473fc4b-9700-43a0-8f29-a9427f7399df None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:22:35.152716 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2473fc4b-9700-43a0-8f29-a9427f7399df None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:22:35.154462 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2473fc4b-9700-43a0-8f29-a9427f7399df None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:22:35.191360 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 320/623] 10.222.0.23 () {56 vars in 1133 bytes} [Tue May 10 05:22:34 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:22:35.197384 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2473fc4b-9700-43a0-8f29-a9427f7399df None admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:22:35.212264 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861cb35d-bc07-41d8-b828-8df7582738ba None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:22:35.251223 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e386275-6571-4bb4-aacb-3cc6ebc085f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:22:35.252055 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e386275-6571-4bb4-aacb-3cc6ebc085f8 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:35.252328 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e386275-6571-4bb4-aacb-3cc6ebc085f8 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:35.252594 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e386275-6571-4bb4-aacb-3cc6ebc085f8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:35.267822 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e386275-6571-4bb4-aacb-3cc6ebc085f8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:22:35.269279 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e386275-6571-4bb4-aacb-3cc6ebc085f8 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:22:35.296112 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application [None req-6e386275-6571-4bb4-aacb-3cc6ebc085f8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 05:22:35.296112 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 05:22:35.296112 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 05:22:35.296112 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 05:22:35.296112 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 05:22:35.296112 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 05:22:35.296112 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 05:22:35.296112 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 05:22:35.296112 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 05:22:35.296112 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 05:22:35.296112 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 05:22:35.296112 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 05:22:35.296112 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 05:22:35.296112 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 05:22:35.296112 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 05:22:35.297071 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 05:22:35.297071 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 05:22:35.297071 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 05:22:35.297071 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 05:22:35.297071 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 05:22:35.297071 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 05:22:35.297071 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.get_or_create( May 10 05:22:35.297071 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 05:22:35.297071 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application with Lock( May 10 05:22:35.297071 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 05:22:35.297071 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._enter() May 10 05:22:35.297071 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 05:22:35.297071 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 05:22:35.297071 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 05:22:35.297071 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.creator() May 10 05:22:35.297071 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 05:22:35.297071 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application created_value = creator( May 10 05:22:35.297969 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 05:22:35.297969 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 05:22:35.297969 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 05:22:35.297969 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application May 10 05:22:35.300351 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 304/624] 10.222.0.23 () {56 vars in 1108 bytes} [Tue May 10 05:22:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 05:22:35.306165 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0385e5aa-f27e-46c5-bbab-dd6d22930f23 None None] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:35.306792 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0385e5aa-f27e-46c5-bbab-dd6d22930f23 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:35.307264 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0385e5aa-f27e-46c5-bbab-dd6d22930f23 None None] PATH_INFO: `/` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:35.308952 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 305/625] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 10 05:22:35 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 05:22:35.309877 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0385e5aa-f27e-46c5-bbab-dd6d22930f23 None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:22:35.345154 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2473fc4b-9700-43a0-8f29-a9427f7399df None admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:22:35.383245 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e89c61-74f3-44c9-8b0a-d162bd02db5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:22:35.384021 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e89c61-74f3-44c9-8b0a-d162bd02db5b None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:35.384304 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e89c61-74f3-44c9-8b0a-d162bd02db5b None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:35.384627 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e89c61-74f3-44c9-8b0a-d162bd02db5b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:35.412807 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0385e5aa-f27e-46c5-bbab-dd6d22930f23 None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:22:35.446574 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fabc76-1323-4a20-b2e1-584f9fdef495 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:22:35.447566 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fabc76-1323-4a20-b2e1-584f9fdef495 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:35.448059 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fabc76-1323-4a20-b2e1-584f9fdef495 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:35.448544 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fabc76-1323-4a20-b2e1-584f9fdef495 None admin] PATH_INFO: `/v3/domains` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:35.449474 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28fabc76-1323-4a20-b2e1-584f9fdef495 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:22:35.449959 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28fabc76-1323-4a20-b2e1-584f9fdef495 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:22:35.451512 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28fabc76-1323-4a20-b2e1-584f9fdef495 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:22:35.452397 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e89c61-74f3-44c9-8b0a-d162bd02db5b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:22:35.453908 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e89c61-74f3-44c9-8b0a-d162bd02db5b None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:22:35.468659 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 306/626] 10.222.0.23 () {56 vars in 1109 bytes} [Tue May 10 05:22:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:22:35.470412 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ead0cfd-0e7f-4e5e-baea-5afb81b7b937 None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:35.470892 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ead0cfd-0e7f-4e5e-baea-5afb81b7b937 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:35.471373 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ead0cfd-0e7f-4e5e-baea-5afb81b7b937 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:35.488901 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-6ead0cfd-0e7f-4e5e-baea-5afb81b7b937 None None] MFA Rules not processed for user `44883b22532e44049d846938dc2cf423`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:22:35.490344 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-6ead0cfd-0e7f-4e5e-baea-5afb81b7b937 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:22:35.559617 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 321/627] 10.222.0.23 () {58 vars in 1282 bytes} [Tue May 10 05:22:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 10 05:22:35.559617 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e89c61-74f3-44c9-8b0a-d162bd02db5b None admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:22:35.562879 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 307/628] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 10 05:22:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 05:22:35.564137 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ead0cfd-0e7f-4e5e-baea-5afb81b7b937 None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:22:35.665931 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ead0cfd-0e7f-4e5e-baea-5afb81b7b937 None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:22:35.696434 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e89c61-74f3-44c9-8b0a-d162bd02db5b None admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:22:35.700525 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796726be-c987-4bcb-8b5c-a82ba31b65e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:22:35.701636 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796726be-c987-4bcb-8b5c-a82ba31b65e6 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:35.702152 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796726be-c987-4bcb-8b5c-a82ba31b65e6 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:35.702600 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796726be-c987-4bcb-8b5c-a82ba31b65e6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:35.713453 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796726be-c987-4bcb-8b5c-a82ba31b65e6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:22:35.715159 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796726be-c987-4bcb-8b5c-a82ba31b65e6 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:22:35.734277 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd05141e-35b2-43ce-b976-035ddb2e25ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:22:35.735079 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd05141e-35b2-43ce-b976-035ddb2e25ab None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:35.735359 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd05141e-35b2-43ce-b976-035ddb2e25ab None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:35.735676 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd05141e-35b2-43ce-b976-035ddb2e25ab None admin] PATH_INFO: `/v3/projects/service` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:35.736123 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application [None req-796726be-c987-4bcb-8b5c-a82ba31b65e6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 05:22:35.736123 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 05:22:35.736123 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 05:22:35.736123 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 05:22:35.736123 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 05:22:35.736123 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 05:22:35.736123 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 05:22:35.736123 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 05:22:35.736123 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 05:22:35.736123 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 05:22:35.736123 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 05:22:35.736123 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 05:22:35.736123 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 05:22:35.736123 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 05:22:35.736123 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 05:22:35.737021 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 05:22:35.737021 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 05:22:35.737021 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 05:22:35.737021 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 05:22:35.737021 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 05:22:35.737021 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 05:22:35.737021 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.get_or_create( May 10 05:22:35.737021 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 05:22:35.737021 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application with Lock( May 10 05:22:35.737021 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 05:22:35.737021 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._enter() May 10 05:22:35.737021 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 05:22:35.737021 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 05:22:35.737021 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 05:22:35.737021 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.creator() May 10 05:22:35.737021 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 05:22:35.737021 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application created_value = creator( May 10 05:22:35.737921 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 05:22:35.737921 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 05:22:35.737921 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 05:22:35.737921 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application May 10 05:22:35.744538 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 308/629] 10.222.0.23 () {56 vars in 1108 bytes} [Tue May 10 05:22:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 05:22:35.744538 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796726be-c987-4bcb-8b5c-a82ba31b65e6 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:22:35.744989 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd05141e-35b2-43ce-b976-035ddb2e25ab None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:22:35.746826 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd05141e-35b2-43ce-b976-035ddb2e25ab None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:22:35.761985 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application [None req-cd05141e-35b2-43ce-b976-035ddb2e25ab None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 05:22:35.761985 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 05:22:35.761985 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 05:22:35.761985 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 05:22:35.761985 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 05:22:35.761985 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 05:22:35.761985 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 05:22:35.761985 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 05:22:35.761985 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 05:22:35.761985 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 05:22:35.761985 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 05:22:35.761985 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 05:22:35.761985 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 05:22:35.761985 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 05:22:35.761985 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 05:22:35.762994 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 05:22:35.762994 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 05:22:35.762994 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 05:22:35.762994 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 05:22:35.762994 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 05:22:35.762994 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 05:22:35.762994 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.get_or_create( May 10 05:22:35.762994 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 05:22:35.762994 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application with Lock( May 10 05:22:35.762994 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 05:22:35.762994 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self._enter() May 10 05:22:35.762994 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 05:22:35.762994 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 05:22:35.762994 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 05:22:35.762994 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.creator() May 10 05:22:35.762994 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 05:22:35.762994 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application created_value = creator( May 10 05:22:35.764484 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 05:22:35.764484 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 05:22:35.764484 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 05:22:35.764484 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 05:22:35.764484 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 05:22:35.764484 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 05:22:35.764484 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 05:22:35.764484 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application May 10 05:22:35.764484 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 322/630] 10.222.0.23 () {56 vars in 1111 bytes} [Tue May 10 05:22:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 05:22:35.765002 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245a73dc-5891-4153-8fa7-4b963db63f44 None None] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:35.765266 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245a73dc-5891-4153-8fa7-4b963db63f44 None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:35.765436 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245a73dc-5891-4153-8fa7-4b963db63f44 None None] PATH_INFO: `/` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:35.771093 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 323/631] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 10 05:22:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 05:22:35.771093 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245a73dc-5891-4153-8fa7-4b963db63f44 None None] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:22:35.852061 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796726be-c987-4bcb-8b5c-a82ba31b65e6 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:22:35.868915 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245a73dc-5891-4153-8fa7-4b963db63f44 None None] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:22:35.884610 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7f78df-4de5-41be-89d1-be445db51469 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:22:35.885417 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7f78df-4de5-41be-89d1-be445db51469 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:35.885695 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7f78df-4de5-41be-89d1-be445db51469 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:35.885967 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7f78df-4de5-41be-89d1-be445db51469 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:35.896030 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7f78df-4de5-41be-89d1-be445db51469 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 05:22:35.901551 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ae126e-493c-4345-a78d-635a115b119c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:22:35.902221 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ae126e-493c-4345-a78d-635a115b119c None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:35.902526 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ae126e-493c-4345-a78d-635a115b119c None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:35.902772 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ae126e-493c-4345-a78d-635a115b119c None admin] PATH_INFO: `/v3/domains` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:35.903495 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ae126e-493c-4345-a78d-635a115b119c None admin] RBAC: Adding query filter params (name=Default) {{(pid=79879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:22:35.903829 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ae126e-493c-4345-a78d-635a115b119c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:22:35.904262 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application [None req-ba7f78df-4de5-41be-89d1-be445db51469 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 10 05:22:35.904262 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 05:22:35.904262 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 05:22:35.904262 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 05:22:35.904262 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 05:22:35.904262 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 05:22:35.904262 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 05:22:35.904262 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 05:22:35.904262 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 05:22:35.904262 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 05:22:35.904262 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 05:22:35.904262 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 05:22:35.904262 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 05:22:35.904262 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 05:22:35.904262 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 05:22:35.904262 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 05:22:35.905156 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 05:22:35.905156 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 05:22:35.905156 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 05:22:35.905156 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 05:22:35.905156 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 05:22:35.905156 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 05:22:35.905156 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 05:22:35.905156 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 05:22:35.905156 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 05:22:35.905156 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.get_or_create( May 10 05:22:35.905156 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 05:22:35.905156 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application with Lock( May 10 05:22:35.905156 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 05:22:35.905156 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._enter() May 10 05:22:35.905156 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 05:22:35.905156 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 05:22:35.905999 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 05:22:35.905999 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.creator() May 10 05:22:35.905999 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 05:22:35.905999 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application created_value = creator( May 10 05:22:35.905999 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 05:22:35.905999 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 05:22:35.905999 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 05:22:35.905999 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 05:22:35.905999 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 05:22:35.905999 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 05:22:35.905999 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 10 05:22:35.905999 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application May 10 05:22:35.906731 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ae126e-493c-4345-a78d-635a115b119c None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:22:35.906802 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 309/632] 10.222.0.23 () {56 vars in 1102 bytes} [Tue May 10 05:22:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 05:22:35.906802 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7f78df-4de5-41be-89d1-be445db51469 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:22:35.920625 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 324/633] 10.222.0.23 () {56 vars in 1109 bytes} [Tue May 10 05:22:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:22:35.921910 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dc2ee0-dd23-4976-8706-2cfa63c4f45a None None] REQUEST_METHOD: `POST` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:35.922198 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dc2ee0-dd23-4976-8706-2cfa63c4f45a None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:35.922471 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dc2ee0-dd23-4976-8706-2cfa63c4f45a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:35.938042 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.auth.core [None req-b7dc2ee0-dd23-4976-8706-2cfa63c4f45a None None] MFA Rules not processed for user `44883b22532e44049d846938dc2cf423`. Rule list: `[]` (Enabled: `True`). {{(pid=79879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:22:35.939224 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-b7dc2ee0-dd23-4976-8706-2cfa63c4f45a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:22:36.001813 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 325/634] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 10 05:22:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 05:22:36.002626 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7dc2ee0-dd23-4976-8706-2cfa63c4f45a None None] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:22:36.008164 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7f78df-4de5-41be-89d1-be445db51469 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:22:36.042713 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af23ae2f-760b-4aee-bda0-787b1cb67669 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:22:36.043405 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af23ae2f-760b-4aee-bda0-787b1cb67669 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:36.043717 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af23ae2f-760b-4aee-bda0-787b1cb67669 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:36.043987 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af23ae2f-760b-4aee-bda0-787b1cb67669 None admin] PATH_INFO: `/v3/projects` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:36.044772 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af23ae2f-760b-4aee-bda0-787b1cb67669 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:22:36.045075 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af23ae2f-760b-4aee-bda0-787b1cb67669 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:22:36.046504 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af23ae2f-760b-4aee-bda0-787b1cb67669 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:22:36.057955 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 310/635] 10.222.0.23 () {56 vars in 1148 bytes} [Tue May 10 05:22:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:22:36.058724 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af23ae2f-760b-4aee-bda0-787b1cb67669 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:22:36.111684 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7dc2ee0-dd23-4976-8706-2cfa63c4f45a None None] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:22:36.144996 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d4e57a-212d-4a6f-8fe0-a22f017a14b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:22:36.145658 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d4e57a-212d-4a6f-8fe0-a22f017a14b7 None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:36.145942 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d4e57a-212d-4a6f-8fe0-a22f017a14b7 None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:36.146218 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d4e57a-212d-4a6f-8fe0-a22f017a14b7 None admin] PATH_INFO: `/v3/roles` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:36.146969 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d4e57a-212d-4a6f-8fe0-a22f017a14b7 None admin] RBAC: Adding query filter params (name=service) {{(pid=79879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:22:36.147275 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d4e57a-212d-4a6f-8fe0-a22f017a14b7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:22:36.148693 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d4e57a-212d-4a6f-8fe0-a22f017a14b7 None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:22:36.156963 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af23ae2f-760b-4aee-bda0-787b1cb67669 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:22:36.160072 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 326/636] 10.222.0.23 () {56 vars in 1103 bytes} [Tue May 10 05:22:36 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:22:36.163369 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c64189-7f76-4a4c-80e0-6026c0e4fd8f None None] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:36.163644 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c64189-7f76-4a4c-80e0-6026c0e4fd8f None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:36.163957 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c64189-7f76-4a4c-80e0-6026c0e4fd8f None None] PATH_INFO: `/` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:36.165212 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 327/637] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 10 05:22:36 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 05:22:36.165947 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c64189-7f76-4a4c-80e0-6026c0e4fd8f None None] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:22:36.201802 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfbb166-13b5-4fa8-9f91-bbf72186fe0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:22:36.202606 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfbb166-13b5-4fa8-9f91-bbf72186fe0c None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:36.202887 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfbb166-13b5-4fa8-9f91-bbf72186fe0c None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:36.203156 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfbb166-13b5-4fa8-9f91-bbf72186fe0c None admin] PATH_INFO: `/v3/projects/service` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:36.209675 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bfbb166-13b5-4fa8-9f91-bbf72186fe0c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:22:36.211104 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bfbb166-13b5-4fa8-9f91-bbf72186fe0c None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:22:36.224448 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application [None req-7bfbb166-13b5-4fa8-9f91-bbf72186fe0c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 05:22:36.224448 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 05:22:36.224448 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 05:22:36.224448 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 05:22:36.224448 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 05:22:36.224448 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 05:22:36.224448 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 05:22:36.224448 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 05:22:36.224448 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 05:22:36.224448 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 05:22:36.224448 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 05:22:36.224448 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 05:22:36.224448 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 05:22:36.224448 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 05:22:36.224448 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 05:22:36.225368 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 05:22:36.225368 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 05:22:36.225368 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 05:22:36.225368 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 05:22:36.225368 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 05:22:36.225368 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 05:22:36.225368 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.get_or_create( May 10 05:22:36.225368 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 05:22:36.225368 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application with Lock( May 10 05:22:36.225368 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 05:22:36.225368 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._enter() May 10 05:22:36.225368 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 05:22:36.225368 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 05:22:36.225368 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 05:22:36.225368 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.creator() May 10 05:22:36.225368 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 05:22:36.225368 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application created_value = creator( May 10 05:22:36.226255 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 05:22:36.226255 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 05:22:36.226255 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 05:22:36.226255 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 05:22:36.226255 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 05:22:36.226255 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 05:22:36.226255 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 05:22:36.226255 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application May 10 05:22:36.226255 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 311/638] 10.222.0.23 () {56 vars in 1111 bytes} [Tue May 10 05:22:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 05:22:36.226743 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfbb166-13b5-4fa8-9f91-bbf72186fe0c None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:22:36.277776 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c64189-7f76-4a4c-80e0-6026c0e4fd8f None None] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:22:36.312218 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c054d5a-6b16-4b48-b0ef-3f2486e49135 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:22:36.313069 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c054d5a-6b16-4b48-b0ef-3f2486e49135 None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:36.313343 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c054d5a-6b16-4b48-b0ef-3f2486e49135 None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:36.313609 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c054d5a-6b16-4b48-b0ef-3f2486e49135 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:36.322777 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfbb166-13b5-4fa8-9f91-bbf72186fe0c None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:22:36.323456 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c054d5a-6b16-4b48-b0ef-3f2486e49135 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 05:22:36.331073 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application [None req-0c054d5a-6b16-4b48-b0ef-3f2486e49135 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 10 05:22:36.331073 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 05:22:36.331073 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 05:22:36.331073 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 05:22:36.331073 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 05:22:36.331073 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 05:22:36.331073 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 05:22:36.331073 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 05:22:36.331073 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 05:22:36.331073 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 05:22:36.331073 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 05:22:36.331073 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 05:22:36.331073 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 05:22:36.331073 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 05:22:36.331073 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 05:22:36.331073 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 05:22:36.332025 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 05:22:36.332025 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 05:22:36.332025 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 05:22:36.332025 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 05:22:36.332025 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 05:22:36.332025 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 05:22:36.332025 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 05:22:36.332025 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 05:22:36.332025 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 05:22:36.332025 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.get_or_create( May 10 05:22:36.332025 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 05:22:36.332025 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application with Lock( May 10 05:22:36.332025 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 05:22:36.332025 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self._enter() May 10 05:22:36.332025 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 05:22:36.332025 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 05:22:36.333069 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 05:22:36.333069 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.creator() May 10 05:22:36.333069 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 05:22:36.333069 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application created_value = creator( May 10 05:22:36.333069 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 05:22:36.333069 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 05:22:36.333069 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 05:22:36.333069 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 05:22:36.333069 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 05:22:36.333069 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 05:22:36.333069 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 10 05:22:36.333069 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application May 10 05:22:36.333069 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 328/639] 10.222.0.23 () {56 vars in 1102 bytes} [Tue May 10 05:22:36 2022] GET /identity/v3/roles/service => generated 85 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 05:22:36.333829 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c054d5a-6b16-4b48-b0ef-3f2486e49135 None admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:22:36.355476 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35e8676-d65f-4e86-abd1-c1968624d181 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:22:36.356405 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35e8676-d65f-4e86-abd1-c1968624d181 None admin] REQUEST_METHOD: `PUT` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:36.356689 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35e8676-d65f-4e86-abd1-c1968624d181 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:36.356961 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35e8676-d65f-4e86-abd1-c1968624d181 None admin] PATH_INFO: `/v3/projects/5f23435f783540199d6dcfd0417c090e/users/fd31dacf30804395bd029037b407c12a/roles/8a02b9040d1d4fccababc1eb4dac80e7` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:36.372077 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35e8676-d65f-4e86-abd1-c1968624d181 None admin] RBAC: Authorizing `identity:create_grant(project_id=5f23435f783540199d6dcfd0417c090e, user_id=fd31dacf30804395bd029037b407c12a, role_id=8a02b9040d1d4fccababc1eb4dac80e7)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:22:36.373444 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35e8676-d65f-4e86-abd1-c1968624d181 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:22:36.386049 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 312/640] 10.222.0.23 () {58 vars in 1439 bytes} [Tue May 10 05:22:36 2022] PUT /identity/v3/projects/5f23435f783540199d6dcfd0417c090e/users/fd31dacf30804395bd029037b407c12a/roles/8a02b9040d1d4fccababc1eb4dac80e7 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 05:22:36.387266 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b153cb6b-acb6-4581-9de2-f99b61e8f224 None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:36.387564 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b153cb6b-acb6-4581-9de2-f99b61e8f224 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:36.387863 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b153cb6b-acb6-4581-9de2-f99b61e8f224 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:36.413746 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-b153cb6b-acb6-4581-9de2-f99b61e8f224 None None] MFA Rules not processed for user `44883b22532e44049d846938dc2cf423`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:22:36.415131 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-b153cb6b-acb6-4581-9de2-f99b61e8f224 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:22:36.437828 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c054d5a-6b16-4b48-b0ef-3f2486e49135 None admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:22:36.484033 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfb9676-5118-4ab8-9f13-07e94fe065f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:22:36.484778 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 313/641] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 10 05:22:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 05:22:36.485539 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b153cb6b-acb6-4581-9de2-f99b61e8f224 None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:22:36.507304 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfb9676-5118-4ab8-9f13-07e94fe065f4 None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:36.507304 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfb9676-5118-4ab8-9f13-07e94fe065f4 None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:36.507304 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfb9676-5118-4ab8-9f13-07e94fe065f4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:36.518828 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dfb9676-5118-4ab8-9f13-07e94fe065f4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:22:36.520530 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dfb9676-5118-4ab8-9f13-07e94fe065f4 None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:22:36.538291 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application [None req-7dfb9676-5118-4ab8-9f13-07e94fe065f4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 05:22:36.538291 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 05:22:36.538291 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 05:22:36.538291 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 05:22:36.538291 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 05:22:36.538291 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 05:22:36.538291 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 05:22:36.538291 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 05:22:36.538291 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 05:22:36.538291 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 05:22:36.538291 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 05:22:36.538291 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 05:22:36.538291 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 05:22:36.538291 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 05:22:36.538291 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 05:22:36.539516 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 05:22:36.539516 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 05:22:36.539516 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 05:22:36.539516 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 05:22:36.539516 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 05:22:36.539516 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 05:22:36.539516 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.get_or_create( May 10 05:22:36.539516 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 05:22:36.539516 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application with Lock( May 10 05:22:36.539516 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 05:22:36.539516 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self._enter() May 10 05:22:36.539516 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 05:22:36.539516 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 05:22:36.539516 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 05:22:36.539516 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.creator() May 10 05:22:36.539516 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 05:22:36.539516 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application created_value = creator( May 10 05:22:36.540597 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 05:22:36.540597 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 05:22:36.540597 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 05:22:36.540597 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application May 10 05:22:36.540597 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 329/642] 10.222.0.23 () {56 vars in 1108 bytes} [Tue May 10 05:22:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 05:22:36.540905 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfb9676-5118-4ab8-9f13-07e94fe065f4 None admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:22:36.600711 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b153cb6b-acb6-4581-9de2-f99b61e8f224 None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:22:36.633290 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b6185d-fbe2-46ed-987e-aa3826bca322 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:22:36.634020 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b6185d-fbe2-46ed-987e-aa3826bca322 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:36.634388 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b6185d-fbe2-46ed-987e-aa3826bca322 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:36.634753 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b6185d-fbe2-46ed-987e-aa3826bca322 None admin] PATH_INFO: `/v3/projects` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:36.635659 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b6185d-fbe2-46ed-987e-aa3826bca322 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:22:36.636061 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b6185d-fbe2-46ed-987e-aa3826bca322 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:22:36.637579 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b6185d-fbe2-46ed-987e-aa3826bca322 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:22:36.645732 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfb9676-5118-4ab8-9f13-07e94fe065f4 None admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:22:36.649213 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 314/643] 10.222.0.23 () {56 vars in 1148 bytes} [Tue May 10 05:22:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:22:36.650307 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b6185d-fbe2-46ed-987e-aa3826bca322 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:22:36.681963 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af2f9f1-7ed1-4e5e-8870-0cc10f373cf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:22:36.682643 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af2f9f1-7ed1-4e5e-8870-0cc10f373cf5 None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:36.682919 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af2f9f1-7ed1-4e5e-8870-0cc10f373cf5 None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:36.683192 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af2f9f1-7ed1-4e5e-8870-0cc10f373cf5 None admin] PATH_INFO: `/v3/roles` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:36.683987 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af2f9f1-7ed1-4e5e-8870-0cc10f373cf5 None admin] RBAC: Adding query filter params (name=service) {{(pid=79879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:22:36.684288 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af2f9f1-7ed1-4e5e-8870-0cc10f373cf5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:22:36.685654 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af2f9f1-7ed1-4e5e-8870-0cc10f373cf5 None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:22:36.693553 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 330/644] 10.222.0.23 () {56 vars in 1103 bytes} [Tue May 10 05:22:36 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:22:36.694354 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af2f9f1-7ed1-4e5e-8870-0cc10f373cf5 None admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:22:36.749996 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b6185d-fbe2-46ed-987e-aa3826bca322 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:22:36.783507 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28469e71-a6b8-452c-870e-6b2c23b584e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:22:36.784451 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28469e71-a6b8-452c-870e-6b2c23b584e8 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:36.784731 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28469e71-a6b8-452c-870e-6b2c23b584e8 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:36.785014 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28469e71-a6b8-452c-870e-6b2c23b584e8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:36.795279 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28469e71-a6b8-452c-870e-6b2c23b584e8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 05:22:36.795717 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af2f9f1-7ed1-4e5e-8870-0cc10f373cf5 None admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:22:36.803004 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application [None req-28469e71-a6b8-452c-870e-6b2c23b584e8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 10 05:22:36.803004 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 05:22:36.803004 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 05:22:36.803004 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 05:22:36.803004 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 05:22:36.803004 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 05:22:36.803004 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 05:22:36.803004 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 05:22:36.803004 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 05:22:36.803004 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 05:22:36.803004 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 05:22:36.803004 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 05:22:36.803004 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 05:22:36.803004 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 05:22:36.803004 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 05:22:36.803004 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 05:22:36.803999 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 05:22:36.803999 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 05:22:36.803999 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 05:22:36.803999 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 05:22:36.803999 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 05:22:36.803999 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 05:22:36.803999 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 05:22:36.803999 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 05:22:36.803999 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 05:22:36.803999 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.get_or_create( May 10 05:22:36.803999 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 05:22:36.803999 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application with Lock( May 10 05:22:36.803999 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 05:22:36.803999 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._enter() May 10 05:22:36.803999 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 05:22:36.803999 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 05:22:36.804919 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 05:22:36.804919 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.creator() May 10 05:22:36.804919 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 05:22:36.804919 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application created_value = creator( May 10 05:22:36.804919 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 05:22:36.804919 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 05:22:36.804919 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 05:22:36.804919 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 05:22:36.804919 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 05:22:36.804919 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 05:22:36.804919 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 10 05:22:36.804919 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application May 10 05:22:36.804919 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 315/645] 10.222.0.23 () {56 vars in 1102 bytes} [Tue May 10 05:22:36 2022] GET /identity/v3/roles/service => generated 85 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 05:22:36.805804 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28469e71-a6b8-452c-870e-6b2c23b584e8 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:22:36.830509 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb30bbd-7237-4567-b73e-9c4cbb5002d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:22:36.831180 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb30bbd-7237-4567-b73e-9c4cbb5002d8 None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:36.831463 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb30bbd-7237-4567-b73e-9c4cbb5002d8 None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:36.831756 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb30bbd-7237-4567-b73e-9c4cbb5002d8 None admin] PATH_INFO: `/v3/domains` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:36.832522 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb30bbd-7237-4567-b73e-9c4cbb5002d8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:22:36.832879 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb30bbd-7237-4567-b73e-9c4cbb5002d8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:22:36.834319 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb30bbd-7237-4567-b73e-9c4cbb5002d8 None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:22:36.846161 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 331/646] 10.222.0.23 () {56 vars in 1109 bytes} [Tue May 10 05:22:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:22:36.846986 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb30bbd-7237-4567-b73e-9c4cbb5002d8 None admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:22:36.902567 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28469e71-a6b8-452c-870e-6b2c23b584e8 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:22:36.938963 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56e0875-3c7f-4e58-8a8d-74ba5be63c1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:22:36.939654 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56e0875-3c7f-4e58-8a8d-74ba5be63c1b None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:36.939944 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56e0875-3c7f-4e58-8a8d-74ba5be63c1b None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:36.940223 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56e0875-3c7f-4e58-8a8d-74ba5be63c1b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:36.941062 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56e0875-3c7f-4e58-8a8d-74ba5be63c1b None admin] RBAC: Adding query filter params (role.id=8a02b9040d1d4fccababc1eb4dac80e7, scope.project.id=5f23435f783540199d6dcfd0417c090e, user.id=7f50f224ca944983aecfde86375473da) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:22:36.941379 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56e0875-3c7f-4e58-8a8d-74ba5be63c1b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:22:36.942916 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56e0875-3c7f-4e58-8a8d-74ba5be63c1b None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:22:36.946720 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb30bbd-7237-4567-b73e-9c4cbb5002d8 None admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:22:36.948729 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 316/647] 10.222.0.23 () {56 vars in 1374 bytes} [Tue May 10 05:22:36 2022] GET /identity/v3/role_assignments?user.id=7f50f224ca944983aecfde86375473da&scope.project.id=5f23435f783540199d6dcfd0417c090e&role.id=8a02b9040d1d4fccababc1eb4dac80e7 => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:22:36.949563 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56e0875-3c7f-4e58-8a8d-74ba5be63c1b None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:22:36.997431 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41d0401-80f5-4b79-bc65-cb278e006f65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:22:36.998256 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41d0401-80f5-4b79-bc65-cb278e006f65 None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:36.998541 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41d0401-80f5-4b79-bc65-cb278e006f65 None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:36.998818 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41d0401-80f5-4b79-bc65-cb278e006f65 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:37.010007 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41d0401-80f5-4b79-bc65-cb278e006f65 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:22:37.011491 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41d0401-80f5-4b79-bc65-cb278e006f65 None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:22:37.030704 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application [None req-c41d0401-80f5-4b79-bc65-cb278e006f65 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 05:22:37.030704 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 05:22:37.030704 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 05:22:37.030704 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 05:22:37.030704 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 05:22:37.030704 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 05:22:37.030704 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 05:22:37.030704 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 05:22:37.030704 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 05:22:37.030704 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 05:22:37.030704 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 05:22:37.030704 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 05:22:37.030704 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 05:22:37.030704 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 05:22:37.030704 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 05:22:37.031761 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 05:22:37.031761 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 05:22:37.031761 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 05:22:37.031761 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 05:22:37.031761 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 05:22:37.031761 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 05:22:37.031761 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.get_or_create( May 10 05:22:37.031761 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 05:22:37.031761 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application with Lock( May 10 05:22:37.031761 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 05:22:37.031761 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self._enter() May 10 05:22:37.031761 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 05:22:37.031761 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 05:22:37.031761 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 05:22:37.031761 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.creator() May 10 05:22:37.031761 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 05:22:37.031761 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application created_value = creator( May 10 05:22:37.032652 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 05:22:37.032652 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 05:22:37.032652 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 05:22:37.032652 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application May 10 05:22:37.037015 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 332/648] 10.222.0.23 () {56 vars in 1108 bytes} [Tue May 10 05:22:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 05:22:37.038112 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41d0401-80f5-4b79-bc65-cb278e006f65 None admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:22:37.078106 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56e0875-3c7f-4e58-8a8d-74ba5be63c1b None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:22:37.132845 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985849cc-c331-4a0d-8620-a6d58f4db396 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:22:37.133550 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985849cc-c331-4a0d-8620-a6d58f4db396 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:37.133833 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985849cc-c331-4a0d-8620-a6d58f4db396 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:37.134109 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985849cc-c331-4a0d-8620-a6d58f4db396 None admin] PATH_INFO: `/v3/roles` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:37.134879 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985849cc-c331-4a0d-8620-a6d58f4db396 None admin] RBAC: Adding query filter params (name=service) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:22:37.135188 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985849cc-c331-4a0d-8620-a6d58f4db396 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:22:37.137245 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985849cc-c331-4a0d-8620-a6d58f4db396 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:22:37.145831 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 317/649] 10.222.0.23 () {56 vars in 1103 bytes} [Tue May 10 05:22:36 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:22:37.146789 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985849cc-c331-4a0d-8620-a6d58f4db396 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:22:37.179670 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41d0401-80f5-4b79-bc65-cb278e006f65 None admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:22:37.222903 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9ffdfc-aedf-4ad9-88b4-1549cb068017 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:22:37.223877 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9ffdfc-aedf-4ad9-88b4-1549cb068017 None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:37.224140 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9ffdfc-aedf-4ad9-88b4-1549cb068017 None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:37.224409 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9ffdfc-aedf-4ad9-88b4-1549cb068017 None admin] PATH_INFO: `/v3/users/glance` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:37.232968 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9ffdfc-aedf-4ad9-88b4-1549cb068017 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:22:37.234708 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9ffdfc-aedf-4ad9-88b4-1549cb068017 None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:22:37.250716 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application [None req-fa9ffdfc-aedf-4ad9-88b4-1549cb068017 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 10 05:22:37.250716 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 05:22:37.250716 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 05:22:37.250716 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 05:22:37.250716 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 05:22:37.250716 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 05:22:37.250716 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 05:22:37.250716 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 05:22:37.250716 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 05:22:37.250716 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 05:22:37.250716 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 05:22:37.250716 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 05:22:37.250716 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 05:22:37.250716 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 05:22:37.250716 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 05:22:37.250716 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 05:22:37.251812 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 05:22:37.251812 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 05:22:37.251812 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 05:22:37.251812 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 05:22:37.251812 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 05:22:37.251812 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 05:22:37.251812 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 05:22:37.251812 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 05:22:37.251812 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 05:22:37.251812 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.get_or_create( May 10 05:22:37.251812 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 05:22:37.251812 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application with Lock( May 10 05:22:37.251812 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 05:22:37.251812 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self._enter() May 10 05:22:37.251812 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 05:22:37.251812 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 05:22:37.251812 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 05:22:37.251812 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.creator() May 10 05:22:37.252761 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 05:22:37.252761 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application created_value = creator( May 10 05:22:37.252761 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 05:22:37.252761 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 05:22:37.252761 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 05:22:37.252761 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 05:22:37.252761 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 05:22:37.252761 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 05:22:37.252761 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 10 05:22:37.252761 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application May 10 05:22:37.255465 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 333/650] 10.222.0.23 () {56 vars in 1099 bytes} [Tue May 10 05:22:37 2022] GET /identity/v3/users/glance => generated 84 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 05:22:37.256485 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9ffdfc-aedf-4ad9-88b4-1549cb068017 None admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:22:37.272652 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985849cc-c331-4a0d-8620-a6d58f4db396 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:22:37.312986 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67be10b-f811-4acc-9b0d-ae0cc7a94383 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:22:37.313692 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67be10b-f811-4acc-9b0d-ae0cc7a94383 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:37.313971 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67be10b-f811-4acc-9b0d-ae0cc7a94383 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:37.314243 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67be10b-f811-4acc-9b0d-ae0cc7a94383 None admin] PATH_INFO: `/v3/domains` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:37.314980 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67be10b-f811-4acc-9b0d-ae0cc7a94383 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:22:37.315283 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67be10b-f811-4acc-9b0d-ae0cc7a94383 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:22:37.316740 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67be10b-f811-4acc-9b0d-ae0cc7a94383 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:22:37.330606 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 318/651] 10.222.0.23 () {56 vars in 1109 bytes} [Tue May 10 05:22:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:22:37.331805 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67be10b-f811-4acc-9b0d-ae0cc7a94383 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:22:37.372888 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9ffdfc-aedf-4ad9-88b4-1549cb068017 None admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:22:37.417897 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c399cae6-61da-4c42-8eac-237768330941 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:22:37.418760 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c399cae6-61da-4c42-8eac-237768330941 None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:37.419035 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c399cae6-61da-4c42-8eac-237768330941 None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:37.419330 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c399cae6-61da-4c42-8eac-237768330941 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:37.431204 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c399cae6-61da-4c42-8eac-237768330941 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:22:37.432625 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c399cae6-61da-4c42-8eac-237768330941 None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:22:37.442928 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67be10b-f811-4acc-9b0d-ae0cc7a94383 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:22:37.453959 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application [None req-c399cae6-61da-4c42-8eac-237768330941 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 05:22:37.453959 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 05:22:37.453959 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 05:22:37.453959 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 05:22:37.453959 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 05:22:37.453959 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 05:22:37.453959 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 05:22:37.453959 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 05:22:37.453959 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 05:22:37.453959 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 05:22:37.453959 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 05:22:37.453959 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 05:22:37.453959 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 05:22:37.453959 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 05:22:37.453959 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 05:22:37.454901 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 05:22:37.454901 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 05:22:37.454901 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 05:22:37.454901 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 05:22:37.454901 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 05:22:37.454901 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 05:22:37.454901 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.get_or_create( May 10 05:22:37.454901 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 05:22:37.454901 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application with Lock( May 10 05:22:37.454901 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 05:22:37.454901 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self._enter() May 10 05:22:37.454901 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 05:22:37.454901 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 05:22:37.454901 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 05:22:37.454901 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.creator() May 10 05:22:37.454901 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 05:22:37.454901 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application created_value = creator( May 10 05:22:37.455840 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 05:22:37.455840 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 05:22:37.455840 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 05:22:37.455840 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application May 10 05:22:37.455840 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 334/652] 10.222.0.23 () {56 vars in 1108 bytes} [Tue May 10 05:22:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 05:22:37.456555 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c399cae6-61da-4c42-8eac-237768330941 None admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:22:37.488066 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93cf9e5-9d31-409b-a529-13bb06ad948e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:22:37.489636 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93cf9e5-9d31-409b-a529-13bb06ad948e None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:37.490123 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93cf9e5-9d31-409b-a529-13bb06ad948e None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:37.490858 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93cf9e5-9d31-409b-a529-13bb06ad948e None admin] PATH_INFO: `/v3/users` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:37.492088 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93cf9e5-9d31-409b-a529-13bb06ad948e None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:22:37.492948 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93cf9e5-9d31-409b-a529-13bb06ad948e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:22:37.494982 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93cf9e5-9d31-409b-a529-13bb06ad948e None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:22:37.519842 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 319/653] 10.222.0.23 () {56 vars in 1137 bytes} [Tue May 10 05:22:37 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:22:37.521871 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93cf9e5-9d31-409b-a529-13bb06ad948e None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:22:37.578165 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c399cae6-61da-4c42-8eac-237768330941 None admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:22:37.614430 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5c2a48-9729-4cff-b7a7-00459af59eba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:22:37.615591 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5c2a48-9729-4cff-b7a7-00459af59eba None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:37.616095 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5c2a48-9729-4cff-b7a7-00459af59eba None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:37.616529 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5c2a48-9729-4cff-b7a7-00459af59eba None admin] PATH_INFO: `/v3/users/cinder` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:37.624766 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5c2a48-9729-4cff-b7a7-00459af59eba None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:22:37.626531 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5c2a48-9729-4cff-b7a7-00459af59eba None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:22:37.632402 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93cf9e5-9d31-409b-a529-13bb06ad948e None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:22:37.642011 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application [None req-3f5c2a48-9729-4cff-b7a7-00459af59eba None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 10 05:22:37.642011 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 05:22:37.642011 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 05:22:37.642011 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 05:22:37.642011 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 05:22:37.642011 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 05:22:37.642011 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 05:22:37.642011 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 05:22:37.642011 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 05:22:37.642011 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 05:22:37.642011 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 05:22:37.642011 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 05:22:37.642011 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 05:22:37.642011 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 05:22:37.642011 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 05:22:37.642011 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 05:22:37.643003 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 05:22:37.643003 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 05:22:37.643003 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 05:22:37.643003 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 05:22:37.643003 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 05:22:37.643003 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 05:22:37.643003 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 05:22:37.643003 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 05:22:37.643003 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 05:22:37.643003 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.get_or_create( May 10 05:22:37.643003 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 05:22:37.643003 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application with Lock( May 10 05:22:37.643003 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 05:22:37.643003 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self._enter() May 10 05:22:37.643003 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 05:22:37.643003 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 05:22:37.643003 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 05:22:37.643003 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.creator() May 10 05:22:37.643985 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 05:22:37.643985 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application created_value = creator( May 10 05:22:37.643985 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 05:22:37.643985 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 05:22:37.643985 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 05:22:37.643985 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 05:22:37.643985 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 05:22:37.643985 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 05:22:37.643985 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 10 05:22:37.643985 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application May 10 05:22:37.645885 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 335/654] 10.222.0.23 () {56 vars in 1099 bytes} [Tue May 10 05:22:37 2022] GET /identity/v3/users/cinder => generated 84 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 05:22:37.646813 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5c2a48-9729-4cff-b7a7-00459af59eba None admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:22:37.667913 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99683f79-1162-4238-a688-e7bcb0f20b2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:22:37.668328 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99683f79-1162-4238-a688-e7bcb0f20b2a None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:37.668606 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99683f79-1162-4238-a688-e7bcb0f20b2a None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:37.668878 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99683f79-1162-4238-a688-e7bcb0f20b2a None admin] PATH_INFO: `/v3/domains` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:37.669682 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99683f79-1162-4238-a688-e7bcb0f20b2a None admin] RBAC: Adding query filter params (name=Default) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:22:37.669907 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99683f79-1162-4238-a688-e7bcb0f20b2a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:22:37.671263 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99683f79-1162-4238-a688-e7bcb0f20b2a None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:22:37.683265 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 320/655] 10.222.0.23 () {56 vars in 1109 bytes} [Tue May 10 05:22:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:22:37.684076 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99683f79-1162-4238-a688-e7bcb0f20b2a None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:22:37.752902 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5c2a48-9729-4cff-b7a7-00459af59eba None admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:22:37.790045 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99683f79-1162-4238-a688-e7bcb0f20b2a None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:22:37.793393 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a866ed-6bff-4a75-a3bb-bb5be5e1b3c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:22:37.794300 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a866ed-6bff-4a75-a3bb-bb5be5e1b3c2 None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:37.794769 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a866ed-6bff-4a75-a3bb-bb5be5e1b3c2 None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:37.795191 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a866ed-6bff-4a75-a3bb-bb5be5e1b3c2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:37.826786 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987c1975-a459-43c2-a75d-0013614090a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:22:37.827827 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987c1975-a459-43c2-a75d-0013614090a3 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:37.828044 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987c1975-a459-43c2-a75d-0013614090a3 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:37.828318 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987c1975-a459-43c2-a75d-0013614090a3 None admin] PATH_INFO: `/v3/users` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:37.829188 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987c1975-a459-43c2-a75d-0013614090a3 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:22:37.829474 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987c1975-a459-43c2-a75d-0013614090a3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:22:37.830906 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987c1975-a459-43c2-a75d-0013614090a3 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:22:37.853338 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 321/656] 10.222.0.23 () {56 vars in 1137 bytes} [Tue May 10 05:22:37 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:22:37.853338 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987c1975-a459-43c2-a75d-0013614090a3 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:22:37.873338 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a866ed-6bff-4a75-a3bb-bb5be5e1b3c2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:22:37.875123 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a866ed-6bff-4a75-a3bb-bb5be5e1b3c2 None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:22:37.957070 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987c1975-a459-43c2-a75d-0013614090a3 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:22:37.986660 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 336/657] 10.222.0.23 () {58 vars in 1282 bytes} [Tue May 10 05:22:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 05:22:37.987806 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a866ed-6bff-4a75-a3bb-bb5be5e1b3c2 None admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:22:38.000567 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b24801-b124-4085-a6d1-6d54e5c44f64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:22:38.001315 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b24801-b124-4085-a6d1-6d54e5c44f64 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:38.001594 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b24801-b124-4085-a6d1-6d54e5c44f64 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:38.001866 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b24801-b124-4085-a6d1-6d54e5c44f64 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:38.009484 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b24801-b124-4085-a6d1-6d54e5c44f64 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:22:38.010927 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b24801-b124-4085-a6d1-6d54e5c44f64 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:22:38.029086 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application [None req-d0b24801-b124-4085-a6d1-6d54e5c44f64 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 10 05:22:38.029086 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 05:22:38.029086 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 05:22:38.029086 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 05:22:38.029086 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 05:22:38.029086 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 05:22:38.029086 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 05:22:38.029086 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 05:22:38.029086 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 05:22:38.029086 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 05:22:38.029086 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 05:22:38.029086 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 05:22:38.029086 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 05:22:38.029086 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 05:22:38.029086 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 05:22:38.029086 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 05:22:38.030324 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 05:22:38.030324 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 05:22:38.030324 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 05:22:38.030324 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 05:22:38.030324 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 05:22:38.030324 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 05:22:38.030324 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 05:22:38.030324 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 05:22:38.030324 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 05:22:38.030324 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.get_or_create( May 10 05:22:38.030324 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 05:22:38.030324 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application with Lock( May 10 05:22:38.030324 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 05:22:38.030324 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._enter() May 10 05:22:38.030324 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 05:22:38.030324 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 05:22:38.030324 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 05:22:38.030324 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.creator() May 10 05:22:38.031555 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 05:22:38.031555 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application created_value = creator( May 10 05:22:38.031555 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 05:22:38.031555 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 05:22:38.031555 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 05:22:38.031555 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 05:22:38.031555 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 05:22:38.031555 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 05:22:38.031555 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 10 05:22:38.031555 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application May 10 05:22:38.035060 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 322/658] 10.222.0.23 () {56 vars in 1102 bytes} [Tue May 10 05:22:37 2022] GET /identity/v3/users/neutron => generated 85 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 05:22:38.036090 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b24801-b124-4085-a6d1-6d54e5c44f64 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:22:38.100137 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a866ed-6bff-4a75-a3bb-bb5be5e1b3c2 None admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:22:38.136115 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2839d9-ef90-4ac8-a66b-cf9e62523f37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:22:38.137061 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2839d9-ef90-4ac8-a66b-cf9e62523f37 None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:38.137487 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2839d9-ef90-4ac8-a66b-cf9e62523f37 None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:38.137926 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2839d9-ef90-4ac8-a66b-cf9e62523f37 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:38.140352 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b24801-b124-4085-a6d1-6d54e5c44f64 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:22:38.176877 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51225d3-3761-4053-923a-82de6e82ff14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:22:38.176877 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51225d3-3761-4053-923a-82de6e82ff14 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:38.177197 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51225d3-3761-4053-923a-82de6e82ff14 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:38.177367 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51225d3-3761-4053-923a-82de6e82ff14 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:38.188055 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51225d3-3761-4053-923a-82de6e82ff14 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:22:38.189511 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51225d3-3761-4053-923a-82de6e82ff14 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:22:38.208576 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application [None req-b51225d3-3761-4053-923a-82de6e82ff14 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 05:22:38.208576 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 05:22:38.208576 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 05:22:38.208576 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 05:22:38.208576 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 05:22:38.208576 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 05:22:38.208576 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 05:22:38.208576 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 05:22:38.208576 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 05:22:38.208576 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 05:22:38.208576 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 05:22:38.208576 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 05:22:38.208576 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 05:22:38.208576 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 05:22:38.208576 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 05:22:38.209689 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 05:22:38.209689 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 05:22:38.209689 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 05:22:38.209689 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 05:22:38.209689 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 05:22:38.209689 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 05:22:38.209689 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.get_or_create( May 10 05:22:38.209689 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 05:22:38.209689 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application with Lock( May 10 05:22:38.209689 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 05:22:38.209689 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._enter() May 10 05:22:38.209689 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 05:22:38.209689 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 05:22:38.209689 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 05:22:38.209689 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.creator() May 10 05:22:38.209689 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 05:22:38.209689 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application created_value = creator( May 10 05:22:38.210810 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 05:22:38.210810 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 05:22:38.210810 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 05:22:38.210810 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application May 10 05:22:38.214429 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 323/659] 10.222.0.23 () {56 vars in 1108 bytes} [Tue May 10 05:22:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 05:22:38.215285 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51225d3-3761-4053-923a-82de6e82ff14 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:22:38.215886 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2839d9-ef90-4ac8-a66b-cf9e62523f37 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:22:38.217493 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2839d9-ef90-4ac8-a66b-cf9e62523f37 None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:22:38.318213 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51225d3-3761-4053-923a-82de6e82ff14 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:22:38.324924 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 337/660] 10.222.0.23 () {58 vars in 1282 bytes} [Tue May 10 05:22:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 05:22:38.326320 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2839d9-ef90-4ac8-a66b-cf9e62523f37 None admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:22:38.352917 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1fe012-a94f-4bbc-aaf7-763f92472344 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:22:38.353749 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1fe012-a94f-4bbc-aaf7-763f92472344 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:38.354032 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1fe012-a94f-4bbc-aaf7-763f92472344 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:38.354303 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1fe012-a94f-4bbc-aaf7-763f92472344 None admin] PATH_INFO: `/v3/users` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:38.355600 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1fe012-a94f-4bbc-aaf7-763f92472344 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:22:38.356058 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1fe012-a94f-4bbc-aaf7-763f92472344 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:22:38.357661 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1fe012-a94f-4bbc-aaf7-763f92472344 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:22:38.383712 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 324/661] 10.222.0.23 () {56 vars in 1139 bytes} [Tue May 10 05:22:38 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:22:38.384901 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1fe012-a94f-4bbc-aaf7-763f92472344 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:22:38.430806 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2839d9-ef90-4ac8-a66b-cf9e62523f37 None admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:22:38.469619 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a8bd9e-ffe5-4bd7-9641-4612871c748b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:22:38.470213 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a8bd9e-ffe5-4bd7-9641-4612871c748b None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:38.470496 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a8bd9e-ffe5-4bd7-9641-4612871c748b None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:38.470772 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a8bd9e-ffe5-4bd7-9641-4612871c748b None admin] PATH_INFO: `/v3/domains` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:38.471506 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a8bd9e-ffe5-4bd7-9641-4612871c748b None admin] RBAC: Adding query filter params (name=Default) {{(pid=79879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:22:38.471938 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a8bd9e-ffe5-4bd7-9641-4612871c748b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:22:38.473630 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a8bd9e-ffe5-4bd7-9641-4612871c748b None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:22:38.489794 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 338/662] 10.222.0.23 () {56 vars in 1109 bytes} [Tue May 10 05:22:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:22:38.489794 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a8bd9e-ffe5-4bd7-9641-4612871c748b None admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:22:38.511470 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1fe012-a94f-4bbc-aaf7-763f92472344 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:22:38.546143 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a7a7cd-9f72-4114-9106-42d56b27a1e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:22:38.547001 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a7a7cd-9f72-4114-9106-42d56b27a1e8 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:38.547281 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a7a7cd-9f72-4114-9106-42d56b27a1e8 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:38.547551 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a7a7cd-9f72-4114-9106-42d56b27a1e8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:38.557553 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a7a7cd-9f72-4114-9106-42d56b27a1e8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:22:38.559088 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a7a7cd-9f72-4114-9106-42d56b27a1e8 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:22:38.576202 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application [None req-f8a7a7cd-9f72-4114-9106-42d56b27a1e8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 05:22:38.576202 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 05:22:38.576202 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 05:22:38.576202 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 05:22:38.576202 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 05:22:38.576202 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 05:22:38.576202 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 05:22:38.576202 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 05:22:38.576202 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 05:22:38.576202 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 05:22:38.576202 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 05:22:38.576202 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 05:22:38.576202 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 05:22:38.576202 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 05:22:38.576202 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 05:22:38.577092 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 05:22:38.577092 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 05:22:38.577092 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 05:22:38.577092 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 05:22:38.577092 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 05:22:38.577092 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 05:22:38.577092 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.get_or_create( May 10 05:22:38.577092 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 05:22:38.577092 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application with Lock( May 10 05:22:38.577092 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 05:22:38.577092 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._enter() May 10 05:22:38.577092 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 05:22:38.577092 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 05:22:38.577092 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 05:22:38.577092 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.creator() May 10 05:22:38.577092 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 05:22:38.577092 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application created_value = creator( May 10 05:22:38.578039 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 05:22:38.578039 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 05:22:38.578039 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 05:22:38.578039 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application May 10 05:22:38.581991 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 325/663] 10.222.0.23 () {56 vars in 1108 bytes} [Tue May 10 05:22:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 05:22:38.582930 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a7a7cd-9f72-4114-9106-42d56b27a1e8 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:22:38.615835 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a8bd9e-ffe5-4bd7-9641-4612871c748b None admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:22:38.657215 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca88986-fff4-42c7-8aa0-0c7d56eab674 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:22:38.658531 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca88986-fff4-42c7-8aa0-0c7d56eab674 None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:38.659314 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca88986-fff4-42c7-8aa0-0c7d56eab674 None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:38.660092 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca88986-fff4-42c7-8aa0-0c7d56eab674 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:38.680846 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a7a7cd-9f72-4114-9106-42d56b27a1e8 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:22:38.713192 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d349f2d-2a82-4381-be17-56a45ca66fb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:22:38.713988 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d349f2d-2a82-4381-be17-56a45ca66fb0 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:38.714267 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d349f2d-2a82-4381-be17-56a45ca66fb0 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:38.714538 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d349f2d-2a82-4381-be17-56a45ca66fb0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:38.721354 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d349f2d-2a82-4381-be17-56a45ca66fb0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:22:38.722766 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d349f2d-2a82-4381-be17-56a45ca66fb0 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:22:38.729384 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca88986-fff4-42c7-8aa0-0c7d56eab674 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:22:38.730837 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca88986-fff4-42c7-8aa0-0c7d56eab674 None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:22:38.736030 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application [None req-6d349f2d-2a82-4381-be17-56a45ca66fb0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 05:22:38.736030 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 05:22:38.736030 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 05:22:38.736030 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 05:22:38.736030 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 05:22:38.736030 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 05:22:38.736030 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 05:22:38.736030 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 05:22:38.736030 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 05:22:38.736030 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 05:22:38.736030 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 05:22:38.736030 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 05:22:38.736030 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 05:22:38.736030 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 05:22:38.736030 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 05:22:38.736926 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 05:22:38.736926 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 05:22:38.736926 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 05:22:38.736926 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 05:22:38.736926 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 05:22:38.736926 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 05:22:38.736926 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.get_or_create( May 10 05:22:38.736926 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 05:22:38.736926 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application with Lock( May 10 05:22:38.736926 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 05:22:38.736926 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._enter() May 10 05:22:38.736926 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 05:22:38.736926 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 05:22:38.736926 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 05:22:38.736926 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.creator() May 10 05:22:38.736926 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 05:22:38.736926 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application created_value = creator( May 10 05:22:38.737839 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 05:22:38.737839 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 05:22:38.737839 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 05:22:38.737839 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 05:22:38.737839 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 05:22:38.737839 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 05:22:38.737839 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 05:22:38.737839 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application May 10 05:22:38.739914 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 326/664] 10.222.0.23 () {56 vars in 1111 bytes} [Tue May 10 05:22:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 05:22:38.740909 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d349f2d-2a82-4381-be17-56a45ca66fb0 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:22:38.832391 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 339/665] 10.222.0.23 () {58 vars in 1282 bytes} [Tue May 10 05:22:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 05:22:38.833713 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6142555b-d3d3-4de8-89e3-049a5c35d163 None None] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:38.834064 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6142555b-d3d3-4de8-89e3-049a5c35d163 None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:38.834409 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6142555b-d3d3-4de8-89e3-049a5c35d163 None None] PATH_INFO: `/` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:38.835947 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 340/666] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 10 05:22:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 05:22:38.840732 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6142555b-d3d3-4de8-89e3-049a5c35d163 None None] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:22:38.841122 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d349f2d-2a82-4381-be17-56a45ca66fb0 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:22:38.873740 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1268582e-77b7-4cfe-94fc-aae0bd3cce7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:22:38.874422 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1268582e-77b7-4cfe-94fc-aae0bd3cce7d None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:38.874703 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1268582e-77b7-4cfe-94fc-aae0bd3cce7d None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:38.874978 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1268582e-77b7-4cfe-94fc-aae0bd3cce7d None admin] PATH_INFO: `/v3/domains` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:38.875820 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1268582e-77b7-4cfe-94fc-aae0bd3cce7d None admin] RBAC: Adding query filter params (name=Default) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:22:38.876127 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1268582e-77b7-4cfe-94fc-aae0bd3cce7d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:22:38.877506 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1268582e-77b7-4cfe-94fc-aae0bd3cce7d None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:22:38.889526 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 327/667] 10.222.0.23 () {56 vars in 1109 bytes} [Tue May 10 05:22:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:22:38.892849 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1268582e-77b7-4cfe-94fc-aae0bd3cce7d None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:22:38.938365 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6142555b-d3d3-4de8-89e3-049a5c35d163 None None] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:22:38.970156 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f41aa3-f88b-421f-9217-6d9f0dbf6d79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:22:38.970808 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f41aa3-f88b-421f-9217-6d9f0dbf6d79 None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:38.971087 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f41aa3-f88b-421f-9217-6d9f0dbf6d79 None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:38.971421 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f41aa3-f88b-421f-9217-6d9f0dbf6d79 None admin] PATH_INFO: `/v3/projects` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:38.972180 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f41aa3-f88b-421f-9217-6d9f0dbf6d79 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:22:38.972485 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f41aa3-f88b-421f-9217-6d9f0dbf6d79 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:22:38.973982 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f41aa3-f88b-421f-9217-6d9f0dbf6d79 None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:22:38.989902 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 341/668] 10.222.0.23 () {56 vars in 1148 bytes} [Tue May 10 05:22:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:22:38.990082 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1268582e-77b7-4cfe-94fc-aae0bd3cce7d None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:22:38.990182 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e390015-7713-49d3-8075-db1e0bc0d8b6 None None] REQUEST_METHOD: `POST` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:38.990182 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e390015-7713-49d3-8075-db1e0bc0d8b6 None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:38.990182 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e390015-7713-49d3-8075-db1e0bc0d8b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:39.003206 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.auth.core [None req-3e390015-7713-49d3-8075-db1e0bc0d8b6 None None] MFA Rules not processed for user `44883b22532e44049d846938dc2cf423`. Rule list: `[]` (Enabled: `True`). {{(pid=79879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:22:39.004822 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-3e390015-7713-49d3-8075-db1e0bc0d8b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:22:39.027400 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8f316c-0082-4cb1-9b3d-6989154e3b06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:22:39.028288 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8f316c-0082-4cb1-9b3d-6989154e3b06 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:39.028564 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8f316c-0082-4cb1-9b3d-6989154e3b06 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:39.028834 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8f316c-0082-4cb1-9b3d-6989154e3b06 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:39.038658 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8f316c-0082-4cb1-9b3d-6989154e3b06 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:22:39.040204 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8f316c-0082-4cb1-9b3d-6989154e3b06 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:22:39.057183 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application [None req-5f8f316c-0082-4cb1-9b3d-6989154e3b06 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 05:22:39.057183 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 05:22:39.057183 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 05:22:39.057183 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 05:22:39.057183 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 05:22:39.057183 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 05:22:39.057183 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 05:22:39.057183 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 05:22:39.057183 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 05:22:39.057183 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 05:22:39.057183 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 05:22:39.057183 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 05:22:39.057183 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 05:22:39.057183 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 05:22:39.057183 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 05:22:39.058156 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 05:22:39.058156 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 05:22:39.058156 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 05:22:39.058156 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 05:22:39.058156 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 05:22:39.058156 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 05:22:39.058156 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.get_or_create( May 10 05:22:39.058156 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 05:22:39.058156 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application with Lock( May 10 05:22:39.058156 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 05:22:39.058156 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._enter() May 10 05:22:39.058156 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 05:22:39.058156 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 05:22:39.058156 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 05:22:39.058156 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.creator() May 10 05:22:39.058156 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 05:22:39.058156 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application created_value = creator( May 10 05:22:39.059045 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 05:22:39.059045 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 05:22:39.059045 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 05:22:39.059045 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application May 10 05:22:39.059045 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 328/669] 10.222.0.23 () {56 vars in 1108 bytes} [Tue May 10 05:22:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 05:22:39.060106 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8f316c-0082-4cb1-9b3d-6989154e3b06 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:22:39.079376 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 342/670] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 10 05:22:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 05:22:39.080437 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e390015-7713-49d3-8075-db1e0bc0d8b6 None None] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:22:39.172914 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8f316c-0082-4cb1-9b3d-6989154e3b06 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:22:39.176803 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e390015-7713-49d3-8075-db1e0bc0d8b6 None None] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:22:39.207757 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731e1798-5b8c-4cfb-a022-1cf1437ffa84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:22:39.208577 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731e1798-5b8c-4cfb-a022-1cf1437ffa84 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:39.208850 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731e1798-5b8c-4cfb-a022-1cf1437ffa84 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:39.209127 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731e1798-5b8c-4cfb-a022-1cf1437ffa84 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:39.211704 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf1e3c1-9b98-4adf-a8c3-34ef6e083c15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:22:39.212367 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf1e3c1-9b98-4adf-a8c3-34ef6e083c15 None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:39.212638 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf1e3c1-9b98-4adf-a8c3-34ef6e083c15 None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:39.212913 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf1e3c1-9b98-4adf-a8c3-34ef6e083c15 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:39.213750 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf1e3c1-9b98-4adf-a8c3-34ef6e083c15 None admin] RBAC: Adding query filter params (role.id=8a02b9040d1d4fccababc1eb4dac80e7, scope.project.id=5f23435f783540199d6dcfd0417c090e, user.id=a5b56aedcfd74914938b0b9cdd102f48) {{(pid=79879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:22:39.214060 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf1e3c1-9b98-4adf-a8c3-34ef6e083c15 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:22:39.215497 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf1e3c1-9b98-4adf-a8c3-34ef6e083c15 None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:22:39.217161 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731e1798-5b8c-4cfb-a022-1cf1437ffa84 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:22:39.218588 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731e1798-5b8c-4cfb-a022-1cf1437ffa84 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:22:39.221550 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 343/671] 10.222.0.23 () {56 vars in 1374 bytes} [Tue May 10 05:22:39 2022] GET /identity/v3/role_assignments?user.id=a5b56aedcfd74914938b0b9cdd102f48&scope.project.id=5f23435f783540199d6dcfd0417c090e&role.id=8a02b9040d1d4fccababc1eb4dac80e7 => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:22:39.222106 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf1e3c1-9b98-4adf-a8c3-34ef6e083c15 None admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:22:39.241612 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application [None req-731e1798-5b8c-4cfb-a022-1cf1437ffa84 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 05:22:39.241612 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 05:22:39.241612 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 05:22:39.241612 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 05:22:39.241612 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 05:22:39.241612 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 05:22:39.241612 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 05:22:39.241612 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 05:22:39.241612 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 05:22:39.241612 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 05:22:39.241612 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 05:22:39.241612 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 05:22:39.241612 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 05:22:39.241612 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 05:22:39.241612 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 05:22:39.242606 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 05:22:39.242606 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 05:22:39.242606 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 05:22:39.242606 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 05:22:39.242606 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 05:22:39.242606 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 05:22:39.242606 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.get_or_create( May 10 05:22:39.242606 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 05:22:39.242606 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application with Lock( May 10 05:22:39.242606 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 05:22:39.242606 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._enter() May 10 05:22:39.242606 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 05:22:39.242606 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 05:22:39.242606 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 05:22:39.242606 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.creator() May 10 05:22:39.242606 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 05:22:39.242606 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application created_value = creator( May 10 05:22:39.243478 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 05:22:39.243478 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 05:22:39.243478 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 05:22:39.243478 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 05:22:39.243478 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 05:22:39.243478 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 05:22:39.243478 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 05:22:39.243478 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application May 10 05:22:39.248322 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 329/672] 10.222.0.23 () {56 vars in 1111 bytes} [Tue May 10 05:22:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 05:22:39.249332 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731e1798-5b8c-4cfb-a022-1cf1437ffa84 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:22:39.352371 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731e1798-5b8c-4cfb-a022-1cf1437ffa84 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:22:39.357006 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf1e3c1-9b98-4adf-a8c3-34ef6e083c15 None admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:22:39.388569 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d64e9e-057f-42f6-b6fa-efe5c88c0595 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:22:39.389400 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d64e9e-057f-42f6-b6fa-efe5c88c0595 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:39.389685 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d64e9e-057f-42f6-b6fa-efe5c88c0595 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:39.389967 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d64e9e-057f-42f6-b6fa-efe5c88c0595 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:39.395836 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3197db2e-a60b-45de-8b06-3b7c70239282 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:22:39.396515 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3197db2e-a60b-45de-8b06-3b7c70239282 None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:39.396794 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3197db2e-a60b-45de-8b06-3b7c70239282 None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:39.397064 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3197db2e-a60b-45de-8b06-3b7c70239282 None admin] PATH_INFO: `/v3/domains` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:39.397801 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3197db2e-a60b-45de-8b06-3b7c70239282 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:22:39.398114 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3197db2e-a60b-45de-8b06-3b7c70239282 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:22:39.399504 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3197db2e-a60b-45de-8b06-3b7c70239282 None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:22:39.401361 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d64e9e-057f-42f6-b6fa-efe5c88c0595 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 05:22:39.409480 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application [None req-e1d64e9e-057f-42f6-b6fa-efe5c88c0595 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 10 05:22:39.409480 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 05:22:39.409480 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 05:22:39.409480 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 05:22:39.409480 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 05:22:39.409480 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 05:22:39.409480 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 05:22:39.409480 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 05:22:39.409480 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 05:22:39.409480 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 05:22:39.409480 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 05:22:39.409480 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 05:22:39.409480 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 05:22:39.409480 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 05:22:39.409480 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 05:22:39.409480 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 05:22:39.410529 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 05:22:39.410529 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 05:22:39.410529 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 05:22:39.410529 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 05:22:39.410529 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 05:22:39.410529 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 05:22:39.410529 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 05:22:39.410529 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 05:22:39.410529 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 05:22:39.410529 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.get_or_create( May 10 05:22:39.410529 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 05:22:39.410529 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application with Lock( May 10 05:22:39.410529 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 05:22:39.410529 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._enter() May 10 05:22:39.410529 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 05:22:39.410529 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 05:22:39.413695 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 05:22:39.413695 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.creator() May 10 05:22:39.413695 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 05:22:39.413695 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application created_value = creator( May 10 05:22:39.413695 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 05:22:39.413695 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 05:22:39.413695 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 05:22:39.413695 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 05:22:39.413695 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 05:22:39.413695 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 05:22:39.413695 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 10 05:22:39.413695 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application May 10 05:22:39.414495 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 344/673] 10.222.0.23 () {56 vars in 1109 bytes} [Tue May 10 05:22:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:22:39.414495 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3197db2e-a60b-45de-8b06-3b7c70239282 None admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:22:39.414650 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 330/674] 10.222.0.23 () {56 vars in 1102 bytes} [Tue May 10 05:22:39 2022] GET /identity/v3/roles/service => generated 85 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 05:22:39.414650 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83518a7-04e9-43e6-8aa0-2e8639d2b91a None None] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:39.414810 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83518a7-04e9-43e6-8aa0-2e8639d2b91a None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:39.415017 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83518a7-04e9-43e6-8aa0-2e8639d2b91a None None] PATH_INFO: `/` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:39.421251 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 331/675] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 10 05:22:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 05:22:39.421251 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83518a7-04e9-43e6-8aa0-2e8639d2b91a None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:22:39.519740 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3197db2e-a60b-45de-8b06-3b7c70239282 None admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:22:39.537836 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83518a7-04e9-43e6-8aa0-2e8639d2b91a None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:22:39.554527 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550e1a1d-7ebd-483b-ad64-8289b32f5857 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:22:39.555195 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550e1a1d-7ebd-483b-ad64-8289b32f5857 None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:39.555489 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550e1a1d-7ebd-483b-ad64-8289b32f5857 None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:39.555773 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550e1a1d-7ebd-483b-ad64-8289b32f5857 None admin] PATH_INFO: `/v3/projects` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:39.556563 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550e1a1d-7ebd-483b-ad64-8289b32f5857 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:22:39.556870 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550e1a1d-7ebd-483b-ad64-8289b32f5857 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:22:39.558301 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550e1a1d-7ebd-483b-ad64-8289b32f5857 None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:22:39.569194 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a616ba5c-4dbe-45f6-9947-14c2c880e634 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:22:39.569997 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a616ba5c-4dbe-45f6-9947-14c2c880e634 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:39.570530 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 345/676] 10.222.0.23 () {56 vars in 1148 bytes} [Tue May 10 05:22:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:22:39.571198 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550e1a1d-7ebd-483b-ad64-8289b32f5857 None admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:22:39.575094 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a616ba5c-4dbe-45f6-9947-14c2c880e634 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:39.575422 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a616ba5c-4dbe-45f6-9947-14c2c880e634 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:39.582539 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a616ba5c-4dbe-45f6-9947-14c2c880e634 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:22:39.584014 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a616ba5c-4dbe-45f6-9947-14c2c880e634 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:22:39.598115 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application [None req-a616ba5c-4dbe-45f6-9947-14c2c880e634 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 05:22:39.598115 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 05:22:39.598115 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 05:22:39.598115 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 05:22:39.598115 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 05:22:39.598115 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 05:22:39.598115 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 05:22:39.598115 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 05:22:39.598115 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 05:22:39.598115 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 05:22:39.598115 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 05:22:39.598115 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 05:22:39.598115 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 05:22:39.598115 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 05:22:39.598115 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 05:22:39.599025 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 05:22:39.599025 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 05:22:39.599025 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 05:22:39.599025 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 05:22:39.599025 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 05:22:39.599025 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 05:22:39.599025 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.get_or_create( May 10 05:22:39.599025 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 05:22:39.599025 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application with Lock( May 10 05:22:39.599025 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 05:22:39.599025 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._enter() May 10 05:22:39.599025 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 05:22:39.599025 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 05:22:39.599025 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 05:22:39.599025 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.creator() May 10 05:22:39.599025 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 05:22:39.599025 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application created_value = creator( May 10 05:22:39.599943 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 05:22:39.599943 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 05:22:39.599943 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 05:22:39.599943 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 05:22:39.599943 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 05:22:39.599943 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 05:22:39.599943 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 05:22:39.599943 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application May 10 05:22:39.599943 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 332/677] 10.222.0.23 () {56 vars in 1111 bytes} [Tue May 10 05:22:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 05:22:39.600888 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa4ebd9-ff2f-46e8-947b-d59a30e86009 None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:39.600888 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa4ebd9-ff2f-46e8-947b-d59a30e86009 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:39.601041 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa4ebd9-ff2f-46e8-947b-d59a30e86009 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:39.617670 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-4aa4ebd9-ff2f-46e8-947b-d59a30e86009 None None] MFA Rules not processed for user `44883b22532e44049d846938dc2cf423`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:22:39.618875 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-4aa4ebd9-ff2f-46e8-947b-d59a30e86009 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:22:39.671584 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550e1a1d-7ebd-483b-ad64-8289b32f5857 None admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:22:39.691604 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 333/678] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 10 05:22:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 05:22:39.691604 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa4ebd9-ff2f-46e8-947b-d59a30e86009 None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:22:39.705157 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28876c37-5a9f-43c9-abd1-57b73d7910ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:22:39.705837 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28876c37-5a9f-43c9-abd1-57b73d7910ae None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:39.706119 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28876c37-5a9f-43c9-abd1-57b73d7910ae None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:39.706395 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28876c37-5a9f-43c9-abd1-57b73d7910ae None admin] PATH_INFO: `/v3/roles` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:39.707224 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28876c37-5a9f-43c9-abd1-57b73d7910ae None admin] RBAC: Adding query filter params (name=service) {{(pid=79879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:22:39.707535 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28876c37-5a9f-43c9-abd1-57b73d7910ae None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:22:39.708942 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28876c37-5a9f-43c9-abd1-57b73d7910ae None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:22:39.717311 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 346/679] 10.222.0.23 () {56 vars in 1103 bytes} [Tue May 10 05:22:39 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:22:39.718108 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28876c37-5a9f-43c9-abd1-57b73d7910ae None admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:22:39.783737 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa4ebd9-ff2f-46e8-947b-d59a30e86009 None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:22:39.814513 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28876c37-5a9f-43c9-abd1-57b73d7910ae None admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:22:39.816285 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8aa6f48-8bec-4e92-a235-a298589f5f91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:22:39.817021 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8aa6f48-8bec-4e92-a235-a298589f5f91 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:39.817291 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8aa6f48-8bec-4e92-a235-a298589f5f91 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:39.817564 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8aa6f48-8bec-4e92-a235-a298589f5f91 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:39.818396 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8aa6f48-8bec-4e92-a235-a298589f5f91 None admin] RBAC: Adding query filter params (role.id=8a02b9040d1d4fccababc1eb4dac80e7, scope.project.id=5f23435f783540199d6dcfd0417c090e, user.id=355be413675540a39ccb00e1a0722316) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:22:39.818705 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8aa6f48-8bec-4e92-a235-a298589f5f91 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:22:39.820161 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8aa6f48-8bec-4e92-a235-a298589f5f91 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:22:39.828219 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 334/680] 10.222.0.23 () {56 vars in 1374 bytes} [Tue May 10 05:22:39 2022] GET /identity/v3/role_assignments?user.id=355be413675540a39ccb00e1a0722316&scope.project.id=5f23435f783540199d6dcfd0417c090e&role.id=8a02b9040d1d4fccababc1eb4dac80e7 => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:22:39.829611 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8aa6f48-8bec-4e92-a235-a298589f5f91 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:22:39.848970 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4312834e-d3c5-480a-b489-b56415b1bdbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:22:39.849665 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4312834e-d3c5-480a-b489-b56415b1bdbc None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:39.849949 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4312834e-d3c5-480a-b489-b56415b1bdbc None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:39.850226 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4312834e-d3c5-480a-b489-b56415b1bdbc None admin] PATH_INFO: `/v3/projects` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:39.851110 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4312834e-d3c5-480a-b489-b56415b1bdbc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:22:39.851430 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4312834e-d3c5-480a-b489-b56415b1bdbc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:22:39.853029 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4312834e-d3c5-480a-b489-b56415b1bdbc None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:22:39.866852 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 347/681] 10.222.0.23 () {56 vars in 1148 bytes} [Tue May 10 05:22:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:22:39.867788 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4312834e-d3c5-480a-b489-b56415b1bdbc None admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:22:39.948807 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8aa6f48-8bec-4e92-a235-a298589f5f91 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:22:39.976355 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4312834e-d3c5-480a-b489-b56415b1bdbc None admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:22:39.993153 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55e9026-5083-4105-986d-b59726f24207 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:22:39.994576 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55e9026-5083-4105-986d-b59726f24207 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:39.995387 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55e9026-5083-4105-986d-b59726f24207 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:39.996285 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55e9026-5083-4105-986d-b59726f24207 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:40.011019 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55e9026-5083-4105-986d-b59726f24207 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 05:22:40.015451 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b151c37a-6246-4338-9e55-bd0b0a38f6a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:22:40.016596 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b151c37a-6246-4338-9e55-bd0b0a38f6a2 None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:40.017074 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b151c37a-6246-4338-9e55-bd0b0a38f6a2 None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:40.017540 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b151c37a-6246-4338-9e55-bd0b0a38f6a2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:40.019126 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application [None req-b55e9026-5083-4105-986d-b59726f24207 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 10 05:22:40.019126 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 05:22:40.019126 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 05:22:40.019126 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 05:22:40.019126 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 05:22:40.019126 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 05:22:40.019126 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 05:22:40.019126 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 05:22:40.019126 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 05:22:40.019126 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 05:22:40.019126 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 05:22:40.019126 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 05:22:40.019126 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 05:22:40.019126 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 05:22:40.019126 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 05:22:40.019126 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 05:22:40.020322 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 05:22:40.020322 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 05:22:40.020322 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 05:22:40.020322 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 05:22:40.020322 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 05:22:40.020322 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 05:22:40.020322 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 05:22:40.020322 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 05:22:40.020322 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 05:22:40.020322 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.get_or_create( May 10 05:22:40.020322 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 05:22:40.020322 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application with Lock( May 10 05:22:40.020322 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 05:22:40.020322 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._enter() May 10 05:22:40.020322 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 05:22:40.020322 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 05:22:40.021184 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 05:22:40.021184 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.creator() May 10 05:22:40.021184 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 05:22:40.021184 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application created_value = creator( May 10 05:22:40.021184 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 05:22:40.021184 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 05:22:40.021184 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 05:22:40.021184 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 05:22:40.021184 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 05:22:40.021184 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 05:22:40.021184 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 10 05:22:40.021184 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application May 10 05:22:40.021184 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 335/682] 10.222.0.23 () {56 vars in 1096 bytes} [Tue May 10 05:22:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 05:22:40.021883 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55e9026-5083-4105-986d-b59726f24207 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:22:40.032470 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b151c37a-6246-4338-9e55-bd0b0a38f6a2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:22:40.034400 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b151c37a-6246-4338-9e55-bd0b0a38f6a2 None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:22:40.056172 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application [None req-b151c37a-6246-4338-9e55-bd0b0a38f6a2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 05:22:40.056172 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 05:22:40.056172 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 05:22:40.056172 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 05:22:40.056172 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 05:22:40.056172 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 05:22:40.056172 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 05:22:40.056172 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 05:22:40.056172 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 05:22:40.056172 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 05:22:40.056172 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 05:22:40.056172 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 05:22:40.056172 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 05:22:40.056172 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 05:22:40.056172 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 05:22:40.057112 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 05:22:40.057112 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 05:22:40.057112 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 05:22:40.057112 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 05:22:40.057112 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 05:22:40.057112 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 05:22:40.057112 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.get_or_create( May 10 05:22:40.057112 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 05:22:40.057112 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application with Lock( May 10 05:22:40.057112 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 05:22:40.057112 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self._enter() May 10 05:22:40.057112 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 05:22:40.057112 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 05:22:40.057112 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 05:22:40.057112 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.creator() May 10 05:22:40.057112 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 05:22:40.057112 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application created_value = creator( May 10 05:22:40.057997 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 05:22:40.057997 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 05:22:40.057997 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 05:22:40.057997 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application May 10 05:22:40.057997 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 348/683] 10.222.0.23 () {56 vars in 1108 bytes} [Tue May 10 05:22:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 05:22:40.058740 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b151c37a-6246-4338-9e55-bd0b0a38f6a2 None admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:22:40.149307 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55e9026-5083-4105-986d-b59726f24207 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:22:40.181507 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a0f7c4-27e8-431d-89cf-201e5510151d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:22:40.182173 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a0f7c4-27e8-431d-89cf-201e5510151d None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:40.182554 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a0f7c4-27e8-431d-89cf-201e5510151d None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:40.182893 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a0f7c4-27e8-431d-89cf-201e5510151d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:40.183822 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a0f7c4-27e8-431d-89cf-201e5510151d None admin] RBAC: Adding query filter params (role.id=8a02b9040d1d4fccababc1eb4dac80e7, scope.project.id=5f23435f783540199d6dcfd0417c090e, user.id=3c8461cfdd9648b8abcaf8d34b7a102a) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:22:40.184195 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a0f7c4-27e8-431d-89cf-201e5510151d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:22:40.185687 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a0f7c4-27e8-431d-89cf-201e5510151d None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:22:40.191628 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 336/684] 10.222.0.23 () {56 vars in 1374 bytes} [Tue May 10 05:22:40 2022] GET /identity/v3/role_assignments?user.id=3c8461cfdd9648b8abcaf8d34b7a102a&scope.project.id=5f23435f783540199d6dcfd0417c090e&role.id=8a02b9040d1d4fccababc1eb4dac80e7 => generated 608 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:22:40.192421 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a0f7c4-27e8-431d-89cf-201e5510151d None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:22:40.199059 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b151c37a-6246-4338-9e55-bd0b0a38f6a2 None admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:22:40.244619 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b8c42a-ed6c-4f47-a7b9-7f4ae44c5ce9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:22:40.245652 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b8c42a-ed6c-4f47-a7b9-7f4ae44c5ce9 None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:40.246500 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b8c42a-ed6c-4f47-a7b9-7f4ae44c5ce9 None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:40.246973 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b8c42a-ed6c-4f47-a7b9-7f4ae44c5ce9 None admin] PATH_INFO: `/v3/roles` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:40.248001 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b8c42a-ed6c-4f47-a7b9-7f4ae44c5ce9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:22:40.248529 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b8c42a-ed6c-4f47-a7b9-7f4ae44c5ce9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:22:40.251028 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b8c42a-ed6c-4f47-a7b9-7f4ae44c5ce9 None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:22:40.262781 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 349/685] 10.222.0.23 () {56 vars in 1099 bytes} [Tue May 10 05:22:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:22:40.268913 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b8c42a-ed6c-4f47-a7b9-7f4ae44c5ce9 None admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:22:40.302351 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a0f7c4-27e8-431d-89cf-201e5510151d None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:22:40.338203 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc8c49e-39c5-406d-984b-63334cecf706 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:22:40.338870 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc8c49e-39c5-406d-984b-63334cecf706 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:40.339191 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc8c49e-39c5-406d-984b-63334cecf706 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:40.339464 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc8c49e-39c5-406d-984b-63334cecf706 None admin] PATH_INFO: `/v3/domains` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:40.340256 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc8c49e-39c5-406d-984b-63334cecf706 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:22:40.340557 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc8c49e-39c5-406d-984b-63334cecf706 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:22:40.341942 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc8c49e-39c5-406d-984b-63334cecf706 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:22:40.358791 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 337/686] 10.222.0.23 () {56 vars in 1109 bytes} [Tue May 10 05:22:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:22:40.365121 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc8c49e-39c5-406d-984b-63334cecf706 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:22:40.477587 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b8c42a-ed6c-4f47-a7b9-7f4ae44c5ce9 None admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:22:40.488996 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc8c49e-39c5-406d-984b-63334cecf706 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:22:40.522914 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436d3289-d726-47c5-8073-86ea09e58c5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:22:40.523747 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436d3289-d726-47c5-8073-86ea09e58c5a None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:40.524036 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436d3289-d726-47c5-8073-86ea09e58c5a None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:40.524289 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436d3289-d726-47c5-8073-86ea09e58c5a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:40.525651 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6168845-7643-4052-bce4-3a9cce6c7c76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:22:40.526680 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6168845-7643-4052-bce4-3a9cce6c7c76 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:40.527154 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6168845-7643-4052-bce4-3a9cce6c7c76 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:40.527626 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6168845-7643-4052-bce4-3a9cce6c7c76 None admin] PATH_INFO: `/v3/users/swift` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:40.535204 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6168845-7643-4052-bce4-3a9cce6c7c76 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:22:40.536668 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436d3289-d726-47c5-8073-86ea09e58c5a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:22:40.537180 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6168845-7643-4052-bce4-3a9cce6c7c76 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:22:40.538412 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436d3289-d726-47c5-8073-86ea09e58c5a None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:22:40.553000 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application [None req-e6168845-7643-4052-bce4-3a9cce6c7c76 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 10 05:22:40.553000 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 05:22:40.553000 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 05:22:40.553000 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 05:22:40.553000 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 05:22:40.553000 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 05:22:40.553000 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 05:22:40.553000 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 05:22:40.553000 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 05:22:40.553000 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 05:22:40.553000 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 05:22:40.553000 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 05:22:40.553000 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 05:22:40.553000 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 05:22:40.553000 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 05:22:40.553000 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 05:22:40.554006 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 05:22:40.554006 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 05:22:40.554006 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 05:22:40.554006 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 05:22:40.554006 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 05:22:40.554006 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 05:22:40.554006 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 05:22:40.554006 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 05:22:40.554006 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 05:22:40.554006 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.get_or_create( May 10 05:22:40.554006 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 05:22:40.554006 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application with Lock( May 10 05:22:40.554006 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 05:22:40.554006 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._enter() May 10 05:22:40.554006 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 05:22:40.554006 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 05:22:40.554006 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 05:22:40.554006 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.creator() May 10 05:22:40.554984 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 05:22:40.554984 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application created_value = creator( May 10 05:22:40.554984 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 05:22:40.554984 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 05:22:40.554984 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 05:22:40.554984 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 05:22:40.554984 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 05:22:40.554984 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 05:22:40.554984 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 10 05:22:40.554984 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application May 10 05:22:40.558106 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 338/687] 10.222.0.23 () {56 vars in 1096 bytes} [Tue May 10 05:22:40 2022] GET /identity/v3/users/swift => generated 83 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 05:22:40.558530 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application [None req-436d3289-d726-47c5-8073-86ea09e58c5a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 05:22:40.558530 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 05:22:40.558530 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 05:22:40.558530 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 05:22:40.558530 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 05:22:40.558530 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 05:22:40.558530 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 05:22:40.558530 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 05:22:40.558530 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 05:22:40.558530 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 05:22:40.558530 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 05:22:40.558530 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 05:22:40.558530 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 05:22:40.558530 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 05:22:40.558530 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 05:22:40.559476 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 05:22:40.559476 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 05:22:40.559476 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 05:22:40.559476 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 05:22:40.559476 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 05:22:40.559476 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 05:22:40.559476 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.get_or_create( May 10 05:22:40.559476 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 05:22:40.559476 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application with Lock( May 10 05:22:40.559476 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 05:22:40.559476 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self._enter() May 10 05:22:40.559476 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 05:22:40.559476 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 05:22:40.559476 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 05:22:40.559476 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.creator() May 10 05:22:40.559476 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 05:22:40.559476 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application created_value = creator( May 10 05:22:40.560439 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 05:22:40.560439 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 05:22:40.560439 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 05:22:40.560439 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application May 10 05:22:40.560439 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 350/688] 10.222.0.23 () {56 vars in 1108 bytes} [Tue May 10 05:22:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 292 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 05:22:40.563634 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6168845-7643-4052-bce4-3a9cce6c7c76 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:22:40.565580 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436d3289-d726-47c5-8073-86ea09e58c5a None admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:22:40.664224 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6168845-7643-4052-bce4-3a9cce6c7c76 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:22:40.675727 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436d3289-d726-47c5-8073-86ea09e58c5a None admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:22:40.698684 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945a2111-9180-4d8f-a445-30946e9ab5ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:22:40.699365 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945a2111-9180-4d8f-a445-30946e9ab5ba None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:40.699673 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945a2111-9180-4d8f-a445-30946e9ab5ba None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:40.699943 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945a2111-9180-4d8f-a445-30946e9ab5ba None admin] PATH_INFO: `/v3/users` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:40.700787 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945a2111-9180-4d8f-a445-30946e9ab5ba None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:22:40.701090 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945a2111-9180-4d8f-a445-30946e9ab5ba None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:22:40.702536 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945a2111-9180-4d8f-a445-30946e9ab5ba None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:22:40.721823 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7152e5d3-1486-42b7-9cae-96e1ef80411b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:22:40.722503 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7152e5d3-1486-42b7-9cae-96e1ef80411b None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:40.722899 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7152e5d3-1486-42b7-9cae-96e1ef80411b None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:40.723175 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7152e5d3-1486-42b7-9cae-96e1ef80411b None admin] PATH_INFO: `/v3/domains` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:40.723940 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7152e5d3-1486-42b7-9cae-96e1ef80411b None admin] RBAC: Adding query filter params (name=Default) {{(pid=79879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:22:40.724245 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7152e5d3-1486-42b7-9cae-96e1ef80411b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:22:40.725635 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7152e5d3-1486-42b7-9cae-96e1ef80411b None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:22:40.729543 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 339/689] 10.222.0.23 () {56 vars in 1135 bytes} [Tue May 10 05:22:40 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:22:40.734863 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945a2111-9180-4d8f-a445-30946e9ab5ba None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:22:40.752799 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 351/690] 10.222.0.23 () {56 vars in 1109 bytes} [Tue May 10 05:22:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 05:22:40.759419 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7152e5d3-1486-42b7-9cae-96e1ef80411b None admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:22:40.916838 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945a2111-9180-4d8f-a445-30946e9ab5ba None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:22:40.931162 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7152e5d3-1486-42b7-9cae-96e1ef80411b None admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:22:40.970338 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6efb9f-f9a6-481e-bafb-1f97a832342b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:22:40.971008 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6efb9f-f9a6-481e-bafb-1f97a832342b None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:40.971289 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6efb9f-f9a6-481e-bafb-1f97a832342b None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:40.971565 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6efb9f-f9a6-481e-bafb-1f97a832342b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:40.990178 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019a2a19-7668-4cb3-b322-d33ed0f8cfb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:22:40.990992 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019a2a19-7668-4cb3-b322-d33ed0f8cfb0 None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:40.991278 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019a2a19-7668-4cb3-b322-d33ed0f8cfb0 None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:40.991556 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019a2a19-7668-4cb3-b322-d33ed0f8cfb0 None admin] PATH_INFO: `/v3/users/nova` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:41.002933 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019a2a19-7668-4cb3-b322-d33ed0f8cfb0 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:22:41.004489 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019a2a19-7668-4cb3-b322-d33ed0f8cfb0 None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:22:41.038306 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application [None req-019a2a19-7668-4cb3-b322-d33ed0f8cfb0 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 10 05:22:41.038306 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 05:22:41.038306 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 05:22:41.038306 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 05:22:41.038306 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 05:22:41.038306 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 05:22:41.038306 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 05:22:41.038306 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 05:22:41.038306 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 05:22:41.038306 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 05:22:41.038306 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 05:22:41.038306 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 05:22:41.038306 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 05:22:41.038306 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 05:22:41.038306 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 05:22:41.038306 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 05:22:41.039336 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 05:22:41.039336 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 05:22:41.039336 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 05:22:41.039336 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 05:22:41.039336 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 05:22:41.039336 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 05:22:41.039336 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 05:22:41.039336 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 05:22:41.039336 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 05:22:41.039336 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.get_or_create( May 10 05:22:41.039336 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 05:22:41.039336 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application with Lock( May 10 05:22:41.039336 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 05:22:41.039336 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self._enter() May 10 05:22:41.039336 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 05:22:41.039336 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 05:22:41.039336 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 05:22:41.039336 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.creator() May 10 05:22:41.040311 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 05:22:41.040311 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application created_value = creator( May 10 05:22:41.040311 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 05:22:41.040311 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 05:22:41.040311 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 05:22:41.040311 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 05:22:41.040311 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 05:22:41.040311 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 05:22:41.040311 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 10 05:22:41.040311 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application May 10 05:22:41.041618 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 352/691] 10.222.0.23 () {56 vars in 1093 bytes} [Tue May 10 05:22:40 2022] GET /identity/v3/users/nova => generated 82 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 05:22:41.048442 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019a2a19-7668-4cb3-b322-d33ed0f8cfb0 None admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:22:41.076857 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6efb9f-f9a6-481e-bafb-1f97a832342b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:22:41.078335 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6efb9f-f9a6-481e-bafb-1f97a832342b None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:22:41.153111 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019a2a19-7668-4cb3-b322-d33ed0f8cfb0 None admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:22:41.187225 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf037f8-89a3-4ac9-becb-09ce19fceef6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:22:41.187855 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf037f8-89a3-4ac9-becb-09ce19fceef6 None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:41.188133 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf037f8-89a3-4ac9-becb-09ce19fceef6 None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:41.188405 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf037f8-89a3-4ac9-becb-09ce19fceef6 None admin] PATH_INFO: `/v3/users` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:41.189257 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf037f8-89a3-4ac9-becb-09ce19fceef6 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:22:41.189562 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf037f8-89a3-4ac9-becb-09ce19fceef6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:22:41.191005 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf037f8-89a3-4ac9-becb-09ce19fceef6 None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:22:41.208697 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 353/692] 10.222.0.23 () {56 vars in 1133 bytes} [Tue May 10 05:22:41 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 05:22:41.215123 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf037f8-89a3-4ac9-becb-09ce19fceef6 None admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:22:41.232270 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 340/693] 10.222.0.23 () {58 vars in 1282 bytes} [Tue May 10 05:22:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 498 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 10 05:22:41.237481 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6efb9f-f9a6-481e-bafb-1f97a832342b None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:22:41.311798 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf037f8-89a3-4ac9-becb-09ce19fceef6 None admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:22:41.345008 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48eb9038-39b2-44a0-a170-45650d706372 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:22:41.345656 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48eb9038-39b2-44a0-a170-45650d706372 None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:41.345934 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48eb9038-39b2-44a0-a170-45650d706372 None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:41.346358 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48eb9038-39b2-44a0-a170-45650d706372 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:41.412597 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48eb9038-39b2-44a0-a170-45650d706372 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:22:41.414063 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48eb9038-39b2-44a0-a170-45650d706372 None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:22:41.455422 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6efb9f-f9a6-481e-bafb-1f97a832342b None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:22:41.514809 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e18199-cc7f-4e55-aca6-0bc8671f391c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:22:41.516055 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e18199-cc7f-4e55-aca6-0bc8671f391c None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:41.516497 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 354/694] 10.222.0.23 () {58 vars in 1282 bytes} [Tue May 10 05:22:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 10 05:22:41.516794 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e18199-cc7f-4e55-aca6-0bc8671f391c None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:41.517071 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e18199-cc7f-4e55-aca6-0bc8671f391c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:41.527454 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e18199-cc7f-4e55-aca6-0bc8671f391c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:22:41.528719 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48eb9038-39b2-44a0-a170-45650d706372 None admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:22:41.529169 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e18199-cc7f-4e55-aca6-0bc8671f391c None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:22:41.548157 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application [None req-04e18199-cc7f-4e55-aca6-0bc8671f391c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 05:22:41.548157 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 05:22:41.548157 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 05:22:41.548157 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 05:22:41.548157 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 05:22:41.548157 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 05:22:41.548157 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 05:22:41.548157 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 05:22:41.548157 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 05:22:41.548157 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 05:22:41.548157 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 05:22:41.548157 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 05:22:41.548157 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 05:22:41.548157 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 05:22:41.548157 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 05:22:41.549127 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 05:22:41.549127 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 05:22:41.549127 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 05:22:41.549127 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 05:22:41.549127 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 05:22:41.549127 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 05:22:41.549127 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.get_or_create( May 10 05:22:41.549127 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 05:22:41.549127 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application with Lock( May 10 05:22:41.549127 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 05:22:41.549127 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._enter() May 10 05:22:41.549127 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 05:22:41.549127 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 05:22:41.549127 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 05:22:41.549127 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.creator() May 10 05:22:41.549127 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 05:22:41.549127 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application created_value = creator( May 10 05:22:41.550021 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 05:22:41.550021 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 05:22:41.550021 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 05:22:41.550021 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application May 10 05:22:41.553879 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 341/695] 10.222.0.23 () {56 vars in 1108 bytes} [Tue May 10 05:22:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 312 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 05:22:41.555547 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e18199-cc7f-4e55-aca6-0bc8671f391c None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:22:41.668893 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48eb9038-39b2-44a0-a170-45650d706372 None admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:22:41.681494 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e18199-cc7f-4e55-aca6-0bc8671f391c None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:22:41.707022 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb01e3ef-c7b0-4c24-b528-145a89bb7082 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:22:41.710140 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb01e3ef-c7b0-4c24-b528-145a89bb7082 None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:41.710800 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb01e3ef-c7b0-4c24-b528-145a89bb7082 None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:41.712657 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb01e3ef-c7b0-4c24-b528-145a89bb7082 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:41.733547 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb01e3ef-c7b0-4c24-b528-145a89bb7082 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:22:41.735015 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb01e3ef-c7b0-4c24-b528-145a89bb7082 None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:22:41.743241 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89dfe061-e60f-4157-b02d-02ec19822f29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:22:41.744211 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89dfe061-e60f-4157-b02d-02ec19822f29 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:41.744693 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89dfe061-e60f-4157-b02d-02ec19822f29 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:41.747477 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89dfe061-e60f-4157-b02d-02ec19822f29 None admin] PATH_INFO: `/v3/domains` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:41.748493 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89dfe061-e60f-4157-b02d-02ec19822f29 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:22:41.749023 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89dfe061-e60f-4157-b02d-02ec19822f29 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:22:41.750663 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89dfe061-e60f-4157-b02d-02ec19822f29 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:22:41.771166 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application [None req-cb01e3ef-c7b0-4c24-b528-145a89bb7082 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 05:22:41.771166 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 05:22:41.771166 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 05:22:41.771166 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 05:22:41.771166 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 05:22:41.771166 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 05:22:41.771166 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 05:22:41.771166 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 05:22:41.771166 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 05:22:41.771166 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 05:22:41.771166 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 05:22:41.771166 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 05:22:41.771166 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 05:22:41.771166 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 05:22:41.771166 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 05:22:41.772173 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 05:22:41.772173 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 05:22:41.772173 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 05:22:41.772173 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 05:22:41.772173 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 05:22:41.772173 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 05:22:41.772173 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.get_or_create( May 10 05:22:41.772173 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 05:22:41.772173 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application with Lock( May 10 05:22:41.772173 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 05:22:41.772173 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self._enter() May 10 05:22:41.772173 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 05:22:41.772173 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 05:22:41.772173 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 05:22:41.772173 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.creator() May 10 05:22:41.772173 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 05:22:41.772173 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application created_value = creator( May 10 05:22:41.773077 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 05:22:41.773077 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 05:22:41.773077 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 05:22:41.773077 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application May 10 05:22:41.778100 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 342/696] 10.222.0.23 () {56 vars in 1109 bytes} [Tue May 10 05:22:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:22:41.778555 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 355/697] 10.222.0.23 () {56 vars in 1108 bytes} [Tue May 10 05:22:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 05:22:41.787639 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89dfe061-e60f-4157-b02d-02ec19822f29 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:22:41.787799 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb01e3ef-c7b0-4c24-b528-145a89bb7082 None admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:22:41.903363 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89dfe061-e60f-4157-b02d-02ec19822f29 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:22:41.904587 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb01e3ef-c7b0-4c24-b528-145a89bb7082 None admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:22:41.936119 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc53e876-84c8-49d4-8d88-b4007845d894 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:22:41.936911 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc53e876-84c8-49d4-8d88-b4007845d894 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:41.937254 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc53e876-84c8-49d4-8d88-b4007845d894 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:41.937598 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc53e876-84c8-49d4-8d88-b4007845d894 None admin] PATH_INFO: `/v3/domains` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:41.938399 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc53e876-84c8-49d4-8d88-b4007845d894 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:22:41.938770 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc53e876-84c8-49d4-8d88-b4007845d894 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:22:41.940298 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc53e876-84c8-49d4-8d88-b4007845d894 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:22:41.946662 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c85868e-ef34-4acf-b0be-836e09c7c16f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:22:41.948179 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c85868e-ef34-4acf-b0be-836e09c7c16f None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:41.948658 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c85868e-ef34-4acf-b0be-836e09c7c16f None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:41.949097 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c85868e-ef34-4acf-b0be-836e09c7c16f None admin] PATH_INFO: `/v3/projects/service` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:41.953111 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 343/698] 10.222.0.23 () {56 vars in 1109 bytes} [Tue May 10 05:22:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:22:41.954570 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d130ba5-0fd6-40e5-8edb-c50d22d54737 None None] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:41.954928 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d130ba5-0fd6-40e5-8edb-c50d22d54737 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:41.955271 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d130ba5-0fd6-40e5-8edb-c50d22d54737 None None] PATH_INFO: `/` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:41.956619 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 344/699] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 10 05:22:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 05:22:41.958299 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c85868e-ef34-4acf-b0be-836e09c7c16f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:22:41.959947 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c85868e-ef34-4acf-b0be-836e09c7c16f None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:22:41.960554 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d130ba5-0fd6-40e5-8edb-c50d22d54737 None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:22:41.977375 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application [None req-7c85868e-ef34-4acf-b0be-836e09c7c16f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 05:22:41.977375 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 05:22:41.977375 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 05:22:41.977375 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 05:22:41.977375 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 05:22:41.977375 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 05:22:41.977375 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 05:22:41.977375 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 05:22:41.977375 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 05:22:41.977375 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 05:22:41.977375 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 05:22:41.977375 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 05:22:41.977375 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 05:22:41.977375 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 05:22:41.977375 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 05:22:41.978316 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 05:22:41.978316 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 05:22:41.978316 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 05:22:41.978316 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 05:22:41.978316 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 05:22:41.978316 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 05:22:41.978316 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.get_or_create( May 10 05:22:41.978316 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 05:22:41.978316 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application with Lock( May 10 05:22:41.978316 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 05:22:41.978316 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self._enter() May 10 05:22:41.978316 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 05:22:41.978316 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 05:22:41.978316 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 05:22:41.978316 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.creator() May 10 05:22:41.978316 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 05:22:41.978316 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application created_value = creator( May 10 05:22:41.979204 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 05:22:41.979204 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 05:22:41.979204 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 05:22:41.979204 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 05:22:41.979204 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 05:22:41.979204 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 05:22:41.979204 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 05:22:41.979204 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application May 10 05:22:41.981345 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 356/700] 10.222.0.23 () {56 vars in 1111 bytes} [Tue May 10 05:22:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 05:22:41.986137 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec04af6-f76f-44cd-bbcc-ca9e30978a17 None None] REQUEST_METHOD: `POST` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:41.986137 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec04af6-f76f-44cd-bbcc-ca9e30978a17 None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:41.986137 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec04af6-f76f-44cd-bbcc-ca9e30978a17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:42.008954 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.auth.core [None req-aec04af6-f76f-44cd-bbcc-ca9e30978a17 None None] MFA Rules not processed for user `44883b22532e44049d846938dc2cf423`. Rule list: `[]` (Enabled: `True`). {{(pid=79879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:22:42.010524 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-aec04af6-f76f-44cd-bbcc-ca9e30978a17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:22:42.079956 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d130ba5-0fd6-40e5-8edb-c50d22d54737 None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:22:42.095829 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 357/701] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 10 05:22:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 05:22:42.096958 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec04af6-f76f-44cd-bbcc-ca9e30978a17 None None] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:22:42.119107 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1227c8-600b-483b-ad84-14080c3e6d99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:22:42.121778 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1227c8-600b-483b-ad84-14080c3e6d99 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:42.122314 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1227c8-600b-483b-ad84-14080c3e6d99 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:42.122818 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1227c8-600b-483b-ad84-14080c3e6d99 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:42.132342 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1227c8-600b-483b-ad84-14080c3e6d99 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:22:42.134574 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1227c8-600b-483b-ad84-14080c3e6d99 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:22:42.153007 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application [None req-ed1227c8-600b-483b-ad84-14080c3e6d99 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 05:22:42.153007 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 05:22:42.153007 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 05:22:42.153007 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 05:22:42.153007 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 05:22:42.153007 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 05:22:42.153007 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 05:22:42.153007 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 05:22:42.153007 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 05:22:42.153007 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 05:22:42.153007 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 05:22:42.153007 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 05:22:42.153007 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 05:22:42.153007 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 05:22:42.153007 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 05:22:42.153900 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 05:22:42.153900 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 05:22:42.153900 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 05:22:42.153900 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 05:22:42.153900 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 05:22:42.153900 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 05:22:42.153900 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.get_or_create( May 10 05:22:42.153900 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 05:22:42.153900 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application with Lock( May 10 05:22:42.153900 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 05:22:42.153900 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._enter() May 10 05:22:42.153900 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 05:22:42.153900 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 05:22:42.153900 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 05:22:42.153900 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.creator() May 10 05:22:42.153900 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 05:22:42.153900 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application created_value = creator( May 10 05:22:42.154818 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 05:22:42.154818 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 05:22:42.154818 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 05:22:42.154818 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 05:22:42.154818 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 05:22:42.154818 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 05:22:42.154818 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 05:22:42.154818 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application May 10 05:22:42.157393 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 345/702] 10.222.0.23 () {56 vars in 1111 bytes} [Tue May 10 05:22:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 05:22:42.158743 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1227c8-600b-483b-ad84-14080c3e6d99 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:22:42.213805 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec04af6-f76f-44cd-bbcc-ca9e30978a17 None None] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:22:42.253655 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f54bed-7cb2-4f2d-8d0b-2839146d5a24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:22:42.254556 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f54bed-7cb2-4f2d-8d0b-2839146d5a24 None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:42.254962 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f54bed-7cb2-4f2d-8d0b-2839146d5a24 None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:42.255331 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f54bed-7cb2-4f2d-8d0b-2839146d5a24 None admin] PATH_INFO: `/v3/projects` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:42.256453 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f54bed-7cb2-4f2d-8d0b-2839146d5a24 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:22:42.256906 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f54bed-7cb2-4f2d-8d0b-2839146d5a24 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:22:42.258460 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f54bed-7cb2-4f2d-8d0b-2839146d5a24 None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:22:42.275970 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 358/703] 10.222.0.23 () {56 vars in 1148 bytes} [Tue May 10 05:22:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:22:42.275970 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f54bed-7cb2-4f2d-8d0b-2839146d5a24 None admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:22:42.293642 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1227c8-600b-483b-ad84-14080c3e6d99 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:22:42.336227 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca12ff3-6270-4c8a-ab03-cae2518ef784 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:22:42.337221 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca12ff3-6270-4c8a-ab03-cae2518ef784 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:42.337584 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca12ff3-6270-4c8a-ab03-cae2518ef784 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:42.337941 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca12ff3-6270-4c8a-ab03-cae2518ef784 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:42.349984 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca12ff3-6270-4c8a-ab03-cae2518ef784 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:22:42.351644 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca12ff3-6270-4c8a-ab03-cae2518ef784 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:22:42.369102 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application [None req-fca12ff3-6270-4c8a-ab03-cae2518ef784 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 05:22:42.369102 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 05:22:42.369102 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 05:22:42.369102 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 05:22:42.369102 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 05:22:42.369102 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 05:22:42.369102 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 05:22:42.369102 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 05:22:42.369102 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 05:22:42.369102 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 05:22:42.369102 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 05:22:42.369102 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 05:22:42.369102 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 05:22:42.369102 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 05:22:42.369102 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 05:22:42.370249 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 05:22:42.370249 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 05:22:42.370249 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 05:22:42.370249 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 05:22:42.370249 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 05:22:42.370249 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 05:22:42.370249 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.get_or_create( May 10 05:22:42.370249 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 05:22:42.370249 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application with Lock( May 10 05:22:42.370249 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 05:22:42.370249 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._enter() May 10 05:22:42.370249 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 05:22:42.370249 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 05:22:42.370249 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 05:22:42.370249 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.creator() May 10 05:22:42.370249 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 05:22:42.370249 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application created_value = creator( May 10 05:22:42.371724 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 05:22:42.371724 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 05:22:42.371724 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 05:22:42.371724 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application May 10 05:22:42.378080 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 346/704] 10.222.0.23 () {56 vars in 1108 bytes} [Tue May 10 05:22:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 05:22:42.379117 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca12ff3-6270-4c8a-ab03-cae2518ef784 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:22:42.386128 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f54bed-7cb2-4f2d-8d0b-2839146d5a24 None admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:22:42.427667 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66eb71f-6505-4211-b29e-55dd0eb3f220 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:22:42.431107 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66eb71f-6505-4211-b29e-55dd0eb3f220 None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:42.431491 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66eb71f-6505-4211-b29e-55dd0eb3f220 None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:42.431887 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66eb71f-6505-4211-b29e-55dd0eb3f220 None admin] PATH_INFO: `/v3/projects` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:42.432801 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66eb71f-6505-4211-b29e-55dd0eb3f220 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:22:42.433196 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66eb71f-6505-4211-b29e-55dd0eb3f220 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:22:42.434748 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66eb71f-6505-4211-b29e-55dd0eb3f220 None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:22:42.447605 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 359/705] 10.222.0.23 () {56 vars in 1148 bytes} [Tue May 10 05:22:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:22:42.448636 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66eb71f-6505-4211-b29e-55dd0eb3f220 None admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:22:42.486701 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca12ff3-6270-4c8a-ab03-cae2518ef784 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:22:42.522605 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8be26ea-9ccf-4f44-851a-161b765e16c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:22:42.523296 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8be26ea-9ccf-4f44-851a-161b765e16c3 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:42.523603 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8be26ea-9ccf-4f44-851a-161b765e16c3 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:42.523882 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8be26ea-9ccf-4f44-851a-161b765e16c3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:42.524721 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8be26ea-9ccf-4f44-851a-161b765e16c3 None admin] RBAC: Adding query filter params (role.id=8a02b9040d1d4fccababc1eb4dac80e7, scope.project.id=5f23435f783540199d6dcfd0417c090e, user.id=fd31dacf30804395bd029037b407c12a) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:22:42.525037 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8be26ea-9ccf-4f44-851a-161b765e16c3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:22:42.526488 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8be26ea-9ccf-4f44-851a-161b765e16c3 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:22:42.539946 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 347/706] 10.222.0.23 () {56 vars in 1374 bytes} [Tue May 10 05:22:42 2022] GET /identity/v3/role_assignments?user.id=fd31dacf30804395bd029037b407c12a&scope.project.id=5f23435f783540199d6dcfd0417c090e&role.id=8a02b9040d1d4fccababc1eb4dac80e7 => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:22:42.539946 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8be26ea-9ccf-4f44-851a-161b765e16c3 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:22:42.559736 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66eb71f-6505-4211-b29e-55dd0eb3f220 None admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:22:42.596708 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce7bd6f-4bf3-453e-a838-a9b9bc41c977 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:22:42.597545 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce7bd6f-4bf3-453e-a838-a9b9bc41c977 None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:42.597970 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce7bd6f-4bf3-453e-a838-a9b9bc41c977 None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:42.598338 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce7bd6f-4bf3-453e-a838-a9b9bc41c977 None admin] PATH_INFO: `/v3/domains` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:42.599185 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce7bd6f-4bf3-453e-a838-a9b9bc41c977 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:22:42.599626 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce7bd6f-4bf3-453e-a838-a9b9bc41c977 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:22:42.601242 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce7bd6f-4bf3-453e-a838-a9b9bc41c977 None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:22:42.614114 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 360/707] 10.222.0.23 () {56 vars in 1109 bytes} [Tue May 10 05:22:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:22:42.615796 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cedec9-4fa1-4474-a906-a4d0be8d7e3d None None] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:42.616180 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cedec9-4fa1-4474-a906-a4d0be8d7e3d None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:42.616553 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cedec9-4fa1-4474-a906-a4d0be8d7e3d None None] PATH_INFO: `/` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:42.618284 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 361/708] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 10 05:22:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 05:22:42.619080 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cedec9-4fa1-4474-a906-a4d0be8d7e3d None None] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:22:42.677720 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8be26ea-9ccf-4f44-851a-161b765e16c3 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:22:42.722617 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d4bde7-2a5f-40c5-a2f2-c1fd3eeeb00f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:22:42.723628 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d4bde7-2a5f-40c5-a2f2-c1fd3eeeb00f None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:42.723936 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d4bde7-2a5f-40c5-a2f2-c1fd3eeeb00f None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:42.724207 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d4bde7-2a5f-40c5-a2f2-c1fd3eeeb00f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:42.725386 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d4bde7-2a5f-40c5-a2f2-c1fd3eeeb00f None admin] RBAC: Adding query filter params (role.id=199ac1dd842441d7913c6ee89d8fbecc, scope.project.id=5f23435f783540199d6dcfd0417c090e, user.id=7f50f224ca944983aecfde86375473da) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:22:42.725695 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d4bde7-2a5f-40c5-a2f2-c1fd3eeeb00f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:22:42.727966 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d4bde7-2a5f-40c5-a2f2-c1fd3eeeb00f None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:22:42.731181 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cedec9-4fa1-4474-a906-a4d0be8d7e3d None None] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:22:42.736592 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 348/709] 10.222.0.23 () {56 vars in 1374 bytes} [Tue May 10 05:22:42 2022] GET /identity/v3/role_assignments?user.id=7f50f224ca944983aecfde86375473da&scope.project.id=5f23435f783540199d6dcfd0417c090e&role.id=199ac1dd842441d7913c6ee89d8fbecc => generated 259 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:22:42.737901 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed4c967-91ee-4b1b-91ae-709ca803eab2 None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:42.738190 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed4c967-91ee-4b1b-91ae-709ca803eab2 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:42.738578 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed4c967-91ee-4b1b-91ae-709ca803eab2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:42.759242 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-0ed4c967-91ee-4b1b-91ae-709ca803eab2 None None] MFA Rules not processed for user `44883b22532e44049d846938dc2cf423`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:22:42.761213 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-0ed4c967-91ee-4b1b-91ae-709ca803eab2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:22:42.799827 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688eecc3-a40b-4f14-b465-4e428d738d89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:22:42.800783 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688eecc3-a40b-4f14-b465-4e428d738d89 None admin] REQUEST_METHOD: `POST` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:42.801252 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688eecc3-a40b-4f14-b465-4e428d738d89 None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:42.802886 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688eecc3-a40b-4f14-b465-4e428d738d89 None admin] PATH_INFO: `/v3/users` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:42.803863 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688eecc3-a40b-4f14-b465-4e428d738d89 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:22:42.807228 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688eecc3-a40b-4f14-b465-4e428d738d89 None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:22:42.837366 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 362/710] 10.222.0.23 () {60 vars in 1132 bytes} [Tue May 10 05:22:42 2022] POST /identity/v3/users => generated 254 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 05:22:42.858330 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 349/711] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 10 05:22:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 05:22:42.880722 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688eecc3-a40b-4f14-b465-4e428d738d89 None admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:22:42.977068 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7df1d9-1289-4b31-aac8-d3ae2f7799ae None None] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:42.977273 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7df1d9-1289-4b31-aac8-d3ae2f7799ae None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:42.977551 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7df1d9-1289-4b31-aac8-d3ae2f7799ae None None] PATH_INFO: `/` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:42.979070 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 350/712] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 10 05:22:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 05:22:42.985124 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15b8c97-e242-46e1-9578-5468215d68e8 None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:42.985470 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15b8c97-e242-46e1-9578-5468215d68e8 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:42.985683 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15b8c97-e242-46e1-9578-5468215d68e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:43.004389 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688eecc3-a40b-4f14-b465-4e428d738d89 None admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:22:43.009060 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-c15b8c97-e242-46e1-9578-5468215d68e8 None None] MFA Rules not processed for user `44883b22532e44049d846938dc2cf423`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:22:43.010281 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-c15b8c97-e242-46e1-9578-5468215d68e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:22:43.051548 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9bb5bd-e63c-40fd-9ece-dd9d89dd7430 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:22:43.052447 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9bb5bd-e63c-40fd-9ece-dd9d89dd7430 None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:43.052727 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9bb5bd-e63c-40fd-9ece-dd9d89dd7430 None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:43.052997 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9bb5bd-e63c-40fd-9ece-dd9d89dd7430 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:43.053661 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9bb5bd-e63c-40fd-9ece-dd9d89dd7430 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:22:43.055065 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9bb5bd-e63c-40fd-9ece-dd9d89dd7430 None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:22:43.078275 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application [None req-ef9bb5bd-e63c-40fd-9ece-dd9d89dd7430 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 10 05:22:43.078275 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 05:22:43.078275 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 10 05:22:43.078275 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 10 05:22:43.078275 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 10 05:22:43.078275 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 10 05:22:43.078275 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 10 05:22:43.078275 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 05:22:43.078275 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 10 05:22:43.078275 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application May 10 05:22:43.078275 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 05:22:43.078275 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application May 10 05:22:43.078275 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 05:22:43.078275 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 05:22:43.078275 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 05:22:43.078275 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 05:22:43.079335 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 05:22:43.079335 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 05:22:43.079335 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 05:22:43.079335 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 05:22:43.079335 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 05:22:43.079335 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 05:22:43.079335 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 05:22:43.079335 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 10 05:22:43.079335 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self._get_service(service_id) May 10 05:22:43.079335 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 10 05:22:43.079335 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 10 05:22:43.079335 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 05:22:43.079335 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 05:22:43.079335 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 05:22:43.079335 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 05:22:43.079335 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 05:22:43.080226 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.get_or_create( May 10 05:22:43.080226 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 05:22:43.080226 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application with Lock( May 10 05:22:43.080226 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 05:22:43.080226 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self._enter() May 10 05:22:43.080226 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 05:22:43.080226 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 05:22:43.080226 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 05:22:43.080226 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.creator() May 10 05:22:43.080226 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 05:22:43.080226 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application created_value = creator( May 10 05:22:43.080226 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 10 05:22:43.080226 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 05:22:43.080226 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 10 05:22:43.080226 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application May 10 05:22:43.082528 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 363/713] 10.222.0.23 () {56 vars in 1129 bytes} [Tue May 10 05:22:42 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 05:22:43.089934 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9bb5bd-e63c-40fd-9ece-dd9d89dd7430 None admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:22:43.117032 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 351/714] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 10 05:22:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 10 05:22:43.139683 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15b8c97-e242-46e1-9578-5468215d68e8 None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:22:43.205689 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9bb5bd-e63c-40fd-9ece-dd9d89dd7430 None admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:22:43.240797 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7613faed-36b8-418d-a6ee-022e4976bf73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:22:43.241393 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7613faed-36b8-418d-a6ee-022e4976bf73 None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:43.241673 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7613faed-36b8-418d-a6ee-022e4976bf73 None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:43.241944 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7613faed-36b8-418d-a6ee-022e4976bf73 None admin] PATH_INFO: `/v3/services` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:43.242658 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7613faed-36b8-418d-a6ee-022e4976bf73 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=79879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:22:43.242959 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7613faed-36b8-418d-a6ee-022e4976bf73 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:22:43.244383 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7613faed-36b8-418d-a6ee-022e4976bf73 None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:22:43.249362 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 364/715] 10.222.0.23 () {56 vars in 1124 bytes} [Tue May 10 05:22:43 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:22:43.256592 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7613faed-36b8-418d-a6ee-022e4976bf73 None admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:22:43.268571 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15b8c97-e242-46e1-9578-5468215d68e8 None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:22:43.306483 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3244401c-155e-4754-be07-a99c2999baf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:22:43.307316 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3244401c-155e-4754-be07-a99c2999baf1 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:43.307633 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3244401c-155e-4754-be07-a99c2999baf1 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:43.307913 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3244401c-155e-4754-be07-a99c2999baf1 None admin] PATH_INFO: `/v3/services/network` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:43.308640 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3244401c-155e-4754-be07-a99c2999baf1 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:22:43.310028 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3244401c-155e-4754-be07-a99c2999baf1 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:22:43.326586 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application [None req-3244401c-155e-4754-be07-a99c2999baf1 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 10 05:22:43.326586 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 05:22:43.326586 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 10 05:22:43.326586 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 10 05:22:43.326586 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 10 05:22:43.326586 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 10 05:22:43.326586 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 10 05:22:43.326586 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 05:22:43.326586 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 10 05:22:43.326586 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application May 10 05:22:43.326586 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 05:22:43.326586 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application May 10 05:22:43.326586 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 05:22:43.326586 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 05:22:43.326586 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 05:22:43.326586 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 05:22:43.326586 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 05:22:43.327696 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 05:22:43.327696 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 05:22:43.327696 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 05:22:43.327696 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 05:22:43.327696 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 05:22:43.327696 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 05:22:43.327696 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 10 05:22:43.327696 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_service(service_id) May 10 05:22:43.327696 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 10 05:22:43.327696 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 10 05:22:43.327696 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 05:22:43.327696 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 05:22:43.327696 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 05:22:43.327696 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 05:22:43.327696 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 05:22:43.327696 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.get_or_create( May 10 05:22:43.329050 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 05:22:43.329050 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application with Lock( May 10 05:22:43.329050 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 05:22:43.329050 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._enter() May 10 05:22:43.329050 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 05:22:43.329050 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 05:22:43.329050 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 05:22:43.329050 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.creator() May 10 05:22:43.329050 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 05:22:43.329050 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application created_value = creator( May 10 05:22:43.329050 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 10 05:22:43.329050 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 05:22:43.329050 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 10 05:22:43.329050 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application May 10 05:22:43.329050 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 352/716] 10.222.0.23 () {56 vars in 1111 bytes} [Tue May 10 05:22:43 2022] GET /identity/v3/services/network => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 05:22:43.334104 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3244401c-155e-4754-be07-a99c2999baf1 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:22:43.391616 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7613faed-36b8-418d-a6ee-022e4976bf73 None admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:22:43.435916 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96415405-a645-4e7d-910c-939cc968357b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:22:43.436962 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96415405-a645-4e7d-910c-939cc968357b None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:43.437382 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96415405-a645-4e7d-910c-939cc968357b None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:43.437771 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96415405-a645-4e7d-910c-939cc968357b None admin] PATH_INFO: `/v3/services` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:43.438500 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96415405-a645-4e7d-910c-939cc968357b None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=79879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:22:43.438955 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96415405-a645-4e7d-910c-939cc968357b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:22:43.440658 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96415405-a645-4e7d-910c-939cc968357b None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:22:43.448179 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 365/717] 10.222.0.23 () {56 vars in 1124 bytes} [Tue May 10 05:22:43 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:22:43.466725 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3244401c-155e-4754-be07-a99c2999baf1 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:22:43.518293 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc9676f-491d-483a-b1b8-4954060239e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:22:43.518910 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc9676f-491d-483a-b1b8-4954060239e9 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:43.519183 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc9676f-491d-483a-b1b8-4954060239e9 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:43.519452 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc9676f-491d-483a-b1b8-4954060239e9 None admin] PATH_INFO: `/v3/services` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:43.520353 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc9676f-491d-483a-b1b8-4954060239e9 None admin] RBAC: Adding query filter params (name=network) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:22:43.520659 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc9676f-491d-483a-b1b8-4954060239e9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:22:43.522037 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc9676f-491d-483a-b1b8-4954060239e9 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:22:43.526938 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 353/718] 10.222.0.23 () {56 vars in 1112 bytes} [Tue May 10 05:22:43 2022] GET /identity/v3/services?name=network => generated 124 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 05:22:43.532940 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96415405-a645-4e7d-910c-939cc968357b None admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:22:43.678221 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96415405-a645-4e7d-910c-939cc968357b None admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:22:43.712860 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4301ac-0d8a-4e59-a00e-2af8f1538096 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:22:43.713547 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4301ac-0d8a-4e59-a00e-2af8f1538096 None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:43.713818 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4301ac-0d8a-4e59-a00e-2af8f1538096 None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:43.714089 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4301ac-0d8a-4e59-a00e-2af8f1538096 None admin] PATH_INFO: `/v3/services` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:43.714810 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4301ac-0d8a-4e59-a00e-2af8f1538096 None admin] RBAC: Adding query filter params (type=network) {{(pid=79879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:22:43.715116 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4301ac-0d8a-4e59-a00e-2af8f1538096 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:22:43.716537 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4301ac-0d8a-4e59-a00e-2af8f1538096 None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:22:43.721516 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 366/719] 10.222.0.23 () {56 vars in 1112 bytes} [Tue May 10 05:22:43 2022] GET /identity/v3/services?type=network => generated 124 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:22:45.436725 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a0e4f4-58fe-4c28-89e6-fd87b10b28e2 None None] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:45.437298 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a0e4f4-58fe-4c28-89e6-fd87b10b28e2 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:45.437298 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a0e4f4-58fe-4c28-89e6-fd87b10b28e2 None None] PATH_INFO: `/` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:45.440337 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cded99-f049-4bf0-a85e-a65b5ad504fd None None] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:45.440729 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cded99-f049-4bf0-a85e-a65b5ad504fd None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:45.440911 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cded99-f049-4bf0-a85e-a65b5ad504fd None None] PATH_INFO: `/` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:45.442271 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 367/720] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 10 05:22:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 05:22:45.442510 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 354/721] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 10 05:22:45 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 05:22:45.447353 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7691f1ca-e4d7-4fa2-a06f-66f4f9b6d829 None None] REQUEST_METHOD: `POST` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:45.447477 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805a2405-bc8a-45fc-93a5-a33012e4c6d3 None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:45.447670 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805a2405-bc8a-45fc-93a5-a33012e4c6d3 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:45.447770 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7691f1ca-e4d7-4fa2-a06f-66f4f9b6d829 None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:45.447937 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805a2405-bc8a-45fc-93a5-a33012e4c6d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:45.448031 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7691f1ca-e4d7-4fa2-a06f-66f4f9b6d829 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:45.465034 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-805a2405-bc8a-45fc-93a5-a33012e4c6d3 None None] MFA Rules not processed for user `44883b22532e44049d846938dc2cf423`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:22:45.466227 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-805a2405-bc8a-45fc-93a5-a33012e4c6d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:22:45.468872 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.auth.core [None req-7691f1ca-e4d7-4fa2-a06f-66f4f9b6d829 None None] MFA Rules not processed for user `44883b22532e44049d846938dc2cf423`. Rule list: `[]` (Enabled: `True`). {{(pid=79879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:22:45.470025 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-7691f1ca-e4d7-4fa2-a06f-66f4f9b6d829 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:22:45.535190 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 355/722] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 10 05:22:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 05:22:45.559546 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 368/723] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 10 05:22:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 05:22:45.570243 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805a2405-bc8a-45fc-93a5-a33012e4c6d3 None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:22:45.595174 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7691f1ca-e4d7-4fa2-a06f-66f4f9b6d829 None None] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:22:45.705705 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7691f1ca-e4d7-4fa2-a06f-66f4f9b6d829 None None] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:22:45.742658 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcdc17e-8738-4bc4-a4d3-ff1a372a43ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:22:45.743676 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcdc17e-8738-4bc4-a4d3-ff1a372a43ac None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:45.743956 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcdc17e-8738-4bc4-a4d3-ff1a372a43ac None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:45.744369 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcdc17e-8738-4bc4-a4d3-ff1a372a43ac None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:45.755980 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bcdc17e-8738-4bc4-a4d3-ff1a372a43ac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 05:22:45.764402 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application [None req-1bcdc17e-8738-4bc4-a4d3-ff1a372a43ac None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 10 05:22:45.764402 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 05:22:45.764402 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 05:22:45.764402 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 05:22:45.764402 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 05:22:45.764402 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 05:22:45.764402 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 05:22:45.764402 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 05:22:45.764402 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 05:22:45.764402 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 05:22:45.764402 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 05:22:45.764402 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 05:22:45.764402 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 05:22:45.764402 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 05:22:45.764402 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 05:22:45.764402 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 05:22:45.765358 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 05:22:45.765358 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 05:22:45.765358 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 05:22:45.765358 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 05:22:45.765358 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 05:22:45.765358 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 05:22:45.765358 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 05:22:45.765358 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 05:22:45.765358 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 05:22:45.765358 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.get_or_create( May 10 05:22:45.765358 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 05:22:45.765358 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application with Lock( May 10 05:22:45.765358 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 05:22:45.765358 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self._enter() May 10 05:22:45.765358 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 05:22:45.765358 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 05:22:45.766203 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 05:22:45.766203 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.creator() May 10 05:22:45.766203 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 05:22:45.766203 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application created_value = creator( May 10 05:22:45.766203 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 05:22:45.766203 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 05:22:45.766203 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 05:22:45.766203 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 05:22:45.766203 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 05:22:45.766203 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 05:22:45.766203 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 10 05:22:45.766203 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application May 10 05:22:45.767683 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 369/724] 10.222.0.23 () {56 vars in 1096 bytes} [Tue May 10 05:22:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 05:22:45.772289 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcdc17e-8738-4bc4-a4d3-ff1a372a43ac None admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:22:45.781703 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805a2405-bc8a-45fc-93a5-a33012e4c6d3 None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:22:45.841004 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca97ac70-9e33-489c-9f26-fd02753ae54c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:22:45.841819 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca97ac70-9e33-489c-9f26-fd02753ae54c None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:45.842100 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca97ac70-9e33-489c-9f26-fd02753ae54c None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:45.842373 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca97ac70-9e33-489c-9f26-fd02753ae54c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:45.852562 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca97ac70-9e33-489c-9f26-fd02753ae54c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 05:22:45.860176 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application [None req-ca97ac70-9e33-489c-9f26-fd02753ae54c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 10 05:22:45.860176 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 05:22:45.860176 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 05:22:45.860176 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 05:22:45.860176 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 05:22:45.860176 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 05:22:45.860176 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 05:22:45.860176 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 05:22:45.860176 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 05:22:45.860176 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 05:22:45.860176 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 05:22:45.860176 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 05:22:45.860176 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 05:22:45.860176 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 05:22:45.860176 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 05:22:45.860176 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 05:22:45.861144 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 05:22:45.861144 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 05:22:45.861144 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 05:22:45.861144 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 05:22:45.861144 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 05:22:45.861144 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 05:22:45.861144 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 05:22:45.861144 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 05:22:45.861144 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 05:22:45.861144 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.get_or_create( May 10 05:22:45.861144 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 05:22:45.861144 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application with Lock( May 10 05:22:45.861144 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 05:22:45.861144 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._enter() May 10 05:22:45.861144 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 05:22:45.861144 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 05:22:45.862799 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 05:22:45.862799 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.creator() May 10 05:22:45.862799 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 05:22:45.862799 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application created_value = creator( May 10 05:22:45.862799 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 05:22:45.862799 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 05:22:45.862799 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 05:22:45.862799 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 05:22:45.862799 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 05:22:45.862799 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 05:22:45.862799 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 10 05:22:45.862799 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application May 10 05:22:45.862799 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 356/725] 10.222.0.23 () {56 vars in 1096 bytes} [Tue May 10 05:22:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 292 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 05:22:45.864484 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652a1293-e6b5-40ac-b899-747002ccdfe8 None None] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:45.864484 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652a1293-e6b5-40ac-b899-747002ccdfe8 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:45.864484 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652a1293-e6b5-40ac-b899-747002ccdfe8 None None] PATH_INFO: `/` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:45.865895 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 357/726] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 10 05:22:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 05:22:45.870588 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e949bc23-2fc1-4295-bb78-0254666da664 None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:45.871224 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e949bc23-2fc1-4295-bb78-0254666da664 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:45.872806 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e949bc23-2fc1-4295-bb78-0254666da664 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:45.882485 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcdc17e-8738-4bc4-a4d3-ff1a372a43ac None admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:22:45.891484 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-e949bc23-2fc1-4295-bb78-0254666da664 None None] MFA Rules not processed for user `44883b22532e44049d846938dc2cf423`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:22:45.893192 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-e949bc23-2fc1-4295-bb78-0254666da664 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:22:45.921383 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212dc3a6-bf62-4148-9469-0b110a493e0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:22:45.922646 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212dc3a6-bf62-4148-9469-0b110a493e0a None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:45.923203 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212dc3a6-bf62-4148-9469-0b110a493e0a None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:45.923763 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212dc3a6-bf62-4148-9469-0b110a493e0a None admin] PATH_INFO: `/v3/roles` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:45.924755 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212dc3a6-bf62-4148-9469-0b110a493e0a None admin] RBAC: Adding query filter params (name=admin) {{(pid=79879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:22:45.925343 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212dc3a6-bf62-4148-9469-0b110a493e0a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:22:45.927557 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212dc3a6-bf62-4148-9469-0b110a493e0a None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:22:45.938704 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 370/727] 10.222.0.23 () {56 vars in 1099 bytes} [Tue May 10 05:22:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:22:45.939891 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212dc3a6-bf62-4148-9469-0b110a493e0a None admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:22:45.975705 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 358/728] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 10 05:22:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 05:22:45.975705 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e949bc23-2fc1-4295-bb78-0254666da664 None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:22:46.083952 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212dc3a6-bf62-4148-9469-0b110a493e0a None admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:22:46.094147 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e949bc23-2fc1-4295-bb78-0254666da664 None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:22:46.125407 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf8a339-1e58-47d7-9200-7eda6c0b62b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:22:46.126649 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf8a339-1e58-47d7-9200-7eda6c0b62b5 None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:46.127294 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf8a339-1e58-47d7-9200-7eda6c0b62b5 None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:46.128081 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf8a339-1e58-47d7-9200-7eda6c0b62b5 None admin] PATH_INFO: `/v3/roles` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:46.129471 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf8a339-1e58-47d7-9200-7eda6c0b62b5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:22:46.129982 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf8a339-1e58-47d7-9200-7eda6c0b62b5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:22:46.131832 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf8a339-1e58-47d7-9200-7eda6c0b62b5 None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:22:46.132335 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3dc504-55a2-433b-a23a-fa49d53d2520 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:22:46.133145 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3dc504-55a2-433b-a23a-fa49d53d2520 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:46.133422 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3dc504-55a2-433b-a23a-fa49d53d2520 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:46.133689 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3dc504-55a2-433b-a23a-fa49d53d2520 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:46.143508 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 371/729] 10.222.0.23 () {56 vars in 1099 bytes} [Tue May 10 05:22:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:22:46.145096 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf8a339-1e58-47d7-9200-7eda6c0b62b5 None admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:22:46.145208 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3dc504-55a2-433b-a23a-fa49d53d2520 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:22:46.146690 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3dc504-55a2-433b-a23a-fa49d53d2520 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:22:46.168250 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application [None req-4b3dc504-55a2-433b-a23a-fa49d53d2520 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 05:22:46.168250 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 05:22:46.168250 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 05:22:46.168250 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 05:22:46.168250 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 05:22:46.168250 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 05:22:46.168250 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 05:22:46.168250 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 05:22:46.168250 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 05:22:46.168250 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 05:22:46.168250 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 05:22:46.168250 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 05:22:46.168250 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 05:22:46.168250 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 05:22:46.168250 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 05:22:46.169202 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 05:22:46.169202 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 05:22:46.169202 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 05:22:46.169202 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 05:22:46.169202 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 05:22:46.169202 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 05:22:46.169202 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.get_or_create( May 10 05:22:46.169202 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 05:22:46.169202 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application with Lock( May 10 05:22:46.169202 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 05:22:46.169202 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._enter() May 10 05:22:46.169202 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 05:22:46.169202 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 05:22:46.169202 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 05:22:46.169202 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.creator() May 10 05:22:46.169202 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 05:22:46.169202 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application created_value = creator( May 10 05:22:46.170075 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 05:22:46.170075 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 05:22:46.170075 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 05:22:46.170075 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application May 10 05:22:46.172376 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 359/730] 10.222.0.23 () {56 vars in 1108 bytes} [Tue May 10 05:22:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 05:22:46.173390 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3dc504-55a2-433b-a23a-fa49d53d2520 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:22:46.250946 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf8a339-1e58-47d7-9200-7eda6c0b62b5 None admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:22:46.278367 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3dc504-55a2-433b-a23a-fa49d53d2520 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:22:46.286229 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bddf4d-1d75-42a2-b8bb-ce164044c83e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:22:46.287363 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bddf4d-1d75-42a2-b8bb-ce164044c83e None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:46.287858 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bddf4d-1d75-42a2-b8bb-ce164044c83e None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:46.288367 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bddf4d-1d75-42a2-b8bb-ce164044c83e None admin] PATH_INFO: `/v3/roles/service` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:46.299554 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38bddf4d-1d75-42a2-b8bb-ce164044c83e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 05:22:46.307561 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application [None req-38bddf4d-1d75-42a2-b8bb-ce164044c83e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 10 05:22:46.307561 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 05:22:46.307561 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 05:22:46.307561 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 05:22:46.307561 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 05:22:46.307561 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 05:22:46.307561 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 05:22:46.307561 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 05:22:46.307561 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 05:22:46.307561 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 05:22:46.307561 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 05:22:46.307561 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 05:22:46.307561 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 05:22:46.307561 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 05:22:46.307561 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 05:22:46.307561 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 05:22:46.308491 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 05:22:46.308491 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 05:22:46.308491 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 05:22:46.308491 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 05:22:46.308491 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 05:22:46.308491 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 05:22:46.308491 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 05:22:46.308491 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 05:22:46.308491 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 05:22:46.308491 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.get_or_create( May 10 05:22:46.308491 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 05:22:46.308491 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application with Lock( May 10 05:22:46.308491 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 05:22:46.308491 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self._enter() May 10 05:22:46.308491 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 05:22:46.308491 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 05:22:46.309323 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 05:22:46.309323 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.creator() May 10 05:22:46.309323 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 05:22:46.309323 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application created_value = creator( May 10 05:22:46.309323 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 05:22:46.309323 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 05:22:46.309323 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 05:22:46.309323 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 05:22:46.309323 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 05:22:46.309323 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 05:22:46.309323 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 10 05:22:46.309323 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application May 10 05:22:46.309323 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 372/731] 10.222.0.23 () {56 vars in 1102 bytes} [Tue May 10 05:22:46 2022] GET /identity/v3/roles/service => generated 85 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 05:22:46.310016 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bddf4d-1d75-42a2-b8bb-ce164044c83e None admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:22:46.325132 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a363c2e1-7b34-4d8d-b137-dc413c8cb1f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:22:46.325941 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a363c2e1-7b34-4d8d-b137-dc413c8cb1f5 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:46.326217 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a363c2e1-7b34-4d8d-b137-dc413c8cb1f5 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:46.326474 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a363c2e1-7b34-4d8d-b137-dc413c8cb1f5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:46.336900 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a363c2e1-7b34-4d8d-b137-dc413c8cb1f5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:22:46.338338 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a363c2e1-7b34-4d8d-b137-dc413c8cb1f5 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:22:46.355549 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application [None req-a363c2e1-7b34-4d8d-b137-dc413c8cb1f5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 05:22:46.355549 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 05:22:46.355549 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 05:22:46.355549 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 05:22:46.355549 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 05:22:46.355549 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 05:22:46.355549 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 05:22:46.355549 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 05:22:46.355549 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 05:22:46.355549 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 05:22:46.355549 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 05:22:46.355549 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 05:22:46.355549 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 05:22:46.355549 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 05:22:46.355549 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 05:22:46.356680 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 05:22:46.356680 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 05:22:46.356680 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 05:22:46.356680 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 05:22:46.356680 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 05:22:46.356680 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 05:22:46.356680 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.get_or_create( May 10 05:22:46.356680 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 05:22:46.356680 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application with Lock( May 10 05:22:46.356680 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 05:22:46.356680 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._enter() May 10 05:22:46.356680 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 05:22:46.356680 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 05:22:46.356680 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 05:22:46.356680 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.creator() May 10 05:22:46.356680 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 05:22:46.356680 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application created_value = creator( May 10 05:22:46.357610 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 05:22:46.357610 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 05:22:46.357610 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 05:22:46.357610 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application May 10 05:22:46.357610 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 360/732] 10.222.0.23 () {56 vars in 1108 bytes} [Tue May 10 05:22:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 05:22:46.358507 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1d8439-4c34-4953-9df9-1cc876582574 None None] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:46.358795 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1d8439-4c34-4953-9df9-1cc876582574 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:46.359052 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1d8439-4c34-4953-9df9-1cc876582574 None None] PATH_INFO: `/` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:46.363619 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 361/733] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 10 05:22:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 05:22:46.363619 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1d8439-4c34-4953-9df9-1cc876582574 None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:22:46.415394 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bddf4d-1d75-42a2-b8bb-ce164044c83e None admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:22:46.450891 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa8358c-66a9-475b-a141-074e87da7828 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:22:46.451604 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa8358c-66a9-475b-a141-074e87da7828 None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:46.451928 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa8358c-66a9-475b-a141-074e87da7828 None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:46.452157 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa8358c-66a9-475b-a141-074e87da7828 None admin] PATH_INFO: `/v3/domains` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:46.452910 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa8358c-66a9-475b-a141-074e87da7828 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:22:46.453207 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa8358c-66a9-475b-a141-074e87da7828 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:22:46.454624 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa8358c-66a9-475b-a141-074e87da7828 None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:22:46.466772 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1d8439-4c34-4953-9df9-1cc876582574 None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:22:46.471774 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 373/734] 10.222.0.23 () {56 vars in 1109 bytes} [Tue May 10 05:22:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:22:46.471774 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa8358c-66a9-475b-a141-074e87da7828 None admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:22:46.502337 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79667b51-4e8e-4b1b-9edc-5e1865ba8294 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:22:46.502952 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79667b51-4e8e-4b1b-9edc-5e1865ba8294 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:46.503220 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79667b51-4e8e-4b1b-9edc-5e1865ba8294 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:46.503515 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79667b51-4e8e-4b1b-9edc-5e1865ba8294 None admin] PATH_INFO: `/v3/roles` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:46.504317 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79667b51-4e8e-4b1b-9edc-5e1865ba8294 None admin] RBAC: Adding query filter params (name=service) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:22:46.504613 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79667b51-4e8e-4b1b-9edc-5e1865ba8294 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:22:46.505993 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79667b51-4e8e-4b1b-9edc-5e1865ba8294 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:22:46.514544 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 362/735] 10.222.0.23 () {56 vars in 1103 bytes} [Tue May 10 05:22:46 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:22:46.516113 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0620b5-7580-4ccb-b256-8c110262c15c None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:46.516591 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0620b5-7580-4ccb-b256-8c110262c15c None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:46.517027 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0620b5-7580-4ccb-b256-8c110262c15c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:46.534089 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-6b0620b5-7580-4ccb-b256-8c110262c15c None None] MFA Rules not processed for user `44883b22532e44049d846938dc2cf423`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:22:46.535363 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-6b0620b5-7580-4ccb-b256-8c110262c15c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:22:46.573868 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa8358c-66a9-475b-a141-074e87da7828 None admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:22:46.596910 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 363/736] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 10 05:22:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 05:22:46.598049 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0620b5-7580-4ccb-b256-8c110262c15c None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:22:46.621859 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a124bb-1392-4b3d-962e-150c24675c68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:22:46.622535 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a124bb-1392-4b3d-962e-150c24675c68 None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:46.622821 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a124bb-1392-4b3d-962e-150c24675c68 None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:46.623098 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a124bb-1392-4b3d-962e-150c24675c68 None admin] PATH_INFO: `/v3/domains` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:46.623879 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a124bb-1392-4b3d-962e-150c24675c68 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:22:46.624190 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a124bb-1392-4b3d-962e-150c24675c68 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:22:46.625615 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a124bb-1392-4b3d-962e-150c24675c68 None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:22:46.636796 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 374/737] 10.222.0.23 () {56 vars in 1109 bytes} [Tue May 10 05:22:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:22:46.637543 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a124bb-1392-4b3d-962e-150c24675c68 None admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:22:46.695473 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0620b5-7580-4ccb-b256-8c110262c15c None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:22:46.728790 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bd756d-046c-4eee-984c-cb7fc844036b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:22:46.729599 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bd756d-046c-4eee-984c-cb7fc844036b None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:46.729881 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bd756d-046c-4eee-984c-cb7fc844036b None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:46.730149 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bd756d-046c-4eee-984c-cb7fc844036b None admin] PATH_INFO: `/v3/users/swift` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:46.730810 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a124bb-1392-4b3d-962e-150c24675c68 None admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:22:46.737185 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40bd756d-046c-4eee-984c-cb7fc844036b None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:22:46.738649 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40bd756d-046c-4eee-984c-cb7fc844036b None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:22:46.753022 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application [None req-40bd756d-046c-4eee-984c-cb7fc844036b None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 10 05:22:46.753022 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 05:22:46.753022 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 05:22:46.753022 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 05:22:46.753022 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 05:22:46.753022 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 05:22:46.753022 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 05:22:46.753022 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 05:22:46.753022 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 05:22:46.753022 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 05:22:46.753022 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 05:22:46.753022 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 05:22:46.753022 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 05:22:46.753022 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 05:22:46.753022 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 05:22:46.753022 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 05:22:46.754533 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 05:22:46.754533 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 05:22:46.754533 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 05:22:46.754533 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 05:22:46.754533 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 05:22:46.754533 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 05:22:46.754533 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 05:22:46.754533 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 05:22:46.754533 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 05:22:46.754533 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.get_or_create( May 10 05:22:46.754533 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 05:22:46.754533 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application with Lock( May 10 05:22:46.754533 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 05:22:46.754533 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._enter() May 10 05:22:46.754533 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 05:22:46.754533 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 05:22:46.754533 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 05:22:46.754533 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.creator() May 10 05:22:46.756072 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 05:22:46.756072 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application created_value = creator( May 10 05:22:46.756072 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 05:22:46.756072 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 05:22:46.756072 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 05:22:46.756072 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 05:22:46.756072 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 05:22:46.756072 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 05:22:46.756072 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 10 05:22:46.756072 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application May 10 05:22:46.756072 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 364/738] 10.222.0.23 () {56 vars in 1096 bytes} [Tue May 10 05:22:46 2022] GET /identity/v3/users/swift => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 05:22:46.756072 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974bb460-0aac-41aa-b0da-dd2aebbe6da5 None None] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:46.756072 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974bb460-0aac-41aa-b0da-dd2aebbe6da5 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:46.757000 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974bb460-0aac-41aa-b0da-dd2aebbe6da5 None None] PATH_INFO: `/` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:46.757416 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 365/739] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 10 05:22:46 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 05:22:46.757835 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974bb460-0aac-41aa-b0da-dd2aebbe6da5 None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:22:46.770363 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc7578b-7881-4b46-9862-d9898a8aaf11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:22:46.771167 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc7578b-7881-4b46-9862-d9898a8aaf11 None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:46.771458 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc7578b-7881-4b46-9862-d9898a8aaf11 None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:46.771738 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc7578b-7881-4b46-9862-d9898a8aaf11 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:46.782336 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc7578b-7881-4b46-9862-d9898a8aaf11 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:22:46.783835 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc7578b-7881-4b46-9862-d9898a8aaf11 None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:22:46.800415 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application [None req-fcc7578b-7881-4b46-9862-d9898a8aaf11 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 05:22:46.800415 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 05:22:46.800415 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 05:22:46.800415 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 05:22:46.800415 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 05:22:46.800415 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 05:22:46.800415 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 05:22:46.800415 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 05:22:46.800415 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 05:22:46.800415 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 05:22:46.800415 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 05:22:46.800415 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 05:22:46.800415 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 05:22:46.800415 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 05:22:46.800415 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 05:22:46.801368 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 05:22:46.801368 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 05:22:46.801368 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 05:22:46.801368 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 05:22:46.801368 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 05:22:46.801368 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 05:22:46.801368 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.get_or_create( May 10 05:22:46.801368 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 05:22:46.801368 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application with Lock( May 10 05:22:46.801368 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 05:22:46.801368 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self._enter() May 10 05:22:46.801368 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 05:22:46.801368 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 05:22:46.801368 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 05:22:46.801368 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.creator() May 10 05:22:46.801368 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 05:22:46.801368 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application created_value = creator( May 10 05:22:46.802351 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 05:22:46.802351 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 05:22:46.802351 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 05:22:46.802351 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application May 10 05:22:46.802351 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 375/740] 10.222.0.23 () {56 vars in 1108 bytes} [Tue May 10 05:22:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 05:22:46.802649 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc7578b-7881-4b46-9862-d9898a8aaf11 None admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:22:46.856915 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974bb460-0aac-41aa-b0da-dd2aebbe6da5 None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:22:46.890120 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c956bf07-4d32-4d52-8337-1726f896b63f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:22:46.890779 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c956bf07-4d32-4d52-8337-1726f896b63f None admin] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:46.891039 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c956bf07-4d32-4d52-8337-1726f896b63f None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:46.891325 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c956bf07-4d32-4d52-8337-1726f896b63f None admin] PATH_INFO: `/v3/services` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:46.892082 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c956bf07-4d32-4d52-8337-1726f896b63f None admin] RBAC: Authorizing `identity:create_service()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:22:46.893447 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c956bf07-4d32-4d52-8337-1726f896b63f None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:22:46.899552 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc7578b-7881-4b46-9862-d9898a8aaf11 None admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:22:46.908139 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 366/741] 10.222.0.23 () {60 vars in 1141 bytes} [Tue May 10 05:22:46 2022] POST /identity/v3/services => generated 251 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 05:22:46.908940 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c956bf07-4d32-4d52-8337-1726f896b63f None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:22:46.950480 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9931a01-c901-4aa9-86f7-39c623863248 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:22:46.951352 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9931a01-c901-4aa9-86f7-39c623863248 None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:46.951654 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9931a01-c901-4aa9-86f7-39c623863248 None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:46.951930 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9931a01-c901-4aa9-86f7-39c623863248 None admin] PATH_INFO: `/v3/users/nova` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:46.960296 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9931a01-c901-4aa9-86f7-39c623863248 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:22:46.961785 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9931a01-c901-4aa9-86f7-39c623863248 None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:22:46.976942 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application [None req-b9931a01-c901-4aa9-86f7-39c623863248 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 10 05:22:46.976942 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 05:22:46.976942 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 05:22:46.976942 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 05:22:46.976942 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 05:22:46.976942 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 05:22:46.976942 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 05:22:46.976942 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 05:22:46.976942 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 05:22:46.976942 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 05:22:46.976942 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 05:22:46.976942 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 05:22:46.976942 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 05:22:46.976942 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 05:22:46.976942 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 05:22:46.976942 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 05:22:46.978185 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 05:22:46.978185 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 05:22:46.978185 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 05:22:46.978185 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 05:22:46.978185 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 05:22:46.978185 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 05:22:46.978185 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 05:22:46.978185 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 05:22:46.978185 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 05:22:46.978185 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.get_or_create( May 10 05:22:46.978185 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 05:22:46.978185 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application with Lock( May 10 05:22:46.978185 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 05:22:46.978185 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self._enter() May 10 05:22:46.978185 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 05:22:46.978185 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 05:22:46.978185 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 05:22:46.978185 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.creator() May 10 05:22:46.979173 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 05:22:46.979173 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application created_value = creator( May 10 05:22:46.979173 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 05:22:46.979173 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 05:22:46.979173 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 05:22:46.979173 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 05:22:46.979173 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 05:22:46.979173 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 05:22:46.979173 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 10 05:22:46.979173 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application May 10 05:22:46.979173 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 376/742] 10.222.0.23 () {56 vars in 1093 bytes} [Tue May 10 05:22:46 2022] GET /identity/v3/users/nova => generated 82 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 05:22:46.980106 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eadd891-9312-4b25-a5fd-b4fa2fccfa6c None None] REQUEST_METHOD: `POST` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:46.980450 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eadd891-9312-4b25-a5fd-b4fa2fccfa6c None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:46.981002 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eadd891-9312-4b25-a5fd-b4fa2fccfa6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:46.999269 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.auth.core [None req-2eadd891-9312-4b25-a5fd-b4fa2fccfa6c None None] MFA Rules not processed for user `44883b22532e44049d846938dc2cf423`. Rule list: `[]` (Enabled: `True`). {{(pid=79879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:22:47.000537 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-2eadd891-9312-4b25-a5fd-b4fa2fccfa6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:22:47.024374 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c956bf07-4d32-4d52-8337-1726f896b63f None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:22:47.058831 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba028a1f-b91d-4548-82f2-73e51efc997d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:22:47.059520 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba028a1f-b91d-4548-82f2-73e51efc997d None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:47.059828 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba028a1f-b91d-4548-82f2-73e51efc997d None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:47.060104 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba028a1f-b91d-4548-82f2-73e51efc997d None admin] PATH_INFO: `/v3/users` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:47.061009 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba028a1f-b91d-4548-82f2-73e51efc997d None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:22:47.061295 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba028a1f-b91d-4548-82f2-73e51efc997d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:22:47.062802 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba028a1f-b91d-4548-82f2-73e51efc997d None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:22:47.079622 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 377/743] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 10 05:22:46 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 05:22:47.079622 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eadd891-9312-4b25-a5fd-b4fa2fccfa6c None None] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:22:47.096230 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 367/744] 10.222.0.23 () {56 vars in 1135 bytes} [Tue May 10 05:22:46 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:22:47.097100 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba028a1f-b91d-4548-82f2-73e51efc997d None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:22:47.174158 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eadd891-9312-4b25-a5fd-b4fa2fccfa6c None None] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:22:47.199455 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba028a1f-b91d-4548-82f2-73e51efc997d None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:22:47.206752 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb85080-f39f-413a-9bf3-8353e47d767c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:22:47.207483 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb85080-f39f-413a-9bf3-8353e47d767c None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:47.207791 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb85080-f39f-413a-9bf3-8353e47d767c None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:47.208108 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb85080-f39f-413a-9bf3-8353e47d767c None admin] PATH_INFO: `/v3/domains` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:47.208802 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb85080-f39f-413a-9bf3-8353e47d767c None admin] RBAC: Adding query filter params (name=Default) {{(pid=79879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:22:47.209105 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb85080-f39f-413a-9bf3-8353e47d767c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:22:47.210697 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb85080-f39f-413a-9bf3-8353e47d767c None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:22:47.222255 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 378/745] 10.222.0.23 () {56 vars in 1109 bytes} [Tue May 10 05:22:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:22:47.223370 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb85080-f39f-413a-9bf3-8353e47d767c None admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:22:47.235709 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ddb2c9-6f65-4c2f-9098-1f94499aeec9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:22:47.236391 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ddb2c9-6f65-4c2f-9098-1f94499aeec9 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:47.236665 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ddb2c9-6f65-4c2f-9098-1f94499aeec9 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:47.236934 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ddb2c9-6f65-4c2f-9098-1f94499aeec9 None admin] PATH_INFO: `/v3/users` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:47.237777 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ddb2c9-6f65-4c2f-9098-1f94499aeec9 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:22:47.238095 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ddb2c9-6f65-4c2f-9098-1f94499aeec9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:22:47.239608 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ddb2c9-6f65-4c2f-9098-1f94499aeec9 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:22:47.256432 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 368/746] 10.222.0.23 () {56 vars in 1133 bytes} [Tue May 10 05:22:47 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:22:47.257236 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ddb2c9-6f65-4c2f-9098-1f94499aeec9 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:22:47.333591 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb85080-f39f-413a-9bf3-8353e47d767c None admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:22:47.351281 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ddb2c9-6f65-4c2f-9098-1f94499aeec9 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:22:47.365802 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd42f78-da9f-419f-abbe-dd64c17ab79e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:22:47.366497 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd42f78-da9f-419f-abbe-dd64c17ab79e None admin] REQUEST_METHOD: `POST` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:47.366776 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd42f78-da9f-419f-abbe-dd64c17ab79e None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:47.367046 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd42f78-da9f-419f-abbe-dd64c17ab79e None admin] PATH_INFO: `/v3/services` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:47.367804 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd42f78-da9f-419f-abbe-dd64c17ab79e None admin] RBAC: Authorizing `identity:create_service()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:22:47.369194 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd42f78-da9f-419f-abbe-dd64c17ab79e None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:22:47.385263 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff4b516-73ee-4654-b9ed-1ebb9740c2c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:22:47.385916 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff4b516-73ee-4654-b9ed-1ebb9740c2c2 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:47.386199 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff4b516-73ee-4654-b9ed-1ebb9740c2c2 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:47.386538 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff4b516-73ee-4654-b9ed-1ebb9740c2c2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:47.395996 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 379/747] 10.222.0.23 () {60 vars in 1141 bytes} [Tue May 10 05:22:47 2022] POST /identity/v3/services => generated 240 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 05:22:47.396807 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd42f78-da9f-419f-abbe-dd64c17ab79e None admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:22:47.475422 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff4b516-73ee-4654-b9ed-1ebb9740c2c2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:22:47.477019 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff4b516-73ee-4654-b9ed-1ebb9740c2c2 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:22:47.526018 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd42f78-da9f-419f-abbe-dd64c17ab79e None admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:22:47.563147 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ba87be-5fa1-45fd-90db-075c52768526 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:22:47.564452 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ba87be-5fa1-45fd-90db-075c52768526 None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:47.564939 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ba87be-5fa1-45fd-90db-075c52768526 None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:47.565452 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ba87be-5fa1-45fd-90db-075c52768526 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:47.574528 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ba87be-5fa1-45fd-90db-075c52768526 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:22:47.576449 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ba87be-5fa1-45fd-90db-075c52768526 None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:22:47.585448 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 369/748] 10.222.0.23 () {58 vars in 1282 bytes} [Tue May 10 05:22:47 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 05:22:47.586332 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff4b516-73ee-4654-b9ed-1ebb9740c2c2 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:22:47.593091 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application [None req-b1ba87be-5fa1-45fd-90db-075c52768526 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 10 05:22:47.593091 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 05:22:47.593091 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 05:22:47.593091 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 05:22:47.593091 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 05:22:47.593091 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 05:22:47.593091 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 05:22:47.593091 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 05:22:47.593091 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 05:22:47.593091 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 05:22:47.593091 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 05:22:47.593091 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 05:22:47.593091 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 05:22:47.593091 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 05:22:47.593091 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 05:22:47.593091 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 05:22:47.594086 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 05:22:47.594086 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 05:22:47.594086 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 05:22:47.594086 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 05:22:47.594086 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 05:22:47.594086 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 05:22:47.594086 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 05:22:47.594086 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 05:22:47.594086 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 05:22:47.594086 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.get_or_create( May 10 05:22:47.594086 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 05:22:47.594086 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application with Lock( May 10 05:22:47.594086 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 05:22:47.594086 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self._enter() May 10 05:22:47.594086 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 05:22:47.594086 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 05:22:47.594086 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 05:22:47.594086 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.creator() May 10 05:22:47.595052 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 05:22:47.595052 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application created_value = creator( May 10 05:22:47.595052 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 05:22:47.595052 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 05:22:47.595052 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 05:22:47.595052 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 05:22:47.595052 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 05:22:47.595052 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 05:22:47.595052 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 10 05:22:47.595052 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application May 10 05:22:47.597769 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 380/749] 10.222.0.23 () {56 vars in 1117 bytes} [Tue May 10 05:22:47 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 05:22:47.598839 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ba87be-5fa1-45fd-90db-075c52768526 None admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:22:47.703194 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff4b516-73ee-4654-b9ed-1ebb9740c2c2 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:22:47.731275 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ba87be-5fa1-45fd-90db-075c52768526 None admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:22:47.737453 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc91a8a8-bad3-40cc-91cb-955da6c5bcad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:22:47.738708 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc91a8a8-bad3-40cc-91cb-955da6c5bcad None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:47.739189 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc91a8a8-bad3-40cc-91cb-955da6c5bcad None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:47.739698 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc91a8a8-bad3-40cc-91cb-955da6c5bcad None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:47.750797 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc91a8a8-bad3-40cc-91cb-955da6c5bcad None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:22:47.752591 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc91a8a8-bad3-40cc-91cb-955da6c5bcad None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:22:47.766351 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04b1f67-6a99-4e67-95f0-b796bd02849f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:22:47.767211 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04b1f67-6a99-4e67-95f0-b796bd02849f None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:47.767547 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04b1f67-6a99-4e67-95f0-b796bd02849f None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:47.767869 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04b1f67-6a99-4e67-95f0-b796bd02849f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:47.772734 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application [None req-fc91a8a8-bad3-40cc-91cb-955da6c5bcad None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 05:22:47.772734 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 05:22:47.772734 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 05:22:47.772734 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 05:22:47.772734 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 05:22:47.772734 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 05:22:47.772734 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 05:22:47.772734 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 05:22:47.772734 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 05:22:47.772734 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 05:22:47.772734 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 05:22:47.772734 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 05:22:47.772734 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 05:22:47.772734 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 05:22:47.772734 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 05:22:47.773607 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 05:22:47.773607 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 05:22:47.773607 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 05:22:47.773607 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 05:22:47.773607 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 05:22:47.773607 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 05:22:47.773607 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.get_or_create( May 10 05:22:47.773607 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 05:22:47.773607 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application with Lock( May 10 05:22:47.773607 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 05:22:47.773607 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._enter() May 10 05:22:47.773607 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 05:22:47.773607 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 05:22:47.773607 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 05:22:47.773607 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.creator() May 10 05:22:47.773607 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 05:22:47.773607 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application created_value = creator( May 10 05:22:47.774501 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 05:22:47.774501 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 05:22:47.774501 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 05:22:47.774501 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application May 10 05:22:47.776754 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 370/750] 10.222.0.23 () {56 vars in 1108 bytes} [Tue May 10 05:22:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 05:22:47.777769 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc91a8a8-bad3-40cc-91cb-955da6c5bcad None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:22:47.783326 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04b1f67-6a99-4e67-95f0-b796bd02849f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:22:47.784892 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04b1f67-6a99-4e67-95f0-b796bd02849f None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:22:47.802390 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application [None req-c04b1f67-6a99-4e67-95f0-b796bd02849f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 05:22:47.802390 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 05:22:47.802390 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 05:22:47.802390 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 05:22:47.802390 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 05:22:47.802390 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 05:22:47.802390 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 05:22:47.802390 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 05:22:47.802390 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 05:22:47.802390 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 05:22:47.802390 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 05:22:47.802390 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 05:22:47.802390 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 05:22:47.802390 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 05:22:47.802390 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 05:22:47.803312 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 05:22:47.803312 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 05:22:47.803312 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 05:22:47.803312 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 05:22:47.803312 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 05:22:47.803312 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 05:22:47.803312 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.get_or_create( May 10 05:22:47.803312 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 05:22:47.803312 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application with Lock( May 10 05:22:47.803312 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 05:22:47.803312 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self._enter() May 10 05:22:47.803312 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 05:22:47.803312 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 05:22:47.803312 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 05:22:47.803312 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.creator() May 10 05:22:47.803312 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 05:22:47.803312 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application created_value = creator( May 10 05:22:47.804270 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 05:22:47.804270 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 05:22:47.804270 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 05:22:47.804270 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application May 10 05:22:47.807753 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 381/751] 10.222.0.23 () {56 vars in 1108 bytes} [Tue May 10 05:22:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 05:22:47.808575 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04b1f67-6a99-4e67-95f0-b796bd02849f None admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:22:47.880121 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc91a8a8-bad3-40cc-91cb-955da6c5bcad None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:22:47.913558 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa93336-5651-4904-a0cc-0b22783a8181 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:22:47.913778 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04b1f67-6a99-4e67-95f0-b796bd02849f None admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:22:47.914695 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa93336-5651-4904-a0cc-0b22783a8181 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:47.915174 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa93336-5651-4904-a0cc-0b22783a8181 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:47.915672 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa93336-5651-4904-a0cc-0b22783a8181 None admin] PATH_INFO: `/v3/users` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:47.916712 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa93336-5651-4904-a0cc-0b22783a8181 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:22:47.917231 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa93336-5651-4904-a0cc-0b22783a8181 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:22:47.918899 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa93336-5651-4904-a0cc-0b22783a8181 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:22:47.937651 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 371/752] 10.222.0.23 () {56 vars in 1149 bytes} [Tue May 10 05:22:47 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:22:47.938788 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa93336-5651-4904-a0cc-0b22783a8181 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:22:47.946676 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2f3532-bf95-4f80-a30c-b580a7754271 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:22:47.947345 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2f3532-bf95-4f80-a30c-b580a7754271 None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:47.947664 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2f3532-bf95-4f80-a30c-b580a7754271 None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:47.947940 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2f3532-bf95-4f80-a30c-b580a7754271 None admin] PATH_INFO: `/v3/domains` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:47.949079 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2f3532-bf95-4f80-a30c-b580a7754271 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:22:47.949079 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2f3532-bf95-4f80-a30c-b580a7754271 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:22:47.950462 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2f3532-bf95-4f80-a30c-b580a7754271 None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:22:47.962779 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 382/753] 10.222.0.23 () {56 vars in 1109 bytes} [Tue May 10 05:22:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:22:47.963622 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2f3532-bf95-4f80-a30c-b580a7754271 None admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:22:48.043635 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa93336-5651-4904-a0cc-0b22783a8181 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:22:48.081211 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55748561-ce6d-45eb-827f-85766f2b7d79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:22:48.081884 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55748561-ce6d-45eb-827f-85766f2b7d79 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:48.082168 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55748561-ce6d-45eb-827f-85766f2b7d79 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:48.082441 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55748561-ce6d-45eb-827f-85766f2b7d79 None admin] PATH_INFO: `/v3/domains` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:48.083344 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55748561-ce6d-45eb-827f-85766f2b7d79 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:22:48.083679 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55748561-ce6d-45eb-827f-85766f2b7d79 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:22:48.085053 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55748561-ce6d-45eb-827f-85766f2b7d79 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:22:48.088491 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2f3532-bf95-4f80-a30c-b580a7754271 None admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:22:48.097453 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 372/754] 10.222.0.23 () {56 vars in 1109 bytes} [Tue May 10 05:22:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:22:48.099639 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55748561-ce6d-45eb-827f-85766f2b7d79 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:22:48.124801 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fac7870-b103-4ec2-bb6f-86a0a9091448 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:22:48.125602 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fac7870-b103-4ec2-bb6f-86a0a9091448 None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:48.126005 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fac7870-b103-4ec2-bb6f-86a0a9091448 None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:48.126804 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fac7870-b103-4ec2-bb6f-86a0a9091448 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:48.206947 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55748561-ce6d-45eb-827f-85766f2b7d79 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:22:48.208921 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fac7870-b103-4ec2-bb6f-86a0a9091448 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:22:48.211160 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fac7870-b103-4ec2-bb6f-86a0a9091448 None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:22:48.248161 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573432dd-5952-48bb-87ee-9bd9dfb4b18d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:22:48.249007 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573432dd-5952-48bb-87ee-9bd9dfb4b18d None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:48.249279 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573432dd-5952-48bb-87ee-9bd9dfb4b18d None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:48.249547 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573432dd-5952-48bb-87ee-9bd9dfb4b18d None admin] PATH_INFO: `/v3/projects/service` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:48.258708 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573432dd-5952-48bb-87ee-9bd9dfb4b18d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:22:48.260617 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573432dd-5952-48bb-87ee-9bd9dfb4b18d None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:22:48.277995 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application [None req-573432dd-5952-48bb-87ee-9bd9dfb4b18d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 05:22:48.277995 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 05:22:48.277995 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 05:22:48.277995 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 05:22:48.277995 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 05:22:48.277995 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 05:22:48.277995 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 05:22:48.277995 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 05:22:48.277995 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 05:22:48.277995 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 05:22:48.277995 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 05:22:48.277995 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 05:22:48.277995 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 05:22:48.277995 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 05:22:48.277995 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 05:22:48.278937 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 05:22:48.278937 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 05:22:48.278937 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 05:22:48.278937 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 05:22:48.278937 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 05:22:48.278937 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 05:22:48.278937 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.get_or_create( May 10 05:22:48.278937 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 05:22:48.278937 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application with Lock( May 10 05:22:48.278937 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 05:22:48.278937 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._enter() May 10 05:22:48.278937 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 05:22:48.278937 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 05:22:48.278937 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 05:22:48.278937 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.creator() May 10 05:22:48.278937 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 05:22:48.278937 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application created_value = creator( May 10 05:22:48.279849 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 05:22:48.279849 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 05:22:48.279849 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 05:22:48.279849 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 05:22:48.279849 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 05:22:48.279849 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 05:22:48.279849 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 05:22:48.279849 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application May 10 05:22:48.279849 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 373/755] 10.222.0.23 () {56 vars in 1111 bytes} [Tue May 10 05:22:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 05:22:48.280344 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573432dd-5952-48bb-87ee-9bd9dfb4b18d None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:22:48.314810 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 383/756] 10.222.0.23 () {58 vars in 1282 bytes} [Tue May 10 05:22:47 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 10 05:22:48.315722 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fac7870-b103-4ec2-bb6f-86a0a9091448 None admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:22:48.387153 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573432dd-5952-48bb-87ee-9bd9dfb4b18d None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:22:48.420147 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83be4a1-4bba-4704-8d2f-c571549cb740 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:22:48.420895 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83be4a1-4bba-4704-8d2f-c571549cb740 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:48.421170 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83be4a1-4bba-4704-8d2f-c571549cb740 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:48.421438 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83be4a1-4bba-4704-8d2f-c571549cb740 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:48.428074 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83be4a1-4bba-4704-8d2f-c571549cb740 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:22:48.429504 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83be4a1-4bba-4704-8d2f-c571549cb740 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:22:48.432613 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fac7870-b103-4ec2-bb6f-86a0a9091448 None admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:22:48.445004 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application [None req-d83be4a1-4bba-4704-8d2f-c571549cb740 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 05:22:48.445004 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 05:22:48.445004 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 05:22:48.445004 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 05:22:48.445004 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 05:22:48.445004 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 05:22:48.445004 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 05:22:48.445004 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 05:22:48.445004 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 05:22:48.445004 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 05:22:48.445004 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 05:22:48.445004 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 05:22:48.445004 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 05:22:48.445004 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 05:22:48.445004 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 05:22:48.445884 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 05:22:48.445884 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 05:22:48.445884 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 05:22:48.445884 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 05:22:48.445884 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 05:22:48.445884 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 05:22:48.445884 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.get_or_create( May 10 05:22:48.445884 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 05:22:48.445884 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application with Lock( May 10 05:22:48.445884 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 05:22:48.445884 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._enter() May 10 05:22:48.445884 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 05:22:48.445884 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 05:22:48.445884 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 05:22:48.445884 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.creator() May 10 05:22:48.445884 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 05:22:48.445884 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application created_value = creator( May 10 05:22:48.446782 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 05:22:48.446782 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 05:22:48.446782 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 05:22:48.446782 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 05:22:48.446782 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 05:22:48.446782 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 05:22:48.446782 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 05:22:48.446782 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application May 10 05:22:48.449521 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 374/757] 10.222.0.23 () {56 vars in 1111 bytes} [Tue May 10 05:22:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 05:22:48.450610 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83be4a1-4bba-4704-8d2f-c571549cb740 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:22:48.472267 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0ca886-9a9d-4560-bad1-f40d10486717 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:22:48.473113 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0ca886-9a9d-4560-bad1-f40d10486717 None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:48.473495 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0ca886-9a9d-4560-bad1-f40d10486717 None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:48.473865 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0ca886-9a9d-4560-bad1-f40d10486717 None admin] PATH_INFO: `/v3/projects` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:48.474742 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0ca886-9a9d-4560-bad1-f40d10486717 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:22:48.475149 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0ca886-9a9d-4560-bad1-f40d10486717 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:22:48.476738 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0ca886-9a9d-4560-bad1-f40d10486717 None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:22:48.489505 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 384/758] 10.222.0.23 () {56 vars in 1148 bytes} [Tue May 10 05:22:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:22:48.490364 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0ca886-9a9d-4560-bad1-f40d10486717 None admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:22:48.557331 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83be4a1-4bba-4704-8d2f-c571549cb740 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:22:48.587352 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0ca886-9a9d-4560-bad1-f40d10486717 None admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:22:48.591650 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81868047-f48f-497d-becd-d4822212b64b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:22:48.592709 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81868047-f48f-497d-becd-d4822212b64b None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:48.593203 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81868047-f48f-497d-becd-d4822212b64b None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:48.593665 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81868047-f48f-497d-becd-d4822212b64b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:48.604590 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81868047-f48f-497d-becd-d4822212b64b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:22:48.606314 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81868047-f48f-497d-becd-d4822212b64b None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:22:48.620466 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c93968-380c-4e13-bcda-2d3e4d49ba2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:22:48.621497 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c93968-380c-4e13-bcda-2d3e4d49ba2d None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:48.621775 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c93968-380c-4e13-bcda-2d3e4d49ba2d None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:48.622045 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c93968-380c-4e13-bcda-2d3e4d49ba2d None admin] PATH_INFO: `/v3/projects` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:48.622837 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c93968-380c-4e13-bcda-2d3e4d49ba2d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:22:48.623149 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c93968-380c-4e13-bcda-2d3e4d49ba2d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:22:48.624681 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c93968-380c-4e13-bcda-2d3e4d49ba2d None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:22:48.625399 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application [None req-81868047-f48f-497d-becd-d4822212b64b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 05:22:48.625399 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 05:22:48.625399 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 05:22:48.625399 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 05:22:48.625399 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 05:22:48.625399 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 05:22:48.625399 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 05:22:48.625399 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 05:22:48.625399 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 05:22:48.625399 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 05:22:48.625399 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 05:22:48.625399 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 05:22:48.625399 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 05:22:48.625399 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 05:22:48.625399 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 05:22:48.626288 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 05:22:48.626288 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 05:22:48.626288 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 05:22:48.626288 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 05:22:48.626288 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 05:22:48.626288 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 05:22:48.626288 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.get_or_create( May 10 05:22:48.626288 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 05:22:48.626288 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application with Lock( May 10 05:22:48.626288 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 05:22:48.626288 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._enter() May 10 05:22:48.626288 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 05:22:48.626288 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 05:22:48.626288 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 05:22:48.626288 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.creator() May 10 05:22:48.626288 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 05:22:48.626288 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application created_value = creator( May 10 05:22:48.627207 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 05:22:48.627207 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 05:22:48.627207 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 05:22:48.627207 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application May 10 05:22:48.629513 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 375/759] 10.222.0.23 () {56 vars in 1108 bytes} [Tue May 10 05:22:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 05:22:48.630621 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81868047-f48f-497d-becd-d4822212b64b None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:22:48.638440 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 385/760] 10.222.0.23 () {56 vars in 1148 bytes} [Tue May 10 05:22:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:22:48.639444 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c93968-380c-4e13-bcda-2d3e4d49ba2d None admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:22:48.730209 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81868047-f48f-497d-becd-d4822212b64b None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:22:48.745446 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c93968-380c-4e13-bcda-2d3e4d49ba2d None admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:22:48.767679 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944aff48-a877-4c46-9273-52c65c12bafc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:22:48.768724 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944aff48-a877-4c46-9273-52c65c12bafc None admin] REQUEST_METHOD: `PUT` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:48.769519 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944aff48-a877-4c46-9273-52c65c12bafc None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:48.769889 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944aff48-a877-4c46-9273-52c65c12bafc None admin] PATH_INFO: `/v3/projects/5f23435f783540199d6dcfd0417c090e/users/7f50f224ca944983aecfde86375473da/roles/199ac1dd842441d7913c6ee89d8fbecc` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:48.772353 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944aff48-a877-4c46-9273-52c65c12bafc None admin] RBAC: Authorizing `identity:create_grant(project_id=5f23435f783540199d6dcfd0417c090e, user_id=7f50f224ca944983aecfde86375473da, role_id=199ac1dd842441d7913c6ee89d8fbecc)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:22:48.774455 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944aff48-a877-4c46-9273-52c65c12bafc None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:22:48.784064 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb34364-039d-4c51-a92f-eb28676f5609 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:22:48.785075 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb34364-039d-4c51-a92f-eb28676f5609 None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:48.785832 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb34364-039d-4c51-a92f-eb28676f5609 None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:48.786363 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb34364-039d-4c51-a92f-eb28676f5609 None admin] PATH_INFO: `/v3/domains` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:48.787346 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb34364-039d-4c51-a92f-eb28676f5609 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:22:48.788013 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb34364-039d-4c51-a92f-eb28676f5609 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:22:48.789722 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb34364-039d-4c51-a92f-eb28676f5609 None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:22:48.792069 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 376/761] 10.222.0.23 () {58 vars in 1439 bytes} [Tue May 10 05:22:48 2022] PUT /identity/v3/projects/5f23435f783540199d6dcfd0417c090e/users/7f50f224ca944983aecfde86375473da/roles/199ac1dd842441d7913c6ee89d8fbecc => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 05:22:48.793526 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944aff48-a877-4c46-9273-52c65c12bafc None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:22:48.808270 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 386/762] 10.222.0.23 () {56 vars in 1109 bytes} [Tue May 10 05:22:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:22:48.809724 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb34364-039d-4c51-a92f-eb28676f5609 None admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:22:48.931074 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb34364-039d-4c51-a92f-eb28676f5609 None admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:22:48.973834 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c9bd92-31e3-4a02-9593-2616aa9308a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:22:48.975006 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c9bd92-31e3-4a02-9593-2616aa9308a2 None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:48.975287 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c9bd92-31e3-4a02-9593-2616aa9308a2 None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:48.975562 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c9bd92-31e3-4a02-9593-2616aa9308a2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:48.984931 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c9bd92-31e3-4a02-9593-2616aa9308a2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:22:48.986949 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c9bd92-31e3-4a02-9593-2616aa9308a2 None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:22:49.005580 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application [None req-e3c9bd92-31e3-4a02-9593-2616aa9308a2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 05:22:49.005580 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 05:22:49.005580 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 05:22:49.005580 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 05:22:49.005580 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 05:22:49.005580 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 05:22:49.005580 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 05:22:49.005580 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 05:22:49.005580 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 05:22:49.005580 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 05:22:49.005580 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 05:22:49.005580 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 05:22:49.005580 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 05:22:49.005580 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 05:22:49.005580 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 05:22:49.006582 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 05:22:49.006582 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 05:22:49.006582 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 05:22:49.006582 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 05:22:49.006582 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 05:22:49.006582 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 05:22:49.006582 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.get_or_create( May 10 05:22:49.006582 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 05:22:49.006582 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application with Lock( May 10 05:22:49.006582 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 05:22:49.006582 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self._enter() May 10 05:22:49.006582 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 05:22:49.006582 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 05:22:49.006582 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 05:22:49.006582 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.creator() May 10 05:22:49.006582 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 05:22:49.006582 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application created_value = creator( May 10 05:22:49.007624 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 05:22:49.007624 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 05:22:49.007624 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 05:22:49.007624 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 05:22:49.007624 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 05:22:49.007624 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 05:22:49.007624 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 05:22:49.007624 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application May 10 05:22:49.007624 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 387/763] 10.222.0.23 () {56 vars in 1111 bytes} [Tue May 10 05:22:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 05:22:49.014279 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c9bd92-31e3-4a02-9593-2616aa9308a2 None admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:22:49.091029 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944aff48-a877-4c46-9273-52c65c12bafc None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:22:49.135612 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75f77b0-8cb5-43f3-812d-6662d7b96e71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:22:49.136492 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75f77b0-8cb5-43f3-812d-6662d7b96e71 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:49.136768 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75f77b0-8cb5-43f3-812d-6662d7b96e71 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:49.138006 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75f77b0-8cb5-43f3-812d-6662d7b96e71 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:49.138858 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75f77b0-8cb5-43f3-812d-6662d7b96e71 None admin] RBAC: Adding query filter params (role.id=199ac1dd842441d7913c6ee89d8fbecc, scope.project.id=5f23435f783540199d6dcfd0417c090e, user.id=fd31dacf30804395bd029037b407c12a) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:22:49.139167 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75f77b0-8cb5-43f3-812d-6662d7b96e71 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:22:49.140715 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75f77b0-8cb5-43f3-812d-6662d7b96e71 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:22:49.149531 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 377/764] 10.222.0.23 () {56 vars in 1374 bytes} [Tue May 10 05:22:48 2022] GET /identity/v3/role_assignments?user.id=fd31dacf30804395bd029037b407c12a&scope.project.id=5f23435f783540199d6dcfd0417c090e&role.id=199ac1dd842441d7913c6ee89d8fbecc => generated 259 bytes in 357 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:22:49.170805 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c9bd92-31e3-4a02-9593-2616aa9308a2 None admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:22:49.206583 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf6ccd0-f2c5-4fe4-ba8b-efdd46175683 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:22:49.207347 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf6ccd0-f2c5-4fe4-ba8b-efdd46175683 None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:49.207657 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf6ccd0-f2c5-4fe4-ba8b-efdd46175683 None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:49.207929 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf6ccd0-f2c5-4fe4-ba8b-efdd46175683 None admin] PATH_INFO: `/v3/projects` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:49.208751 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf6ccd0-f2c5-4fe4-ba8b-efdd46175683 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:22:49.209061 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf6ccd0-f2c5-4fe4-ba8b-efdd46175683 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:22:49.210547 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf6ccd0-f2c5-4fe4-ba8b-efdd46175683 None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:22:49.223349 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 388/765] 10.222.0.23 () {56 vars in 1148 bytes} [Tue May 10 05:22:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:22:49.229046 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75f77b0-8cb5-43f3-812d-6662d7b96e71 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:22:49.258649 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad5f301-96e9-4cd0-bd97-22d1c813c6b4 None None] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:49.258846 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad5f301-96e9-4cd0-bd97-22d1c813c6b4 None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:49.259123 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad5f301-96e9-4cd0-bd97-22d1c813c6b4 None None] PATH_INFO: `/` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:49.260947 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 389/766] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 10 05:22:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 05:22:49.266768 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3a6312-0ce1-4370-9374-ad03e54b3e8c None None] REQUEST_METHOD: `POST` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:49.267062 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3a6312-0ce1-4370-9374-ad03e54b3e8c None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:49.267337 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3a6312-0ce1-4370-9374-ad03e54b3e8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:49.285239 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.auth.core [None req-8b3a6312-0ce1-4370-9374-ad03e54b3e8c None None] MFA Rules not processed for user `44883b22532e44049d846938dc2cf423`. Rule list: `[]` (Enabled: `True`). {{(pid=79879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:22:49.286561 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-8b3a6312-0ce1-4370-9374-ad03e54b3e8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:22:49.359314 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 390/767] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 10 05:22:49 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 10 05:22:49.382352 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3a6312-0ce1-4370-9374-ad03e54b3e8c None None] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:22:49.415942 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75f77b0-8cb5-43f3-812d-6662d7b96e71 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:22:49.452046 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6604918f-bb87-4b02-81c8-11eeaa848706 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:22:49.452707 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6604918f-bb87-4b02-81c8-11eeaa848706 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:49.452988 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6604918f-bb87-4b02-81c8-11eeaa848706 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:49.453269 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6604918f-bb87-4b02-81c8-11eeaa848706 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:49.454098 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6604918f-bb87-4b02-81c8-11eeaa848706 None admin] RBAC: Adding query filter params (role.id=8a02b9040d1d4fccababc1eb4dac80e7, scope.project.id=5f23435f783540199d6dcfd0417c090e, user.id=c5281b2a1c9a461995653be826207db4) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:22:49.454418 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6604918f-bb87-4b02-81c8-11eeaa848706 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:22:49.455929 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6604918f-bb87-4b02-81c8-11eeaa848706 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:22:49.461992 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 378/768] 10.222.0.23 () {56 vars in 1374 bytes} [Tue May 10 05:22:49 2022] GET /identity/v3/role_assignments?user.id=c5281b2a1c9a461995653be826207db4&scope.project.id=5f23435f783540199d6dcfd0417c090e&role.id=8a02b9040d1d4fccababc1eb4dac80e7 => generated 259 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:22:49.485645 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3a6312-0ce1-4370-9374-ad03e54b3e8c None None] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:22:49.523373 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a562553-2d81-4824-a43a-d11b1ef8458f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:22:49.524131 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a562553-2d81-4824-a43a-d11b1ef8458f None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:49.524410 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a562553-2d81-4824-a43a-d11b1ef8458f None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:49.524678 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a562553-2d81-4824-a43a-d11b1ef8458f None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:49.525352 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a562553-2d81-4824-a43a-d11b1ef8458f None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:22:49.526731 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a562553-2d81-4824-a43a-d11b1ef8458f None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:22:49.538929 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application [None req-9a562553-2d81-4824-a43a-d11b1ef8458f None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 10 05:22:49.538929 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 05:22:49.538929 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 10 05:22:49.538929 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 10 05:22:49.538929 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 10 05:22:49.538929 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 10 05:22:49.538929 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 10 05:22:49.538929 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 05:22:49.538929 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 10 05:22:49.538929 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application May 10 05:22:49.538929 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 05:22:49.538929 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application May 10 05:22:49.538929 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 05:22:49.538929 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 05:22:49.538929 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 05:22:49.538929 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 05:22:49.540010 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 05:22:49.540010 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 05:22:49.540010 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 05:22:49.540010 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 05:22:49.540010 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 05:22:49.540010 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 05:22:49.540010 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 05:22:49.540010 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 10 05:22:49.540010 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self._get_service(service_id) May 10 05:22:49.540010 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 10 05:22:49.540010 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 10 05:22:49.540010 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 05:22:49.540010 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 05:22:49.540010 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 05:22:49.540010 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 05:22:49.540010 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 05:22:49.540853 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.get_or_create( May 10 05:22:49.540853 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 05:22:49.540853 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application with Lock( May 10 05:22:49.540853 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 05:22:49.540853 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self._enter() May 10 05:22:49.540853 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 05:22:49.540853 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 05:22:49.540853 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 05:22:49.540853 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.creator() May 10 05:22:49.540853 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 05:22:49.540853 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application created_value = creator( May 10 05:22:49.540853 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 10 05:22:49.540853 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 05:22:49.540853 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 10 05:22:49.540853 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application May 10 05:22:49.540853 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 391/769] 10.222.0.23 () {56 vars in 1129 bytes} [Tue May 10 05:22:49 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 05:22:49.546450 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6604918f-bb87-4b02-81c8-11eeaa848706 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:22:49.666173 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6604918f-bb87-4b02-81c8-11eeaa848706 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:22:49.705251 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c642bc-c0dd-488b-be33-87478d831876 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:22:49.705950 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c642bc-c0dd-488b-be33-87478d831876 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:49.706226 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c642bc-c0dd-488b-be33-87478d831876 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:49.706496 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c642bc-c0dd-488b-be33-87478d831876 None admin] PATH_INFO: `/v3/services` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:49.707275 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c642bc-c0dd-488b-be33-87478d831876 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:22:49.707598 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c642bc-c0dd-488b-be33-87478d831876 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:22:49.709025 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c642bc-c0dd-488b-be33-87478d831876 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:22:49.714190 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 379/770] 10.222.0.23 () {56 vars in 1124 bytes} [Tue May 10 05:22:49 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:22:49.719599 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a562553-2d81-4824-a43a-d11b1ef8458f None admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:22:49.849729 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a562553-2d81-4824-a43a-d11b1ef8458f None admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:22:49.891059 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044aa67b-a132-4574-92a6-deb5a8ec3a80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:22:49.891777 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044aa67b-a132-4574-92a6-deb5a8ec3a80 None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:49.892061 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044aa67b-a132-4574-92a6-deb5a8ec3a80 None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:49.892336 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044aa67b-a132-4574-92a6-deb5a8ec3a80 None admin] PATH_INFO: `/v3/services` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:49.893071 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044aa67b-a132-4574-92a6-deb5a8ec3a80 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=79879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:22:49.893368 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044aa67b-a132-4574-92a6-deb5a8ec3a80 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:22:49.894822 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044aa67b-a132-4574-92a6-deb5a8ec3a80 None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:22:49.900494 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 392/771] 10.222.0.23 () {56 vars in 1124 bytes} [Tue May 10 05:22:49 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:22:49.906348 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c642bc-c0dd-488b-be33-87478d831876 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:22:50.076843 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c642bc-c0dd-488b-be33-87478d831876 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:22:50.085237 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0300feb7-2dd5-44c7-9292-175563789808 None None] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:50.085535 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0300feb7-2dd5-44c7-9292-175563789808 None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:50.085793 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0300feb7-2dd5-44c7-9292-175563789808 None None] PATH_INFO: `/` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:50.088392 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 393/772] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 10 05:22:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 05:22:50.093438 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae813196-4e90-45dc-88e2-a33656cb6143 None None] REQUEST_METHOD: `POST` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:50.093723 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae813196-4e90-45dc-88e2-a33656cb6143 None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:50.094001 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae813196-4e90-45dc-88e2-a33656cb6143 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:50.112037 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.auth.core [None req-ae813196-4e90-45dc-88e2-a33656cb6143 None None] MFA Rules not processed for user `44883b22532e44049d846938dc2cf423`. Rule list: `[]` (Enabled: `True`). {{(pid=79879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:22:50.113891 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-ae813196-4e90-45dc-88e2-a33656cb6143 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:22:50.156869 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1142121d-2816-4bb2-b56f-0822d7a0bff0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:22:50.157550 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1142121d-2816-4bb2-b56f-0822d7a0bff0 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:50.157825 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1142121d-2816-4bb2-b56f-0822d7a0bff0 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:50.158095 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1142121d-2816-4bb2-b56f-0822d7a0bff0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:50.158898 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1142121d-2816-4bb2-b56f-0822d7a0bff0 None admin] RBAC: Adding query filter params (interface=public, service_id=4d6e9d11f1d548f6b36be13fc1cfbf41, region_id=RegionOne) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:22:50.159203 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1142121d-2816-4bb2-b56f-0822d7a0bff0 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:22:50.160643 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1142121d-2816-4bb2-b56f-0822d7a0bff0 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:22:50.183764 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 380/773] 10.222.0.23 () {56 vars in 1251 bytes} [Tue May 10 05:22:49 2022] GET /identity/v3/endpoints?service_id=4d6e9d11f1d548f6b36be13fc1cfbf41&interface=public®ion_id=RegionOne => generated 194 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:22:50.188848 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1142121d-2816-4bb2-b56f-0822d7a0bff0 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:22:50.210260 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 394/774] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 10 05:22:50 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 10 05:22:50.234150 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae813196-4e90-45dc-88e2-a33656cb6143 None None] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:22:50.345332 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae813196-4e90-45dc-88e2-a33656cb6143 None None] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:22:50.393947 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c0cbd4-8e06-4242-8de3-45ad213cc51f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:22:50.394710 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c0cbd4-8e06-4242-8de3-45ad213cc51f None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:50.394987 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c0cbd4-8e06-4242-8de3-45ad213cc51f None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:50.395257 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c0cbd4-8e06-4242-8de3-45ad213cc51f None admin] PATH_INFO: `/v3/services/network` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:50.395944 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c0cbd4-8e06-4242-8de3-45ad213cc51f None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:22:50.397332 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c0cbd4-8e06-4242-8de3-45ad213cc51f None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:22:50.398001 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1142121d-2816-4bb2-b56f-0822d7a0bff0 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:22:50.429108 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application [None req-71c0cbd4-8e06-4242-8de3-45ad213cc51f None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 10 05:22:50.429108 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 05:22:50.429108 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 10 05:22:50.429108 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 10 05:22:50.429108 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 10 05:22:50.429108 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 10 05:22:50.429108 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 10 05:22:50.429108 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 05:22:50.429108 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 10 05:22:50.429108 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application May 10 05:22:50.429108 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 05:22:50.429108 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application May 10 05:22:50.429108 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 05:22:50.429108 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 05:22:50.429108 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 05:22:50.429108 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 05:22:50.429108 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 05:22:50.430147 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 05:22:50.430147 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 05:22:50.430147 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 05:22:50.430147 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 05:22:50.430147 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 05:22:50.430147 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 05:22:50.430147 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 10 05:22:50.430147 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self._get_service(service_id) May 10 05:22:50.430147 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 10 05:22:50.430147 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 10 05:22:50.430147 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 05:22:50.430147 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 05:22:50.430147 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 05:22:50.430147 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 05:22:50.430147 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 05:22:50.430147 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.get_or_create( May 10 05:22:50.430984 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 05:22:50.430984 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application with Lock( May 10 05:22:50.430984 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 05:22:50.430984 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self._enter() May 10 05:22:50.430984 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 05:22:50.430984 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 05:22:50.430984 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 05:22:50.430984 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.creator() May 10 05:22:50.430984 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 05:22:50.430984 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application created_value = creator( May 10 05:22:50.430984 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 10 05:22:50.430984 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 05:22:50.430984 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 10 05:22:50.430984 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application May 10 05:22:50.430984 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 395/775] 10.222.0.23 () {56 vars in 1111 bytes} [Tue May 10 05:22:50 2022] GET /identity/v3/services/network => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 05:22:50.436796 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c0cbd4-8e06-4242-8de3-45ad213cc51f None admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:22:50.438593 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59996598-67d3-4644-a9b3-c7e26ed485a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:22:50.439322 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59996598-67d3-4644-a9b3-c7e26ed485a9 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:50.439828 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59996598-67d3-4644-a9b3-c7e26ed485a9 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:50.440151 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59996598-67d3-4644-a9b3-c7e26ed485a9 None admin] PATH_INFO: `/v3/services` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:50.441921 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59996598-67d3-4644-a9b3-c7e26ed485a9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:22:50.443669 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59996598-67d3-4644-a9b3-c7e26ed485a9 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:22:50.449953 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 381/776] 10.222.0.23 () {56 vars in 1087 bytes} [Tue May 10 05:22:50 2022] GET /identity/v3/services => generated 772 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 05:22:50.605434 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c0cbd4-8e06-4242-8de3-45ad213cc51f None admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:22:50.640142 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a31a8bf-44ca-44f7-a9de-ce02838168f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:22:50.640836 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a31a8bf-44ca-44f7-a9de-ce02838168f5 None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:50.641111 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a31a8bf-44ca-44f7-a9de-ce02838168f5 None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:50.641384 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a31a8bf-44ca-44f7-a9de-ce02838168f5 None admin] PATH_INFO: `/v3/services` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:50.642125 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a31a8bf-44ca-44f7-a9de-ce02838168f5 None admin] RBAC: Adding query filter params (name=network) {{(pid=79879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:22:50.642432 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a31a8bf-44ca-44f7-a9de-ce02838168f5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:22:50.644299 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a31a8bf-44ca-44f7-a9de-ce02838168f5 None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:22:50.649832 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 396/777] 10.222.0.23 () {56 vars in 1112 bytes} [Tue May 10 05:22:50 2022] GET /identity/v3/services?name=network => generated 124 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:22:50.655433 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59996598-67d3-4644-a9b3-c7e26ed485a9 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:22:50.755975 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59996598-67d3-4644-a9b3-c7e26ed485a9 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:22:50.789781 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bfc5f9-5745-4d49-b5d1-3881529501c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:22:50.790462 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bfc5f9-5745-4d49-b5d1-3881529501c2 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:50.790741 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bfc5f9-5745-4d49-b5d1-3881529501c2 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:50.791015 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bfc5f9-5745-4d49-b5d1-3881529501c2 None admin] PATH_INFO: `/v3/services` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:50.791768 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55bfc5f9-5745-4d49-b5d1-3881529501c2 None admin] RBAC: Adding query filter params (type=network) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:22:50.792071 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55bfc5f9-5745-4d49-b5d1-3881529501c2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:22:50.793443 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55bfc5f9-5745-4d49-b5d1-3881529501c2 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:22:50.800504 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 382/778] 10.222.0.23 () {56 vars in 1112 bytes} [Tue May 10 05:22:50 2022] GET /identity/v3/services?type=network => generated 350 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:22:50.806484 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a31a8bf-44ca-44f7-a9de-ce02838168f5 None admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:22:50.907859 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a31a8bf-44ca-44f7-a9de-ce02838168f5 None admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:22:50.940538 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76abaff0-1b4c-4d9f-a66d-6932fe07405c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:22:50.941233 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76abaff0-1b4c-4d9f-a66d-6932fe07405c None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:50.941519 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76abaff0-1b4c-4d9f-a66d-6932fe07405c None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:50.941792 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76abaff0-1b4c-4d9f-a66d-6932fe07405c None admin] PATH_INFO: `/v3/endpoints` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:50.942584 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76abaff0-1b4c-4d9f-a66d-6932fe07405c None admin] RBAC: Adding query filter params (interface=public, service_id=131ecd47961b491e8964f0eae97bf61d, region_id=RegionOne) {{(pid=79879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:22:50.942893 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76abaff0-1b4c-4d9f-a66d-6932fe07405c None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:22:50.944454 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76abaff0-1b4c-4d9f-a66d-6932fe07405c None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:22:50.952418 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 397/779] 10.222.0.23 () {56 vars in 1251 bytes} [Tue May 10 05:22:50 2022] GET /identity/v3/endpoints?service_id=131ecd47961b491e8964f0eae97bf61d&interface=public®ion_id=RegionOne => generated 194 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:22:50.957995 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bfc5f9-5745-4d49-b5d1-3881529501c2 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:22:51.056936 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bfc5f9-5745-4d49-b5d1-3881529501c2 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:22:51.089893 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9131b7f-703d-4787-99f4-d78965d78c02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:22:51.090561 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9131b7f-703d-4787-99f4-d78965d78c02 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:51.090840 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9131b7f-703d-4787-99f4-d78965d78c02 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:51.091114 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9131b7f-703d-4787-99f4-d78965d78c02 None admin] PATH_INFO: `/v3/services` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:51.091841 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9131b7f-703d-4787-99f4-d78965d78c02 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:22:51.093211 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9131b7f-703d-4787-99f4-d78965d78c02 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:22:51.098879 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 383/780] 10.222.0.23 () {56 vars in 1087 bytes} [Tue May 10 05:22:50 2022] GET /identity/v3/services => generated 772 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:22:51.613691 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5bb9d7-bd58-421a-b96b-cf1ea96a172b None None] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:51.614085 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5bb9d7-bd58-421a-b96b-cf1ea96a172b None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:51.614257 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5bb9d7-bd58-421a-b96b-cf1ea96a172b None None] PATH_INFO: `/` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:51.615843 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 398/781] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 10 05:22:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 05:22:51.621730 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35df0505-d09f-4e83-be4a-98c4840043a7 None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:51.622022 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35df0505-d09f-4e83-be4a-98c4840043a7 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:51.622298 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35df0505-d09f-4e83-be4a-98c4840043a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:51.639395 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-35df0505-d09f-4e83-be4a-98c4840043a7 None None] MFA Rules not processed for user `44883b22532e44049d846938dc2cf423`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:22:51.640637 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-35df0505-d09f-4e83-be4a-98c4840043a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:22:51.706502 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 384/782] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 10 05:22:51 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 10 05:22:51.729797 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5bb9d7-bd58-421a-b96b-cf1ea96a172b None None] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:22:51.835748 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5bb9d7-bd58-421a-b96b-cf1ea96a172b None None] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:22:51.868823 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a13576-f5b1-4898-8240-fb1be16b2dd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:22:51.869675 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a13576-f5b1-4898-8240-fb1be16b2dd8 None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:51.869956 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a13576-f5b1-4898-8240-fb1be16b2dd8 None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:51.870226 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a13576-f5b1-4898-8240-fb1be16b2dd8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:51.881059 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a13576-f5b1-4898-8240-fb1be16b2dd8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 05:22:51.888831 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application [None req-68a13576-f5b1-4898-8240-fb1be16b2dd8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 10 05:22:51.888831 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 05:22:51.888831 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 05:22:51.888831 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 05:22:51.888831 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 05:22:51.888831 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 05:22:51.888831 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 05:22:51.888831 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 05:22:51.888831 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 05:22:51.888831 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 05:22:51.888831 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 05:22:51.888831 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 05:22:51.888831 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 05:22:51.888831 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 05:22:51.888831 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 05:22:51.888831 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 05:22:51.890865 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 05:22:51.890865 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 05:22:51.890865 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 05:22:51.890865 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 05:22:51.890865 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 05:22:51.890865 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 05:22:51.890865 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 05:22:51.890865 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 05:22:51.890865 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 05:22:51.890865 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.get_or_create( May 10 05:22:51.890865 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 05:22:51.890865 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application with Lock( May 10 05:22:51.890865 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 05:22:51.890865 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self._enter() May 10 05:22:51.890865 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 05:22:51.890865 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 05:22:51.892827 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 05:22:51.892827 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.creator() May 10 05:22:51.892827 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 05:22:51.892827 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application created_value = creator( May 10 05:22:51.892827 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 05:22:51.892827 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 05:22:51.892827 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 05:22:51.892827 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 05:22:51.892827 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 05:22:51.892827 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 05:22:51.892827 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 10 05:22:51.892827 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application May 10 05:22:51.892827 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 399/783] 10.222.0.23 () {56 vars in 1096 bytes} [Tue May 10 05:22:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 05:22:51.896342 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35df0505-d09f-4e83-be4a-98c4840043a7 None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:22:51.922178 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d58caf9-109a-4cd6-bf89-0e1f197081b6 None None] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:51.922486 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d58caf9-109a-4cd6-bf89-0e1f197081b6 None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:51.922717 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d58caf9-109a-4cd6-bf89-0e1f197081b6 None None] PATH_INFO: `/` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:51.924339 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 400/784] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 10 05:22:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 05:22:51.937410 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f3a4fa-0abc-4a83-8ceb-f9066f51de70 None None] REQUEST_METHOD: `POST` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:51.937781 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f3a4fa-0abc-4a83-8ceb-f9066f51de70 None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:51.938004 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f3a4fa-0abc-4a83-8ceb-f9066f51de70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:51.968153 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.auth.core [None req-63f3a4fa-0abc-4a83-8ceb-f9066f51de70 None None] MFA Rules not processed for user `44883b22532e44049d846938dc2cf423`. Rule list: `[]` (Enabled: `True`). {{(pid=79879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:22:51.971790 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-63f3a4fa-0abc-4a83-8ceb-f9066f51de70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:22:52.060085 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35df0505-d09f-4e83-be4a-98c4840043a7 None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:22:52.111208 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 401/785] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 10 05:22:51 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 10 05:22:52.124758 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085de1e7-3d5c-45a6-a621-dc83886962ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:22:52.125451 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085de1e7-3d5c-45a6-a621-dc83886962ae None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:52.125724 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085de1e7-3d5c-45a6-a621-dc83886962ae None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:52.126040 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085de1e7-3d5c-45a6-a621-dc83886962ae None admin] PATH_INFO: `/v3/roles` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:52.126802 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085de1e7-3d5c-45a6-a621-dc83886962ae None admin] RBAC: Adding query filter params (name=admin) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:22:52.127104 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085de1e7-3d5c-45a6-a621-dc83886962ae None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:22:52.128504 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085de1e7-3d5c-45a6-a621-dc83886962ae None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:22:52.137611 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 385/786] 10.222.0.23 () {56 vars in 1099 bytes} [Tue May 10 05:22:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 05:22:52.138434 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6679b98d-e741-4327-b2c4-6094ee789cdb None None] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:52.138788 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6679b98d-e741-4327-b2c4-6094ee789cdb None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:52.139071 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6679b98d-e741-4327-b2c4-6094ee789cdb None None] PATH_INFO: `/` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:52.142975 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085de1e7-3d5c-45a6-a621-dc83886962ae None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:22:52.144446 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 402/787] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 10 05:22:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 05:22:52.145992 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60de5767-0f51-4d57-8fe2-567c5e3f3d76 None None] REQUEST_METHOD: `POST` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:52.146277 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60de5767-0f51-4d57-8fe2-567c5e3f3d76 None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:52.146557 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60de5767-0f51-4d57-8fe2-567c5e3f3d76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:52.163161 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.auth.core [None req-60de5767-0f51-4d57-8fe2-567c5e3f3d76 None None] MFA Rules not processed for user `44883b22532e44049d846938dc2cf423`. Rule list: `[]` (Enabled: `True`). {{(pid=79879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:22:52.164388 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-60de5767-0f51-4d57-8fe2-567c5e3f3d76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:22:52.235672 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 403/788] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 10 05:22:52 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 10 05:22:52.236598 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60de5767-0f51-4d57-8fe2-567c5e3f3d76 None None] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:22:52.249911 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085de1e7-3d5c-45a6-a621-dc83886962ae None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:22:52.283707 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98b6c1c-2a70-4c12-b2b9-b4d1cb168235 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:22:52.284899 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98b6c1c-2a70-4c12-b2b9-b4d1cb168235 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:52.285413 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98b6c1c-2a70-4c12-b2b9-b4d1cb168235 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:52.285906 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98b6c1c-2a70-4c12-b2b9-b4d1cb168235 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:52.296791 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98b6c1c-2a70-4c12-b2b9-b4d1cb168235 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:22:52.298484 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98b6c1c-2a70-4c12-b2b9-b4d1cb168235 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:22:52.316060 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application [None req-b98b6c1c-2a70-4c12-b2b9-b4d1cb168235 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 05:22:52.316060 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 05:22:52.316060 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 05:22:52.316060 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 05:22:52.316060 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 05:22:52.316060 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 05:22:52.316060 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 05:22:52.316060 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 05:22:52.316060 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 05:22:52.316060 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 05:22:52.316060 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 05:22:52.316060 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 05:22:52.316060 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 05:22:52.316060 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 05:22:52.316060 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 05:22:52.317013 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 05:22:52.317013 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 05:22:52.317013 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 05:22:52.317013 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 05:22:52.317013 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 05:22:52.317013 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 05:22:52.317013 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.get_or_create( May 10 05:22:52.317013 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 05:22:52.317013 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application with Lock( May 10 05:22:52.317013 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 05:22:52.317013 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._enter() May 10 05:22:52.317013 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 05:22:52.317013 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 05:22:52.317013 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 05:22:52.317013 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.creator() May 10 05:22:52.317013 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 05:22:52.317013 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application created_value = creator( May 10 05:22:52.317910 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 05:22:52.317910 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 05:22:52.317910 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 05:22:52.317910 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application May 10 05:22:52.320178 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 386/789] 10.222.0.23 () {56 vars in 1108 bytes} [Tue May 10 05:22:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 05:22:52.321174 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98b6c1c-2a70-4c12-b2b9-b4d1cb168235 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:22:52.337694 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60de5767-0f51-4d57-8fe2-567c5e3f3d76 None None] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:22:52.377906 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef96cda-67bc-49d4-88a1-ccbbc97db1c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:22:52.378713 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef96cda-67bc-49d4-88a1-ccbbc97db1c6 None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:52.379017 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef96cda-67bc-49d4-88a1-ccbbc97db1c6 None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:52.379283 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef96cda-67bc-49d4-88a1-ccbbc97db1c6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:52.389548 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef96cda-67bc-49d4-88a1-ccbbc97db1c6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 05:22:52.397267 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application [None req-2ef96cda-67bc-49d4-88a1-ccbbc97db1c6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 10 05:22:52.397267 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 05:22:52.397267 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 05:22:52.397267 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 05:22:52.397267 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 05:22:52.397267 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 05:22:52.397267 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 05:22:52.397267 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 05:22:52.397267 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 05:22:52.397267 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 05:22:52.397267 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 05:22:52.397267 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 05:22:52.397267 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 05:22:52.397267 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 05:22:52.397267 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 05:22:52.397267 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 05:22:52.398299 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 05:22:52.398299 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 05:22:52.398299 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 05:22:52.398299 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 05:22:52.398299 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 05:22:52.398299 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 05:22:52.398299 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 05:22:52.398299 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 05:22:52.398299 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 05:22:52.398299 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.get_or_create( May 10 05:22:52.398299 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 05:22:52.398299 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application with Lock( May 10 05:22:52.398299 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 05:22:52.398299 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self._enter() May 10 05:22:52.398299 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 05:22:52.398299 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 05:22:52.399151 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 05:22:52.399151 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.creator() May 10 05:22:52.399151 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 05:22:52.399151 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application created_value = creator( May 10 05:22:52.399151 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 05:22:52.399151 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 05:22:52.399151 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 05:22:52.399151 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 05:22:52.399151 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 05:22:52.399151 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 05:22:52.399151 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 10 05:22:52.399151 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application May 10 05:22:52.399151 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 404/790] 10.222.0.23 () {56 vars in 1096 bytes} [Tue May 10 05:22:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 05:22:52.399879 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef96cda-67bc-49d4-88a1-ccbbc97db1c6 None admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:22:52.437637 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98b6c1c-2a70-4c12-b2b9-b4d1cb168235 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:22:52.485304 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94072fbf-f1d9-42da-809f-d5b665fa4708 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:22:52.486275 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94072fbf-f1d9-42da-809f-d5b665fa4708 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:52.486643 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94072fbf-f1d9-42da-809f-d5b665fa4708 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:52.487003 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94072fbf-f1d9-42da-809f-d5b665fa4708 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:52.499165 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94072fbf-f1d9-42da-809f-d5b665fa4708 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 05:22:52.507540 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application [None req-94072fbf-f1d9-42da-809f-d5b665fa4708 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 10 05:22:52.507540 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 05:22:52.507540 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 05:22:52.507540 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 05:22:52.507540 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 05:22:52.507540 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 05:22:52.507540 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 05:22:52.507540 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 05:22:52.507540 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 05:22:52.507540 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 05:22:52.507540 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 05:22:52.507540 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 05:22:52.507540 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 05:22:52.507540 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 05:22:52.507540 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 05:22:52.507540 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 05:22:52.508791 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 05:22:52.508791 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 05:22:52.508791 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 05:22:52.508791 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 05:22:52.508791 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 05:22:52.508791 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 05:22:52.508791 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 05:22:52.508791 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 05:22:52.508791 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 05:22:52.508791 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.get_or_create( May 10 05:22:52.508791 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 05:22:52.508791 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application with Lock( May 10 05:22:52.508791 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 05:22:52.508791 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._enter() May 10 05:22:52.508791 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 05:22:52.508791 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 05:22:52.509840 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 05:22:52.509840 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.creator() May 10 05:22:52.509840 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 05:22:52.509840 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application created_value = creator( May 10 05:22:52.509840 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 05:22:52.509840 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 05:22:52.509840 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 05:22:52.509840 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 05:22:52.509840 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 05:22:52.509840 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 05:22:52.509840 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 10 05:22:52.509840 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application May 10 05:22:52.511966 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 387/791] 10.222.0.23 () {56 vars in 1102 bytes} [Tue May 10 05:22:52 2022] GET /identity/v3/roles/service => generated 85 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 05:22:52.512875 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94072fbf-f1d9-42da-809f-d5b665fa4708 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:22:52.617425 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94072fbf-f1d9-42da-809f-d5b665fa4708 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:22:52.650351 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef96cda-67bc-49d4-88a1-ccbbc97db1c6 None admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:22:52.653503 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c6babd-4566-404b-bb52-05dd6ddf256b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:22:52.654360 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c6babd-4566-404b-bb52-05dd6ddf256b None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:52.654813 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c6babd-4566-404b-bb52-05dd6ddf256b None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:52.655221 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c6babd-4566-404b-bb52-05dd6ddf256b None admin] PATH_INFO: `/v3/roles` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:52.656221 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c6babd-4566-404b-bb52-05dd6ddf256b None admin] RBAC: Adding query filter params (name=admin) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:22:52.656667 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c6babd-4566-404b-bb52-05dd6ddf256b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:22:52.658180 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c6babd-4566-404b-bb52-05dd6ddf256b None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:22:52.666794 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 388/792] 10.222.0.23 () {56 vars in 1099 bytes} [Tue May 10 05:22:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:22:52.667849 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c6babd-4566-404b-bb52-05dd6ddf256b None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:22:52.685158 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19dc9b28-8746-448a-803d-06e9f0a4f7fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:22:52.685934 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dc9b28-8746-448a-803d-06e9f0a4f7fc None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:52.686276 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dc9b28-8746-448a-803d-06e9f0a4f7fc None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:52.686602 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dc9b28-8746-448a-803d-06e9f0a4f7fc None admin] PATH_INFO: `/v3/domains` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:52.687404 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19dc9b28-8746-448a-803d-06e9f0a4f7fc None admin] RBAC: Adding query filter params (name=Default) {{(pid=79879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:22:52.687806 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19dc9b28-8746-448a-803d-06e9f0a4f7fc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:22:52.689276 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19dc9b28-8746-448a-803d-06e9f0a4f7fc None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:22:52.705496 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 405/793] 10.222.0.23 () {56 vars in 1109 bytes} [Tue May 10 05:22:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:22:52.705496 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19dc9b28-8746-448a-803d-06e9f0a4f7fc None admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:22:52.773142 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c6babd-4566-404b-bb52-05dd6ddf256b None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:22:52.806864 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19dc9b28-8746-448a-803d-06e9f0a4f7fc None admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:22:52.812789 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11aa174d-faae-4d15-8c57-37d2849821a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:22:52.813739 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11aa174d-faae-4d15-8c57-37d2849821a5 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:52.814567 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11aa174d-faae-4d15-8c57-37d2849821a5 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:52.815020 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11aa174d-faae-4d15-8c57-37d2849821a5 None admin] PATH_INFO: `/v3/roles` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:52.815989 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11aa174d-faae-4d15-8c57-37d2849821a5 None admin] RBAC: Adding query filter params (name=service) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:22:52.816868 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11aa174d-faae-4d15-8c57-37d2849821a5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:22:52.818983 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11aa174d-faae-4d15-8c57-37d2849821a5 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:22:52.829639 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 389/794] 10.222.0.23 () {56 vars in 1103 bytes} [Tue May 10 05:22:52 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:22:52.830726 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11aa174d-faae-4d15-8c57-37d2849821a5 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:22:52.846073 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecb4f33-25ac-4c4f-901f-5ba83ee93035 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:22:52.846991 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecb4f33-25ac-4c4f-901f-5ba83ee93035 None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:52.847361 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecb4f33-25ac-4c4f-901f-5ba83ee93035 None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:52.847848 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecb4f33-25ac-4c4f-901f-5ba83ee93035 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:52.858729 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fecb4f33-25ac-4c4f-901f-5ba83ee93035 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:22:52.860353 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fecb4f33-25ac-4c4f-901f-5ba83ee93035 None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:22:52.878276 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application [None req-fecb4f33-25ac-4c4f-901f-5ba83ee93035 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 05:22:52.878276 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 05:22:52.878276 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 05:22:52.878276 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 05:22:52.878276 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 05:22:52.878276 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 05:22:52.878276 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 05:22:52.878276 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 05:22:52.878276 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 05:22:52.878276 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 05:22:52.878276 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 05:22:52.878276 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 05:22:52.878276 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 05:22:52.878276 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 05:22:52.878276 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 05:22:52.879502 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 05:22:52.879502 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 05:22:52.879502 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 05:22:52.879502 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 05:22:52.879502 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 05:22:52.879502 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 05:22:52.879502 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.get_or_create( May 10 05:22:52.879502 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 05:22:52.879502 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application with Lock( May 10 05:22:52.879502 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 05:22:52.879502 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self._enter() May 10 05:22:52.879502 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 05:22:52.879502 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 05:22:52.879502 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 05:22:52.879502 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.creator() May 10 05:22:52.879502 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 05:22:52.879502 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application created_value = creator( May 10 05:22:52.880625 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 05:22:52.880625 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 05:22:52.880625 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 05:22:52.880625 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application May 10 05:22:52.882043 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 406/795] 10.222.0.23 () {56 vars in 1108 bytes} [Tue May 10 05:22:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 05:22:52.883090 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecb4f33-25ac-4c4f-901f-5ba83ee93035 None admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:22:52.942914 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11aa174d-faae-4d15-8c57-37d2849821a5 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:22:52.976106 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597f2307-ca06-42df-9588-59006dd3466d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:22:52.977181 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597f2307-ca06-42df-9588-59006dd3466d None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:52.977612 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597f2307-ca06-42df-9588-59006dd3466d None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:52.978031 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597f2307-ca06-42df-9588-59006dd3466d None admin] PATH_INFO: `/v3/users/nova` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:52.982967 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecb4f33-25ac-4c4f-901f-5ba83ee93035 None admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:22:52.985911 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597f2307-ca06-42df-9588-59006dd3466d None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:22:52.987551 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597f2307-ca06-42df-9588-59006dd3466d None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:22:53.002107 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application [None req-597f2307-ca06-42df-9588-59006dd3466d None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 10 05:22:53.002107 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 05:22:53.002107 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 05:22:53.002107 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 05:22:53.002107 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 05:22:53.002107 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 05:22:53.002107 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 05:22:53.002107 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 05:22:53.002107 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 05:22:53.002107 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 05:22:53.002107 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 05:22:53.002107 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 05:22:53.002107 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 05:22:53.002107 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 05:22:53.002107 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 05:22:53.002107 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 05:22:53.003042 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 05:22:53.003042 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 05:22:53.003042 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 05:22:53.003042 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 05:22:53.003042 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 05:22:53.003042 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 05:22:53.003042 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 05:22:53.003042 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 05:22:53.003042 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 05:22:53.003042 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.get_or_create( May 10 05:22:53.003042 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 05:22:53.003042 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application with Lock( May 10 05:22:53.003042 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 05:22:53.003042 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._enter() May 10 05:22:53.003042 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 05:22:53.003042 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 05:22:53.003042 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 05:22:53.003042 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.creator() May 10 05:22:53.004049 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 05:22:53.004049 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application created_value = creator( May 10 05:22:53.004049 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 05:22:53.004049 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 05:22:53.004049 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 05:22:53.004049 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 05:22:53.004049 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 05:22:53.004049 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 05:22:53.004049 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 10 05:22:53.004049 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application May 10 05:22:53.010981 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 390/796] 10.222.0.23 () {56 vars in 1093 bytes} [Tue May 10 05:22:52 2022] GET /identity/v3/users/nova => generated 82 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 05:22:53.012078 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597f2307-ca06-42df-9588-59006dd3466d None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:22:53.017283 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ece6792-87f5-4a7b-9954-858e716b3019 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:22:53.018212 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ece6792-87f5-4a7b-9954-858e716b3019 None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:53.018644 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ece6792-87f5-4a7b-9954-858e716b3019 None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:53.019008 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ece6792-87f5-4a7b-9954-858e716b3019 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:53.029863 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ece6792-87f5-4a7b-9954-858e716b3019 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:22:53.031424 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ece6792-87f5-4a7b-9954-858e716b3019 None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:22:53.048947 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application [None req-5ece6792-87f5-4a7b-9954-858e716b3019 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 05:22:53.048947 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 05:22:53.048947 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 05:22:53.048947 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 05:22:53.048947 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 05:22:53.048947 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 05:22:53.048947 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 05:22:53.048947 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 05:22:53.048947 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 05:22:53.048947 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 05:22:53.048947 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 05:22:53.048947 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 05:22:53.048947 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 05:22:53.048947 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 05:22:53.048947 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 05:22:53.049923 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 05:22:53.049923 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 05:22:53.049923 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 05:22:53.049923 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 05:22:53.049923 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 05:22:53.049923 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 05:22:53.049923 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.get_or_create( May 10 05:22:53.049923 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 05:22:53.049923 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application with Lock( May 10 05:22:53.049923 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 05:22:53.049923 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self._enter() May 10 05:22:53.049923 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 05:22:53.049923 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 05:22:53.049923 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 05:22:53.049923 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.creator() May 10 05:22:53.049923 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 05:22:53.049923 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application created_value = creator( May 10 05:22:53.050962 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 05:22:53.050962 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 05:22:53.050962 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 05:22:53.050962 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application May 10 05:22:53.056014 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 407/797] 10.222.0.23 () {56 vars in 1108 bytes} [Tue May 10 05:22:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 05:22:53.056647 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ece6792-87f5-4a7b-9954-858e716b3019 None admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:22:53.117588 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597f2307-ca06-42df-9588-59006dd3466d None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:22:53.151529 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34110c17-7d2b-489e-a319-9a1bcf57cabb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:22:53.152535 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34110c17-7d2b-489e-a319-9a1bcf57cabb None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:53.152997 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34110c17-7d2b-489e-a319-9a1bcf57cabb None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:53.153436 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34110c17-7d2b-489e-a319-9a1bcf57cabb None admin] PATH_INFO: `/v3/domains` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:53.154346 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34110c17-7d2b-489e-a319-9a1bcf57cabb None admin] RBAC: Adding query filter params (name=Default) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:22:53.154850 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34110c17-7d2b-489e-a319-9a1bcf57cabb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:22:53.156443 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34110c17-7d2b-489e-a319-9a1bcf57cabb None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:22:53.158115 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ece6792-87f5-4a7b-9954-858e716b3019 None admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:22:53.169139 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 391/798] 10.222.0.23 () {56 vars in 1109 bytes} [Tue May 10 05:22:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:22:53.170264 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34110c17-7d2b-489e-a319-9a1bcf57cabb None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:22:53.192241 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff52523-54c0-42db-b1a8-5d16dac583a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:22:53.193023 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff52523-54c0-42db-b1a8-5d16dac583a5 None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:53.193295 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff52523-54c0-42db-b1a8-5d16dac583a5 None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:53.193561 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff52523-54c0-42db-b1a8-5d16dac583a5 None admin] PATH_INFO: `/v3/users` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:53.194511 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff52523-54c0-42db-b1a8-5d16dac583a5 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:22:53.194817 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff52523-54c0-42db-b1a8-5d16dac583a5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:22:53.196328 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff52523-54c0-42db-b1a8-5d16dac583a5 None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:22:53.219137 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 408/799] 10.222.0.23 () {56 vars in 1133 bytes} [Tue May 10 05:22:53 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:22:53.219137 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff52523-54c0-42db-b1a8-5d16dac583a5 None admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:22:53.273531 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34110c17-7d2b-489e-a319-9a1bcf57cabb None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:22:53.306555 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbebb9d6-5a86-436b-91fd-adb72c143792 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:22:53.307224 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbebb9d6-5a86-436b-91fd-adb72c143792 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:53.307498 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbebb9d6-5a86-436b-91fd-adb72c143792 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:53.307799 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbebb9d6-5a86-436b-91fd-adb72c143792 None admin] PATH_INFO: `/v3/domains` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:53.308520 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbebb9d6-5a86-436b-91fd-adb72c143792 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:22:53.308821 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbebb9d6-5a86-436b-91fd-adb72c143792 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:22:53.310183 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbebb9d6-5a86-436b-91fd-adb72c143792 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:22:53.317751 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff52523-54c0-42db-b1a8-5d16dac583a5 None admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:22:53.321316 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 392/800] 10.222.0.23 () {56 vars in 1109 bytes} [Tue May 10 05:22:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:22:53.323218 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbebb9d6-5a86-436b-91fd-adb72c143792 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:22:53.355548 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79cb216-5c78-4340-b356-0c9d965b1401 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:22:53.356535 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79cb216-5c78-4340-b356-0c9d965b1401 None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:53.356815 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79cb216-5c78-4340-b356-0c9d965b1401 None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:53.357824 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79cb216-5c78-4340-b356-0c9d965b1401 None admin] PATH_INFO: `/v3/users/swift` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:53.366172 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79cb216-5c78-4340-b356-0c9d965b1401 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:22:53.368146 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79cb216-5c78-4340-b356-0c9d965b1401 None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:22:53.387424 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application [None req-a79cb216-5c78-4340-b356-0c9d965b1401 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 10 05:22:53.387424 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 05:22:53.387424 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 05:22:53.387424 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 05:22:53.387424 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 05:22:53.387424 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 05:22:53.387424 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 05:22:53.387424 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 05:22:53.387424 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 05:22:53.387424 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 05:22:53.387424 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 05:22:53.387424 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 05:22:53.387424 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 05:22:53.387424 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 05:22:53.387424 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 05:22:53.387424 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 05:22:53.388437 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 05:22:53.388437 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 05:22:53.388437 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 05:22:53.388437 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 05:22:53.388437 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 05:22:53.388437 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 05:22:53.388437 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 05:22:53.388437 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 05:22:53.388437 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 05:22:53.388437 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.get_or_create( May 10 05:22:53.388437 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 05:22:53.388437 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application with Lock( May 10 05:22:53.388437 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 05:22:53.388437 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self._enter() May 10 05:22:53.388437 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 05:22:53.388437 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 05:22:53.388437 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 05:22:53.388437 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.creator() May 10 05:22:53.389370 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 05:22:53.389370 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application created_value = creator( May 10 05:22:53.389370 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 05:22:53.389370 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 05:22:53.389370 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 05:22:53.389370 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 05:22:53.389370 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 05:22:53.389370 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 05:22:53.389370 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 10 05:22:53.389370 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application May 10 05:22:53.390549 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 409/801] 10.222.0.23 () {56 vars in 1096 bytes} [Tue May 10 05:22:53 2022] GET /identity/v3/users/swift => generated 83 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 05:22:53.392236 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c211033d-ce55-49a0-91af-39b2b3f4401d None None] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:53.392586 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c211033d-ce55-49a0-91af-39b2b3f4401d None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:53.392926 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c211033d-ce55-49a0-91af-39b2b3f4401d None None] PATH_INFO: `/` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:53.395636 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 410/802] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 10 05:22:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 05:22:53.395636 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c211033d-ce55-49a0-91af-39b2b3f4401d None None] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:22:53.434231 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbebb9d6-5a86-436b-91fd-adb72c143792 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:22:53.471069 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799ef997-06ab-478c-88cb-6d568e390257 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:22:53.471796 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799ef997-06ab-478c-88cb-6d568e390257 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:53.472589 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799ef997-06ab-478c-88cb-6d568e390257 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:53.472888 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799ef997-06ab-478c-88cb-6d568e390257 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:53.496798 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c211033d-ce55-49a0-91af-39b2b3f4401d None None] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:22:53.533667 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3401adcb-be85-4ebd-af57-652e72b82cfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:22:53.534487 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3401adcb-be85-4ebd-af57-652e72b82cfa None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:53.534927 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3401adcb-be85-4ebd-af57-652e72b82cfa None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:53.535266 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3401adcb-be85-4ebd-af57-652e72b82cfa None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:53.537850 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799ef997-06ab-478c-88cb-6d568e390257 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:22:53.539377 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799ef997-06ab-478c-88cb-6d568e390257 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:22:53.543970 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3401adcb-be85-4ebd-af57-652e72b82cfa None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:22:53.545404 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3401adcb-be85-4ebd-af57-652e72b82cfa None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:22:53.564674 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application [None req-3401adcb-be85-4ebd-af57-652e72b82cfa None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 10 05:22:53.564674 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 05:22:53.564674 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 05:22:53.564674 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 05:22:53.564674 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 05:22:53.564674 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 05:22:53.564674 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 05:22:53.564674 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 05:22:53.564674 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 05:22:53.564674 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 05:22:53.564674 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 05:22:53.564674 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 05:22:53.564674 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 05:22:53.564674 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 05:22:53.564674 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 05:22:53.564674 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 05:22:53.565699 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 05:22:53.565699 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 05:22:53.565699 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 05:22:53.565699 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 05:22:53.565699 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 05:22:53.565699 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 05:22:53.565699 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 05:22:53.565699 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 05:22:53.565699 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 05:22:53.565699 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.get_or_create( May 10 05:22:53.565699 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 05:22:53.565699 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application with Lock( May 10 05:22:53.565699 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 05:22:53.565699 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self._enter() May 10 05:22:53.565699 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 05:22:53.565699 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 05:22:53.565699 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 05:22:53.565699 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.creator() May 10 05:22:53.566778 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 05:22:53.566778 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application created_value = creator( May 10 05:22:53.566778 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 05:22:53.566778 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 05:22:53.566778 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 05:22:53.566778 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 05:22:53.566778 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 05:22:53.566778 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 05:22:53.566778 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 10 05:22:53.566778 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application May 10 05:22:53.567341 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 411/803] 10.222.0.23 () {56 vars in 1117 bytes} [Tue May 10 05:22:53 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 05:22:53.568082 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3401adcb-be85-4ebd-af57-652e72b82cfa None admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:22:53.643519 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 393/804] 10.222.0.23 () {58 vars in 1282 bytes} [Tue May 10 05:22:53 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 10 05:22:53.644938 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143494be-5679-4505-a6ef-4d0b2dee4989 None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:53.645219 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143494be-5679-4505-a6ef-4d0b2dee4989 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:53.645487 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143494be-5679-4505-a6ef-4d0b2dee4989 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:53.661802 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-143494be-5679-4505-a6ef-4d0b2dee4989 None None] MFA Rules not processed for user `44883b22532e44049d846938dc2cf423`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:22:53.662971 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-143494be-5679-4505-a6ef-4d0b2dee4989 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:22:53.673849 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3401adcb-be85-4ebd-af57-652e72b82cfa None admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:22:53.707764 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbba3bc-c9d5-4715-9071-f9a5e3b90c2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:22:53.708364 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbba3bc-c9d5-4715-9071-f9a5e3b90c2d None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:53.708640 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbba3bc-c9d5-4715-9071-f9a5e3b90c2d None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:53.708913 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbba3bc-c9d5-4715-9071-f9a5e3b90c2d None admin] PATH_INFO: `/v3/users` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:53.709761 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbba3bc-c9d5-4715-9071-f9a5e3b90c2d None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:22:53.710063 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbba3bc-c9d5-4715-9071-f9a5e3b90c2d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:22:53.711505 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbba3bc-c9d5-4715-9071-f9a5e3b90c2d None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:22:53.727621 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 394/805] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 10 05:22:53 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 05:22:53.728646 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 412/806] 10.222.0.23 () {56 vars in 1135 bytes} [Tue May 10 05:22:53 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:22:53.728902 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143494be-5679-4505-a6ef-4d0b2dee4989 None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:22:53.729445 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbba3bc-c9d5-4715-9071-f9a5e3b90c2d None admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:22:53.823611 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbba3bc-c9d5-4715-9071-f9a5e3b90c2d None admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:22:53.832428 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143494be-5679-4505-a6ef-4d0b2dee4989 None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:22:53.856837 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9a72e6-87b7-47fa-b46f-367e376f6e74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:22:53.857633 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9a72e6-87b7-47fa-b46f-367e376f6e74 None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:53.857910 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9a72e6-87b7-47fa-b46f-367e376f6e74 None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:53.858179 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9a72e6-87b7-47fa-b46f-367e376f6e74 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:53.864854 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb21238-4b11-451b-ad6d-583b7ce76072 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:22:53.865520 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb21238-4b11-451b-ad6d-583b7ce76072 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:53.865801 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb21238-4b11-451b-ad6d-583b7ce76072 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:53.866093 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb21238-4b11-451b-ad6d-583b7ce76072 None admin] PATH_INFO: `/v3/users` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:53.866931 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb21238-4b11-451b-ad6d-583b7ce76072 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:22:53.867235 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb21238-4b11-451b-ad6d-583b7ce76072 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:22:53.867963 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9a72e6-87b7-47fa-b46f-367e376f6e74 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:22:53.868701 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb21238-4b11-451b-ad6d-583b7ce76072 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:22:53.869398 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9a72e6-87b7-47fa-b46f-367e376f6e74 None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:22:53.885571 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 395/807] 10.222.0.23 () {56 vars in 1149 bytes} [Tue May 10 05:22:53 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:22:53.886281 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb21238-4b11-451b-ad6d-583b7ce76072 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:22:53.886528 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application [None req-0c9a72e6-87b7-47fa-b46f-367e376f6e74 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 05:22:53.886528 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 05:22:53.886528 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 05:22:53.886528 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 05:22:53.886528 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 05:22:53.886528 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 05:22:53.886528 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 05:22:53.886528 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 05:22:53.886528 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 05:22:53.886528 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 05:22:53.886528 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 05:22:53.886528 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 05:22:53.886528 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 05:22:53.886528 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 05:22:53.886528 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 05:22:53.887354 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 05:22:53.887354 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 05:22:53.887354 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 05:22:53.887354 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 05:22:53.887354 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 05:22:53.887354 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 05:22:53.887354 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.get_or_create( May 10 05:22:53.887354 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 05:22:53.887354 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application with Lock( May 10 05:22:53.887354 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 05:22:53.887354 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self._enter() May 10 05:22:53.887354 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 05:22:53.887354 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 05:22:53.887354 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 05:22:53.887354 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.creator() May 10 05:22:53.887354 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 05:22:53.887354 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application created_value = creator( May 10 05:22:53.888283 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 05:22:53.888283 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 05:22:53.888283 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 05:22:53.888283 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application May 10 05:22:53.888283 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 413/808] 10.222.0.23 () {56 vars in 1108 bytes} [Tue May 10 05:22:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 05:22:53.890083 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccebf6cf-1934-47a8-ac0e-a9935c43e7ae None None] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:53.890083 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccebf6cf-1934-47a8-ac0e-a9935c43e7ae None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:53.890083 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccebf6cf-1934-47a8-ac0e-a9935c43e7ae None None] PATH_INFO: `/` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:53.891305 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 414/809] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 10 05:22:53 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 05:22:53.892458 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccebf6cf-1934-47a8-ac0e-a9935c43e7ae None None] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:22:53.981404 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb21238-4b11-451b-ad6d-583b7ce76072 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:22:53.986874 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccebf6cf-1934-47a8-ac0e-a9935c43e7ae None None] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:22:54.015497 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbb728c-6f67-4b0e-b9db-57ae945b86a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:22:54.016323 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbb728c-6f67-4b0e-b9db-57ae945b86a6 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:54.016596 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbb728c-6f67-4b0e-b9db-57ae945b86a6 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:54.016862 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbb728c-6f67-4b0e-b9db-57ae945b86a6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:54.020552 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75271d59-76b9-4c8c-b596-92b44c42ff7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:22:54.021356 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75271d59-76b9-4c8c-b596-92b44c42ff7d None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:54.021637 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75271d59-76b9-4c8c-b596-92b44c42ff7d None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:54.021905 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75271d59-76b9-4c8c-b596-92b44c42ff7d None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:54.022552 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75271d59-76b9-4c8c-b596-92b44c42ff7d None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:22:54.023961 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75271d59-76b9-4c8c-b596-92b44c42ff7d None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:22:54.026355 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbb728c-6f67-4b0e-b9db-57ae945b86a6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:22:54.027798 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbb728c-6f67-4b0e-b9db-57ae945b86a6 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:22:54.035985 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application [None req-75271d59-76b9-4c8c-b596-92b44c42ff7d None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 10 05:22:54.035985 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 05:22:54.035985 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 10 05:22:54.035985 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 10 05:22:54.035985 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 10 05:22:54.035985 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 10 05:22:54.035985 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 10 05:22:54.035985 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 05:22:54.035985 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 10 05:22:54.035985 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application May 10 05:22:54.035985 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 05:22:54.035985 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application May 10 05:22:54.035985 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 05:22:54.035985 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 05:22:54.035985 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 05:22:54.035985 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 05:22:54.036948 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 05:22:54.036948 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 05:22:54.036948 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 05:22:54.036948 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 05:22:54.036948 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 05:22:54.036948 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 05:22:54.036948 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 05:22:54.036948 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 10 05:22:54.036948 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self._get_service(service_id) May 10 05:22:54.036948 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 10 05:22:54.036948 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 10 05:22:54.036948 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 05:22:54.036948 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 05:22:54.036948 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 05:22:54.036948 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 05:22:54.036948 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 05:22:54.037807 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.get_or_create( May 10 05:22:54.037807 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 05:22:54.037807 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application with Lock( May 10 05:22:54.037807 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 05:22:54.037807 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self._enter() May 10 05:22:54.037807 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 05:22:54.037807 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 05:22:54.037807 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 05:22:54.037807 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.creator() May 10 05:22:54.037807 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 05:22:54.037807 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application created_value = creator( May 10 05:22:54.037807 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 10 05:22:54.037807 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 05:22:54.037807 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 10 05:22:54.037807 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application May 10 05:22:54.037807 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 415/810] 10.222.0.23 () {56 vars in 1129 bytes} [Tue May 10 05:22:53 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 05:22:54.038656 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75271d59-76b9-4c8c-b596-92b44c42ff7d None admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:22:54.044425 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application [None req-5cbb728c-6f67-4b0e-b9db-57ae945b86a6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 05:22:54.044425 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 05:22:54.044425 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 05:22:54.044425 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 05:22:54.044425 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 05:22:54.044425 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 05:22:54.044425 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 05:22:54.044425 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 05:22:54.044425 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 05:22:54.044425 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 05:22:54.044425 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 05:22:54.044425 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 05:22:54.044425 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 05:22:54.044425 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 05:22:54.044425 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 05:22:54.045329 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 05:22:54.045329 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 05:22:54.045329 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 05:22:54.045329 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 05:22:54.045329 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 05:22:54.045329 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 05:22:54.045329 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.get_or_create( May 10 05:22:54.045329 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 05:22:54.045329 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application with Lock( May 10 05:22:54.045329 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 05:22:54.045329 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._enter() May 10 05:22:54.045329 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 05:22:54.045329 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 05:22:54.045329 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 05:22:54.045329 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.creator() May 10 05:22:54.045329 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 05:22:54.045329 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application created_value = creator( May 10 05:22:54.046232 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 05:22:54.046232 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 05:22:54.046232 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 05:22:54.046232 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application May 10 05:22:54.046232 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 396/811] 10.222.0.23 () {56 vars in 1108 bytes} [Tue May 10 05:22:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 05:22:54.046517 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbb728c-6f67-4b0e-b9db-57ae945b86a6 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:22:54.142013 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75271d59-76b9-4c8c-b596-92b44c42ff7d None admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:22:54.142366 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbb728c-6f67-4b0e-b9db-57ae945b86a6 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:22:54.174722 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c5ce06-7843-4edf-ad11-0572c0653bdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:22:54.174958 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c8c20a-7a9d-4ed4-9c6e-0334932b1b46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:22:54.175374 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c5ce06-7843-4edf-ad11-0572c0653bdb None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:54.175678 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c5ce06-7843-4edf-ad11-0572c0653bdb None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:54.175802 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c8c20a-7a9d-4ed4-9c6e-0334932b1b46 None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:54.175975 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c5ce06-7843-4edf-ad11-0572c0653bdb None admin] PATH_INFO: `/v3/domains` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:54.176070 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c8c20a-7a9d-4ed4-9c6e-0334932b1b46 None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:54.176285 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c8c20a-7a9d-4ed4-9c6e-0334932b1b46 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:54.176659 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c5ce06-7843-4edf-ad11-0572c0653bdb None admin] RBAC: Adding query filter params (name=Default) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:22:54.176957 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c5ce06-7843-4edf-ad11-0572c0653bdb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:22:54.178315 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c5ce06-7843-4edf-ad11-0572c0653bdb None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:22:54.187199 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c8c20a-7a9d-4ed4-9c6e-0334932b1b46 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:22:54.188679 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c8c20a-7a9d-4ed4-9c6e-0334932b1b46 None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:22:54.189270 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 397/812] 10.222.0.23 () {56 vars in 1109 bytes} [Tue May 10 05:22:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:22:54.190557 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2c7457-feef-4e21-ac49-1de62708a55b None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:54.190737 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2c7457-feef-4e21-ac49-1de62708a55b None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:54.190995 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2c7457-feef-4e21-ac49-1de62708a55b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:54.206135 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application [None req-19c8c20a-7a9d-4ed4-9c6e-0334932b1b46 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 05:22:54.206135 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 05:22:54.206135 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 05:22:54.206135 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 05:22:54.206135 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 05:22:54.206135 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 05:22:54.206135 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 05:22:54.206135 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 05:22:54.206135 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 05:22:54.206135 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 05:22:54.206135 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 05:22:54.206135 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 05:22:54.206135 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 05:22:54.206135 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 05:22:54.206135 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 05:22:54.207096 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 05:22:54.207096 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 05:22:54.207096 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 05:22:54.207096 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 05:22:54.207096 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 05:22:54.207096 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 05:22:54.207096 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.get_or_create( May 10 05:22:54.207096 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 05:22:54.207096 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application with Lock( May 10 05:22:54.207096 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 05:22:54.207096 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self._enter() May 10 05:22:54.207096 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 05:22:54.207096 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 05:22:54.207096 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 05:22:54.207096 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.creator() May 10 05:22:54.207096 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 05:22:54.207096 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application created_value = creator( May 10 05:22:54.208248 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 05:22:54.208248 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 05:22:54.208248 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 05:22:54.208248 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application May 10 05:22:54.208471 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-2c2c7457-feef-4e21-ac49-1de62708a55b None None] MFA Rules not processed for user `44883b22532e44049d846938dc2cf423`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:22:54.208544 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 416/813] 10.222.0.23 () {56 vars in 1108 bytes} [Tue May 10 05:22:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 05:22:54.208879 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c8c20a-7a9d-4ed4-9c6e-0334932b1b46 None admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:22:54.209065 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-2c2c7457-feef-4e21-ac49-1de62708a55b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:22:54.276215 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 398/814] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 10 05:22:54 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 05:22:54.276847 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2c7457-feef-4e21-ac49-1de62708a55b None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:22:54.314036 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c8c20a-7a9d-4ed4-9c6e-0334932b1b46 None admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:22:54.345006 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d583c5-908c-4947-905a-2c790ad7031b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:22:54.345788 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d583c5-908c-4947-905a-2c790ad7031b None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:54.346136 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d583c5-908c-4947-905a-2c790ad7031b None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:54.346485 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d583c5-908c-4947-905a-2c790ad7031b None admin] PATH_INFO: `/v3/services` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:54.347276 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d583c5-908c-4947-905a-2c790ad7031b None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=79879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:22:54.347774 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d583c5-908c-4947-905a-2c790ad7031b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:22:54.349162 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d583c5-908c-4947-905a-2c790ad7031b None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:22:54.353587 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 417/815] 10.222.0.23 () {56 vars in 1124 bytes} [Tue May 10 05:22:54 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:22:54.354355 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d583c5-908c-4947-905a-2c790ad7031b None admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:22:54.372859 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2c7457-feef-4e21-ac49-1de62708a55b None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:22:54.405625 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa83f08-e265-40a2-b689-1934b71c7ddc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:22:54.406288 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa83f08-e265-40a2-b689-1934b71c7ddc None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:54.406545 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa83f08-e265-40a2-b689-1934b71c7ddc None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:54.406798 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa83f08-e265-40a2-b689-1934b71c7ddc None admin] PATH_INFO: `/v3/domains` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:54.407541 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa83f08-e265-40a2-b689-1934b71c7ddc None admin] RBAC: Adding query filter params (name=Default) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:22:54.407851 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa83f08-e265-40a2-b689-1934b71c7ddc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:22:54.409227 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa83f08-e265-40a2-b689-1934b71c7ddc None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:22:54.419866 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 399/816] 10.222.0.23 () {56 vars in 1109 bytes} [Tue May 10 05:22:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:22:54.420682 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa83f08-e265-40a2-b689-1934b71c7ddc None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:22:54.448513 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d583c5-908c-4947-905a-2c790ad7031b None admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:22:54.480131 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e3f21f-590e-42b4-a541-5bea9d6db2cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:22:54.480931 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e3f21f-590e-42b4-a541-5bea9d6db2cb None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:54.481210 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e3f21f-590e-42b4-a541-5bea9d6db2cb None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:54.481472 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e3f21f-590e-42b4-a541-5bea9d6db2cb None admin] PATH_INFO: `/v3/projects/service` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:54.488094 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e3f21f-590e-42b4-a541-5bea9d6db2cb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:22:54.489604 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e3f21f-590e-42b4-a541-5bea9d6db2cb None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:22:54.503528 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application [None req-b6e3f21f-590e-42b4-a541-5bea9d6db2cb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 05:22:54.503528 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 05:22:54.503528 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 05:22:54.503528 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 05:22:54.503528 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 05:22:54.503528 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 05:22:54.503528 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 05:22:54.503528 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 05:22:54.503528 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 05:22:54.503528 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 05:22:54.503528 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 05:22:54.503528 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 05:22:54.503528 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 05:22:54.503528 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 05:22:54.503528 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 05:22:54.504423 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 05:22:54.504423 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 05:22:54.504423 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 05:22:54.504423 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 05:22:54.504423 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 05:22:54.504423 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 05:22:54.504423 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.get_or_create( May 10 05:22:54.504423 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 05:22:54.504423 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application with Lock( May 10 05:22:54.504423 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 05:22:54.504423 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self._enter() May 10 05:22:54.504423 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 05:22:54.504423 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 05:22:54.504423 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 05:22:54.504423 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.creator() May 10 05:22:54.504423 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 05:22:54.504423 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application created_value = creator( May 10 05:22:54.505311 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 05:22:54.505311 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 05:22:54.505311 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 05:22:54.505311 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 05:22:54.505311 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 05:22:54.505311 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 05:22:54.505311 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 05:22:54.505311 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application May 10 05:22:54.505311 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 418/817] 10.222.0.23 () {56 vars in 1111 bytes} [Tue May 10 05:22:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 05:22:54.505911 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e3f21f-590e-42b4-a541-5bea9d6db2cb None admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:22:54.518648 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa83f08-e265-40a2-b689-1934b71c7ddc None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:22:54.550869 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1990e8-a93f-4c3c-8191-94f26a5ba301 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:22:54.551526 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1990e8-a93f-4c3c-8191-94f26a5ba301 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:54.551842 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1990e8-a93f-4c3c-8191-94f26a5ba301 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:54.552120 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1990e8-a93f-4c3c-8191-94f26a5ba301 None admin] PATH_INFO: `/v3/domains` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:54.552850 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1990e8-a93f-4c3c-8191-94f26a5ba301 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:22:54.553167 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1990e8-a93f-4c3c-8191-94f26a5ba301 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:22:54.554540 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1990e8-a93f-4c3c-8191-94f26a5ba301 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:22:54.565821 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 400/818] 10.222.0.23 () {56 vars in 1109 bytes} [Tue May 10 05:22:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:22:54.566633 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1990e8-a93f-4c3c-8191-94f26a5ba301 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:22:54.598868 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e3f21f-590e-42b4-a541-5bea9d6db2cb None admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:22:54.632911 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ea8b23-ee56-473c-a7f3-5990a14be3ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:22:54.633785 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ea8b23-ee56-473c-a7f3-5990a14be3ef None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:54.634067 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ea8b23-ee56-473c-a7f3-5990a14be3ef None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:54.634337 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ea8b23-ee56-473c-a7f3-5990a14be3ef None admin] PATH_INFO: `/v3/services/network` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:54.634993 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ea8b23-ee56-473c-a7f3-5990a14be3ef None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:22:54.636395 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ea8b23-ee56-473c-a7f3-5990a14be3ef None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:22:54.648077 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application [None req-f3ea8b23-ee56-473c-a7f3-5990a14be3ef None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 10 05:22:54.648077 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 05:22:54.648077 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 10 05:22:54.648077 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 10 05:22:54.648077 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 10 05:22:54.648077 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 10 05:22:54.648077 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 10 05:22:54.648077 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 05:22:54.648077 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 10 05:22:54.648077 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application May 10 05:22:54.648077 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 05:22:54.648077 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application May 10 05:22:54.648077 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 05:22:54.648077 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 05:22:54.648077 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 05:22:54.648077 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 05:22:54.648077 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 05:22:54.649143 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 05:22:54.649143 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 05:22:54.649143 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 05:22:54.649143 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 05:22:54.649143 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 05:22:54.649143 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 05:22:54.649143 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 10 05:22:54.649143 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self._get_service(service_id) May 10 05:22:54.649143 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 10 05:22:54.649143 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 10 05:22:54.649143 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 05:22:54.649143 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 05:22:54.649143 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 05:22:54.649143 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 05:22:54.649143 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 05:22:54.649143 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.get_or_create( May 10 05:22:54.649985 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 05:22:54.649985 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application with Lock( May 10 05:22:54.649985 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 05:22:54.649985 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self._enter() May 10 05:22:54.649985 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 05:22:54.649985 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 05:22:54.649985 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 05:22:54.649985 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.creator() May 10 05:22:54.649985 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 05:22:54.649985 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application created_value = creator( May 10 05:22:54.649985 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 10 05:22:54.649985 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 05:22:54.649985 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 10 05:22:54.649985 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application May 10 05:22:54.649985 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 419/819] 10.222.0.23 () {56 vars in 1111 bytes} [Tue May 10 05:22:54 2022] GET /identity/v3/services/network => generated 88 bytes in 144 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 05:22:54.650807 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ea8b23-ee56-473c-a7f3-5990a14be3ef None admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:22:54.664412 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1990e8-a93f-4c3c-8191-94f26a5ba301 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:22:54.698475 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5053c052-900c-419a-837e-9cf48eae3f7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:22:54.699133 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5053c052-900c-419a-837e-9cf48eae3f7b None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:54.699415 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5053c052-900c-419a-837e-9cf48eae3f7b None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:54.699724 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5053c052-900c-419a-837e-9cf48eae3f7b None admin] PATH_INFO: `/v3/services` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:54.700438 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5053c052-900c-419a-837e-9cf48eae3f7b None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:22:54.700736 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5053c052-900c-419a-837e-9cf48eae3f7b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:22:54.702106 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5053c052-900c-419a-837e-9cf48eae3f7b None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:22:54.707409 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 401/820] 10.222.0.23 () {56 vars in 1124 bytes} [Tue May 10 05:22:54 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:22:54.708234 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5053c052-900c-419a-837e-9cf48eae3f7b None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:22:54.747551 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ea8b23-ee56-473c-a7f3-5990a14be3ef None admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:22:54.780020 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28e5bdd-f3c2-4a4b-a072-de2b69f2acc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:22:54.780821 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28e5bdd-f3c2-4a4b-a072-de2b69f2acc8 None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:54.781099 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28e5bdd-f3c2-4a4b-a072-de2b69f2acc8 None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:54.781371 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28e5bdd-f3c2-4a4b-a072-de2b69f2acc8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:54.788195 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28e5bdd-f3c2-4a4b-a072-de2b69f2acc8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:22:54.789642 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28e5bdd-f3c2-4a4b-a072-de2b69f2acc8 None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:22:54.799980 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5053c052-900c-419a-837e-9cf48eae3f7b None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:22:54.803675 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application [None req-c28e5bdd-f3c2-4a4b-a072-de2b69f2acc8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 05:22:54.803675 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 05:22:54.803675 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 05:22:54.803675 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 05:22:54.803675 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 05:22:54.803675 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 05:22:54.803675 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 05:22:54.803675 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 05:22:54.803675 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 05:22:54.803675 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 05:22:54.803675 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 05:22:54.803675 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 05:22:54.803675 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 05:22:54.803675 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 05:22:54.803675 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 05:22:54.804596 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 05:22:54.804596 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 05:22:54.804596 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 05:22:54.804596 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 05:22:54.804596 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 05:22:54.804596 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 05:22:54.804596 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.get_or_create( May 10 05:22:54.804596 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 05:22:54.804596 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application with Lock( May 10 05:22:54.804596 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 05:22:54.804596 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self._enter() May 10 05:22:54.804596 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 05:22:54.804596 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 05:22:54.804596 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 05:22:54.804596 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.creator() May 10 05:22:54.804596 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 05:22:54.804596 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application created_value = creator( May 10 05:22:54.805491 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 05:22:54.805491 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 05:22:54.805491 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 05:22:54.805491 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 05:22:54.805491 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 05:22:54.805491 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 05:22:54.805491 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 05:22:54.805491 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application May 10 05:22:54.805491 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 420/821] 10.222.0.23 () {56 vars in 1111 bytes} [Tue May 10 05:22:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 05:22:54.805974 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28e5bdd-f3c2-4a4b-a072-de2b69f2acc8 None admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:22:54.831907 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6e8757-373d-41f3-9b0b-9c898df93081 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:22:54.832566 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6e8757-373d-41f3-9b0b-9c898df93081 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:54.832844 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6e8757-373d-41f3-9b0b-9c898df93081 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:54.833111 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6e8757-373d-41f3-9b0b-9c898df93081 None admin] PATH_INFO: `/v3/projects` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:54.833899 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6e8757-373d-41f3-9b0b-9c898df93081 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:22:54.834199 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6e8757-373d-41f3-9b0b-9c898df93081 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:22:54.835644 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6e8757-373d-41f3-9b0b-9c898df93081 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:22:54.846579 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 402/822] 10.222.0.23 () {56 vars in 1148 bytes} [Tue May 10 05:22:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:22:54.847373 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6e8757-373d-41f3-9b0b-9c898df93081 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:22:54.904842 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28e5bdd-f3c2-4a4b-a072-de2b69f2acc8 None admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:22:54.938388 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d116ecd1-e07b-4a8f-b94e-649ee59e89aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:22:54.939192 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d116ecd1-e07b-4a8f-b94e-649ee59e89aa None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:54.939469 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d116ecd1-e07b-4a8f-b94e-649ee59e89aa None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:54.939775 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d116ecd1-e07b-4a8f-b94e-649ee59e89aa None admin] PATH_INFO: `/v3/projects/service` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:54.942625 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6e8757-373d-41f3-9b0b-9c898df93081 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:22:54.946471 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d116ecd1-e07b-4a8f-b94e-649ee59e89aa None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:22:54.947947 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d116ecd1-e07b-4a8f-b94e-649ee59e89aa None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:22:54.961348 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application [None req-d116ecd1-e07b-4a8f-b94e-649ee59e89aa None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 05:22:54.961348 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 05:22:54.961348 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 05:22:54.961348 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 05:22:54.961348 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 05:22:54.961348 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 05:22:54.961348 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 05:22:54.961348 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 05:22:54.961348 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 05:22:54.961348 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 05:22:54.961348 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 05:22:54.961348 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 05:22:54.961348 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 05:22:54.961348 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 05:22:54.961348 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 05:22:54.962243 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 05:22:54.962243 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 05:22:54.962243 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 05:22:54.962243 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 05:22:54.962243 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 05:22:54.962243 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 05:22:54.962243 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.get_or_create( May 10 05:22:54.962243 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 05:22:54.962243 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application with Lock( May 10 05:22:54.962243 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 05:22:54.962243 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self._enter() May 10 05:22:54.962243 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 05:22:54.962243 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 05:22:54.962243 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 05:22:54.962243 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.creator() May 10 05:22:54.962243 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 05:22:54.962243 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application created_value = creator( May 10 05:22:54.963134 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 05:22:54.963134 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 05:22:54.963134 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 05:22:54.963134 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 05:22:54.963134 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 05:22:54.963134 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 05:22:54.963134 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 05:22:54.963134 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application May 10 05:22:54.963134 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 421/823] 10.222.0.23 () {56 vars in 1111 bytes} [Tue May 10 05:22:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 05:22:54.963654 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d116ecd1-e07b-4a8f-b94e-649ee59e89aa None admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:22:54.974508 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38010dd5-85ae-40a4-a68d-a51185a245f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:22:54.975154 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38010dd5-85ae-40a4-a68d-a51185a245f0 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:54.975428 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38010dd5-85ae-40a4-a68d-a51185a245f0 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:54.975732 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38010dd5-85ae-40a4-a68d-a51185a245f0 None admin] PATH_INFO: `/v3/services` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:54.976445 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38010dd5-85ae-40a4-a68d-a51185a245f0 None admin] RBAC: Adding query filter params (name=network) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:22:54.976749 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38010dd5-85ae-40a4-a68d-a51185a245f0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:22:54.978113 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38010dd5-85ae-40a4-a68d-a51185a245f0 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:22:54.982631 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 403/824] 10.222.0.23 () {56 vars in 1112 bytes} [Tue May 10 05:22:54 2022] GET /identity/v3/services?name=network => generated 124 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:22:54.983386 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38010dd5-85ae-40a4-a68d-a51185a245f0 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:22:55.059823 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d116ecd1-e07b-4a8f-b94e-649ee59e89aa None admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:22:55.076721 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38010dd5-85ae-40a4-a68d-a51185a245f0 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:22:55.090303 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6cdcb1-5a34-45ac-b1fc-edcdd4cb5b56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:22:55.090959 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6cdcb1-5a34-45ac-b1fc-edcdd4cb5b56 None admin] REQUEST_METHOD: `POST` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:55.091249 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6cdcb1-5a34-45ac-b1fc-edcdd4cb5b56 None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:55.091516 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6cdcb1-5a34-45ac-b1fc-edcdd4cb5b56 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:55.092291 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6cdcb1-5a34-45ac-b1fc-edcdd4cb5b56 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:22:55.093676 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6cdcb1-5a34-45ac-b1fc-edcdd4cb5b56 None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:22:55.109908 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd2641e-99f5-4439-b13d-d2332556d1de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:22:55.110790 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd2641e-99f5-4439-b13d-d2332556d1de None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:55.111066 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd2641e-99f5-4439-b13d-d2332556d1de None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:55.111334 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd2641e-99f5-4439-b13d-d2332556d1de None admin] PATH_INFO: `/v3/projects` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:55.112152 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd2641e-99f5-4439-b13d-d2332556d1de None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:22:55.112453 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd2641e-99f5-4439-b13d-d2332556d1de None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:22:55.113107 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 422/825] 10.222.0.23 () {60 vars in 1144 bytes} [Tue May 10 05:22:54 2022] POST /identity/v3/endpoints => generated 346 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 05:22:55.113908 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6cdcb1-5a34-45ac-b1fc-edcdd4cb5b56 None admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:22:55.114020 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd2641e-99f5-4439-b13d-d2332556d1de None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:22:55.129296 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 404/826] 10.222.0.23 () {56 vars in 1148 bytes} [Tue May 10 05:22:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:22:55.130220 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd2641e-99f5-4439-b13d-d2332556d1de None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:22:55.231175 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6cdcb1-5a34-45ac-b1fc-edcdd4cb5b56 None admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:22:55.237308 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd2641e-99f5-4439-b13d-d2332556d1de None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:22:55.271442 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b19c0e7-864e-489c-82c1-1f1faf938987 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:22:55.272481 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b19c0e7-864e-489c-82c1-1f1faf938987 None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:55.272624 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbfd939-92a9-4a82-ab6b-48e1e17837bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:22:55.273064 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b19c0e7-864e-489c-82c1-1f1faf938987 None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:55.273179 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbfd939-92a9-4a82-ab6b-48e1e17837bd None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:55.273455 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbfd939-92a9-4a82-ab6b-48e1e17837bd None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:55.273728 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbfd939-92a9-4a82-ab6b-48e1e17837bd None admin] PATH_INFO: `/v3/projects` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:55.273861 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b19c0e7-864e-489c-82c1-1f1faf938987 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:55.274529 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebbfd939-92a9-4a82-ab6b-48e1e17837bd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:22:55.274834 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebbfd939-92a9-4a82-ab6b-48e1e17837bd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:22:55.275234 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b19c0e7-864e-489c-82c1-1f1faf938987 None admin] RBAC: Adding query filter params (role.id=199ac1dd842441d7913c6ee89d8fbecc, scope.project.id=5f23435f783540199d6dcfd0417c090e, user.id=7f50f224ca944983aecfde86375473da) {{(pid=79879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:22:55.275740 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b19c0e7-864e-489c-82c1-1f1faf938987 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:22:55.276313 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebbfd939-92a9-4a82-ab6b-48e1e17837bd None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:22:55.277578 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b19c0e7-864e-489c-82c1-1f1faf938987 None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:22:55.286548 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 423/827] 10.222.0.23 () {56 vars in 1374 bytes} [Tue May 10 05:22:55 2022] GET /identity/v3/role_assignments?user.id=7f50f224ca944983aecfde86375473da&scope.project.id=5f23435f783540199d6dcfd0417c090e&role.id=199ac1dd842441d7913c6ee89d8fbecc => generated 608 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:22:55.287798 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b19c0e7-864e-489c-82c1-1f1faf938987 None admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:22:55.289196 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 405/828] 10.222.0.23 () {56 vars in 1148 bytes} [Tue May 10 05:22:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:22:55.290085 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbfd939-92a9-4a82-ab6b-48e1e17837bd None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:22:55.418199 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b19c0e7-864e-489c-82c1-1f1faf938987 None admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:22:55.422079 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbfd939-92a9-4a82-ab6b-48e1e17837bd None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:22:55.457369 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28feaf85-2a2e-4484-8116-39332270230d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:22:55.458415 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28feaf85-2a2e-4484-8116-39332270230d None admin] REQUEST_METHOD: `PUT` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:55.458774 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28feaf85-2a2e-4484-8116-39332270230d None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:55.459120 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28feaf85-2a2e-4484-8116-39332270230d None admin] PATH_INFO: `/v3/projects/5f23435f783540199d6dcfd0417c090e/users/fd31dacf30804395bd029037b407c12a/roles/199ac1dd842441d7913c6ee89d8fbecc` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:55.461357 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28feaf85-2a2e-4484-8116-39332270230d None admin] RBAC: Authorizing `identity:create_grant(project_id=5f23435f783540199d6dcfd0417c090e, user_id=fd31dacf30804395bd029037b407c12a, role_id=199ac1dd842441d7913c6ee89d8fbecc)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:22:55.463851 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28feaf85-2a2e-4484-8116-39332270230d None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:22:55.464123 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9a4645-d8be-4813-8366-376f8846e0ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:22:55.464989 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9a4645-d8be-4813-8366-376f8846e0ff None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:55.465412 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9a4645-d8be-4813-8366-376f8846e0ff None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:55.465826 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9a4645-d8be-4813-8366-376f8846e0ff None admin] PATH_INFO: `/v3/services` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:55.466696 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9a4645-d8be-4813-8366-376f8846e0ff None admin] RBAC: Adding query filter params (type=network) {{(pid=79879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:22:55.467148 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9a4645-d8be-4813-8366-376f8846e0ff None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:22:55.470085 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9a4645-d8be-4813-8366-376f8846e0ff None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:22:55.482122 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 424/829] 10.222.0.23 () {56 vars in 1112 bytes} [Tue May 10 05:22:55 2022] GET /identity/v3/services?type=network => generated 350 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:22:55.482122 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9a4645-d8be-4813-8366-376f8846e0ff None admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:22:55.490183 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 406/830] 10.222.0.23 () {58 vars in 1439 bytes} [Tue May 10 05:22:55 2022] PUT /identity/v3/projects/5f23435f783540199d6dcfd0417c090e/users/fd31dacf30804395bd029037b407c12a/roles/199ac1dd842441d7913c6ee89d8fbecc => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 05:22:55.491231 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28feaf85-2a2e-4484-8116-39332270230d None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:22:55.620769 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9a4645-d8be-4813-8366-376f8846e0ff None admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:22:55.635313 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28feaf85-2a2e-4484-8116-39332270230d None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:22:55.667635 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3e7c74-3f01-418a-858d-9233c5be5549 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:22:55.669374 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3e7c74-3f01-418a-858d-9233c5be5549 None admin] REQUEST_METHOD: `PUT` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:55.669945 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3e7c74-3f01-418a-858d-9233c5be5549 None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:55.670396 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3e7c74-3f01-418a-858d-9233c5be5549 None admin] PATH_INFO: `/v3/projects/5f23435f783540199d6dcfd0417c090e/users/c5281b2a1c9a461995653be826207db4/roles/8a02b9040d1d4fccababc1eb4dac80e7` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:55.673297 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b046998d-d212-40de-9852-866f6987f489 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:22:55.674087 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b046998d-d212-40de-9852-866f6987f489 None admin] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:55.674433 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b046998d-d212-40de-9852-866f6987f489 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:55.674774 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b046998d-d212-40de-9852-866f6987f489 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:55.676170 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b046998d-d212-40de-9852-866f6987f489 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:22:55.677255 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b046998d-d212-40de-9852-866f6987f489 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:22:55.690111 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3e7c74-3f01-418a-858d-9233c5be5549 None admin] RBAC: Authorizing `identity:create_grant(project_id=5f23435f783540199d6dcfd0417c090e, user_id=c5281b2a1c9a461995653be826207db4, role_id=8a02b9040d1d4fccababc1eb4dac80e7)` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:22:55.692824 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3e7c74-3f01-418a-858d-9233c5be5549 None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:22:55.705888 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 407/831] 10.222.0.23 () {60 vars in 1144 bytes} [Tue May 10 05:22:55 2022] POST /identity/v3/endpoints => generated 327 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 05:22:55.709725 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 425/832] 10.222.0.23 () {58 vars in 1439 bytes} [Tue May 10 05:22:55 2022] PUT /identity/v3/projects/5f23435f783540199d6dcfd0417c090e/users/c5281b2a1c9a461995653be826207db4/roles/8a02b9040d1d4fccababc1eb4dac80e7 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 05:22:57.500749 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534a71d8-c944-4c39-9748-b8688c3d1a02 None None] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:57.501757 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534a71d8-c944-4c39-9748-b8688c3d1a02 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:57.502233 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534a71d8-c944-4c39-9748-b8688c3d1a02 None None] PATH_INFO: `/` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:57.504243 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 408/833] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 10 05:22:57 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 05:22:57.510303 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca808fb1-e74d-4e3a-9f84-42487bbdb7e9 None None] REQUEST_METHOD: `POST` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:57.511195 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca808fb1-e74d-4e3a-9f84-42487bbdb7e9 None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:57.511733 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca808fb1-e74d-4e3a-9f84-42487bbdb7e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:57.528981 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.auth.core [None req-ca808fb1-e74d-4e3a-9f84-42487bbdb7e9 None None] MFA Rules not processed for user `44883b22532e44049d846938dc2cf423`. Rule list: `[]` (Enabled: `True`). {{(pid=79879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:22:57.530476 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-ca808fb1-e74d-4e3a-9f84-42487bbdb7e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:22:57.607545 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 426/834] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 10 05:22:57 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 05:22:57.630299 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534a71d8-c944-4c39-9748-b8688c3d1a02 None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:22:57.737691 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534a71d8-c944-4c39-9748-b8688c3d1a02 None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:22:57.775844 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52946893-1092-43d6-8d7b-c82b9b7b9091 None None] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:57.776487 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52946893-1092-43d6-8d7b-c82b9b7b9091 None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:57.776907 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8847c158-bd21-43bb-a9d8-85c5c3be6a85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:22:57.777265 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52946893-1092-43d6-8d7b-c82b9b7b9091 None None] PATH_INFO: `/` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:57.777728 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8847c158-bd21-43bb-a9d8-85c5c3be6a85 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:57.778003 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8847c158-bd21-43bb-a9d8-85c5c3be6a85 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:57.778268 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8847c158-bd21-43bb-a9d8-85c5c3be6a85 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:57.778932 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8847c158-bd21-43bb-a9d8-85c5c3be6a85 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:22:57.779952 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 427/835] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 10 05:22:57 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 05:22:57.780331 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8847c158-bd21-43bb-a9d8-85c5c3be6a85 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:22:57.785737 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb539f88-d4ec-40cd-a0de-917422774cd2 None None] REQUEST_METHOD: `POST` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:57.786019 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb539f88-d4ec-40cd-a0de-917422774cd2 None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:57.786295 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb539f88-d4ec-40cd-a0de-917422774cd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:57.796625 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application [None req-8847c158-bd21-43bb-a9d8-85c5c3be6a85 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 10 05:22:57.796625 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 05:22:57.796625 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 10 05:22:57.796625 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 10 05:22:57.796625 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 10 05:22:57.796625 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 10 05:22:57.796625 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 10 05:22:57.796625 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 05:22:57.796625 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 10 05:22:57.796625 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application May 10 05:22:57.796625 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 05:22:57.796625 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application May 10 05:22:57.796625 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 05:22:57.796625 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 05:22:57.796625 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 05:22:57.796625 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 05:22:57.796625 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 05:22:57.797670 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 05:22:57.797670 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 05:22:57.797670 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 05:22:57.797670 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 05:22:57.797670 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 05:22:57.797670 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 05:22:57.797670 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 10 05:22:57.797670 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_service(service_id) May 10 05:22:57.797670 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 10 05:22:57.797670 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 10 05:22:57.797670 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 05:22:57.797670 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 05:22:57.797670 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 05:22:57.797670 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 05:22:57.797670 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 05:22:57.797670 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.get_or_create( May 10 05:22:57.798534 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 05:22:57.798534 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application with Lock( May 10 05:22:57.798534 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 05:22:57.798534 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._enter() May 10 05:22:57.798534 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 05:22:57.798534 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 05:22:57.798534 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 05:22:57.798534 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.creator() May 10 05:22:57.798534 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 05:22:57.798534 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application created_value = creator( May 10 05:22:57.798534 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 10 05:22:57.798534 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 05:22:57.798534 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 10 05:22:57.798534 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application May 10 05:22:57.801464 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 409/836] 10.222.0.23 () {56 vars in 1114 bytes} [Tue May 10 05:22:57 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 05:22:57.805668 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.auth.core [None req-fb539f88-d4ec-40cd-a0de-917422774cd2 None None] MFA Rules not processed for user `44883b22532e44049d846938dc2cf423`. Rule list: `[]` (Enabled: `True`). {{(pid=79879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:22:57.805668 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-fb539f88-d4ec-40cd-a0de-917422774cd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:22:57.807906 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8847c158-bd21-43bb-a9d8-85c5c3be6a85 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:22:57.875622 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 428/837] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 10 05:22:57 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 10 05:22:57.877010 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a74da1a-04b9-4166-af17-d1a9f67e86fc None None] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:57.877258 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a74da1a-04b9-4166-af17-d1a9f67e86fc None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:57.877530 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a74da1a-04b9-4166-af17-d1a9f67e86fc None None] PATH_INFO: `/` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:57.879141 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 429/838] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 10 05:22:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 05:22:57.884623 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607aa87b-1150-4b81-9e20-f5d7a3f358a1 None None] REQUEST_METHOD: `POST` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:57.884902 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607aa87b-1150-4b81-9e20-f5d7a3f358a1 None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:57.885174 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607aa87b-1150-4b81-9e20-f5d7a3f358a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:57.901981 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.auth.core [None req-607aa87b-1150-4b81-9e20-f5d7a3f358a1 None None] MFA Rules not processed for user `44883b22532e44049d846938dc2cf423`. Rule list: `[]` (Enabled: `True`). {{(pid=79879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:22:57.903181 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-607aa87b-1150-4b81-9e20-f5d7a3f358a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:22:57.914135 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8847c158-bd21-43bb-a9d8-85c5c3be6a85 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:22:57.946450 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f21029-7850-48c7-8b5c-29cac512b72f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:22:57.947507 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f21029-7850-48c7-8b5c-29cac512b72f None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:57.947977 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f21029-7850-48c7-8b5c-29cac512b72f None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:57.948255 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f21029-7850-48c7-8b5c-29cac512b72f None admin] PATH_INFO: `/v3/services` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:57.948977 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f21029-7850-48c7-8b5c-29cac512b72f None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:22:57.949287 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f21029-7850-48c7-8b5c-29cac512b72f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:22:57.950655 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f21029-7850-48c7-8b5c-29cac512b72f None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:22:57.959912 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 410/839] 10.222.0.23 () {56 vars in 1114 bytes} [Tue May 10 05:22:57 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 05:22:57.960903 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f21029-7850-48c7-8b5c-29cac512b72f None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:22:57.966527 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 430/840] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 10 05:22:57 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 05:22:57.971175 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607aa87b-1150-4b81-9e20-f5d7a3f358a1 None None] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:22:58.055276 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f21029-7850-48c7-8b5c-29cac512b72f None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:22:58.070409 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607aa87b-1150-4b81-9e20-f5d7a3f358a1 None None] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:22:58.086013 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb330b1-232a-4d2e-85a5-a201fc732a32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:22:58.086812 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb330b1-232a-4d2e-85a5-a201fc732a32 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:58.087092 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb330b1-232a-4d2e-85a5-a201fc732a32 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:58.087365 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb330b1-232a-4d2e-85a5-a201fc732a32 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:58.097729 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb330b1-232a-4d2e-85a5-a201fc732a32 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 05:22:58.101601 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d663f0a3-6649-4932-9380-8932b60e5fcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:22:58.102264 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d663f0a3-6649-4932-9380-8932b60e5fcd None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:58.102587 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d663f0a3-6649-4932-9380-8932b60e5fcd None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:58.102856 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d663f0a3-6649-4932-9380-8932b60e5fcd None admin] PATH_INFO: `/v3/services` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:58.103597 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d663f0a3-6649-4932-9380-8932b60e5fcd None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=79879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:22:58.103903 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d663f0a3-6649-4932-9380-8932b60e5fcd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:22:58.105284 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d663f0a3-6649-4932-9380-8932b60e5fcd None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:22:58.105418 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application [None req-bcb330b1-232a-4d2e-85a5-a201fc732a32 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 10 05:22:58.105418 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 05:22:58.105418 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 05:22:58.105418 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 05:22:58.105418 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 05:22:58.105418 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 05:22:58.105418 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 05:22:58.105418 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 05:22:58.105418 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 05:22:58.105418 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 05:22:58.105418 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 05:22:58.105418 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 05:22:58.105418 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 05:22:58.105418 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 05:22:58.105418 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 05:22:58.105418 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 05:22:58.106420 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 05:22:58.106420 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 05:22:58.106420 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 05:22:58.106420 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 05:22:58.106420 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 05:22:58.106420 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 05:22:58.106420 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 05:22:58.106420 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 05:22:58.106420 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 05:22:58.106420 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.get_or_create( May 10 05:22:58.106420 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 05:22:58.106420 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application with Lock( May 10 05:22:58.106420 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 05:22:58.106420 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._enter() May 10 05:22:58.106420 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 05:22:58.106420 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 05:22:58.107272 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 05:22:58.107272 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.creator() May 10 05:22:58.107272 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 05:22:58.107272 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application created_value = creator( May 10 05:22:58.107272 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 05:22:58.107272 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 05:22:58.107272 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 05:22:58.107272 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 05:22:58.107272 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 05:22:58.107272 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 05:22:58.107272 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 10 05:22:58.107272 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application May 10 05:22:58.107272 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 411/841] 10.222.0.23 () {56 vars in 1096 bytes} [Tue May 10 05:22:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 05:22:58.108104 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb330b1-232a-4d2e-85a5-a201fc732a32 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:22:58.123625 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 431/842] 10.222.0.23 () {56 vars in 1114 bytes} [Tue May 10 05:22:57 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:22:58.123625 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b498c4ab-1724-4183-bd04-f6d217692af9 None None] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:58.123625 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b498c4ab-1724-4183-bd04-f6d217692af9 None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:58.123625 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b498c4ab-1724-4183-bd04-f6d217692af9 None None] PATH_INFO: `/` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:58.123625 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 432/843] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 10 05:22:58 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 05:22:58.123625 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b498c4ab-1724-4183-bd04-f6d217692af9 None None] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:22:58.219198 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb330b1-232a-4d2e-85a5-a201fc732a32 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:22:58.229289 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b498c4ab-1724-4183-bd04-f6d217692af9 None None] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:22:58.256154 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae2790b-f3e9-43d2-91f0-429054cb3d37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:22:58.257014 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae2790b-f3e9-43d2-91f0-429054cb3d37 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:58.257294 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae2790b-f3e9-43d2-91f0-429054cb3d37 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:58.257568 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae2790b-f3e9-43d2-91f0-429054cb3d37 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:58.258251 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae2790b-f3e9-43d2-91f0-429054cb3d37 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:22:58.259754 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae2790b-f3e9-43d2-91f0-429054cb3d37 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:22:58.266442 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797c435e-880a-4a6c-94d2-9ffbdb15fb46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:22:58.267119 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797c435e-880a-4a6c-94d2-9ffbdb15fb46 None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:58.267401 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797c435e-880a-4a6c-94d2-9ffbdb15fb46 None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:58.267721 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797c435e-880a-4a6c-94d2-9ffbdb15fb46 None admin] PATH_INFO: `/v3/roles` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:58.268496 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797c435e-880a-4a6c-94d2-9ffbdb15fb46 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:22:58.268803 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797c435e-880a-4a6c-94d2-9ffbdb15fb46 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:22:58.270317 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797c435e-880a-4a6c-94d2-9ffbdb15fb46 None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:22:58.272657 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application [None req-cae2790b-f3e9-43d2-91f0-429054cb3d37 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 10 05:22:58.272657 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 05:22:58.272657 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 10 05:22:58.272657 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 10 05:22:58.272657 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 10 05:22:58.272657 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 10 05:22:58.272657 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 10 05:22:58.272657 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 05:22:58.272657 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 10 05:22:58.272657 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application May 10 05:22:58.272657 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 05:22:58.272657 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application May 10 05:22:58.272657 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 05:22:58.272657 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 05:22:58.272657 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 05:22:58.272657 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 05:22:58.273627 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 05:22:58.273627 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 05:22:58.273627 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 05:22:58.273627 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 05:22:58.273627 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 05:22:58.273627 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 05:22:58.273627 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 05:22:58.273627 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 10 05:22:58.273627 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_service(service_id) May 10 05:22:58.273627 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 10 05:22:58.273627 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 10 05:22:58.273627 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 05:22:58.273627 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 05:22:58.273627 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 05:22:58.273627 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 05:22:58.273627 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 05:22:58.274775 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.get_or_create( May 10 05:22:58.274775 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 05:22:58.274775 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application with Lock( May 10 05:22:58.274775 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 05:22:58.274775 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._enter() May 10 05:22:58.274775 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 05:22:58.274775 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 05:22:58.274775 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 05:22:58.274775 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.creator() May 10 05:22:58.274775 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 05:22:58.274775 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application created_value = creator( May 10 05:22:58.274775 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 10 05:22:58.274775 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 05:22:58.274775 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 10 05:22:58.274775 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application May 10 05:22:58.274775 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 412/844] 10.222.0.23 () {56 vars in 1132 bytes} [Tue May 10 05:22:58 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 05:22:58.275817 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef0d473-1be0-4634-a236-2f3b90efade3 None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:58.275817 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef0d473-1be0-4634-a236-2f3b90efade3 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:58.276071 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef0d473-1be0-4634-a236-2f3b90efade3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:58.283078 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 433/845] 10.222.0.23 () {56 vars in 1099 bytes} [Tue May 10 05:22:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:22:58.284377 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797c435e-880a-4a6c-94d2-9ffbdb15fb46 None admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:22:58.299978 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-4ef0d473-1be0-4634-a236-2f3b90efade3 None None] MFA Rules not processed for user `44883b22532e44049d846938dc2cf423`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:22:58.301263 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-4ef0d473-1be0-4634-a236-2f3b90efade3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:22:58.370941 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 413/846] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 10 05:22:58 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 05:22:58.372262 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef0d473-1be0-4634-a236-2f3b90efade3 None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:22:58.392914 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797c435e-880a-4a6c-94d2-9ffbdb15fb46 None admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:22:58.426827 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3527ce-a82f-4cc8-909c-5342dcc458f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:22:58.427506 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3527ce-a82f-4cc8-909c-5342dcc458f6 None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:58.427812 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3527ce-a82f-4cc8-909c-5342dcc458f6 None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:58.428081 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3527ce-a82f-4cc8-909c-5342dcc458f6 None admin] PATH_INFO: `/v3/services` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:58.428797 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3527ce-a82f-4cc8-909c-5342dcc458f6 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=79879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:22:58.429099 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3527ce-a82f-4cc8-909c-5342dcc458f6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:22:58.430478 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3527ce-a82f-4cc8-909c-5342dcc458f6 None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:22:58.439280 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 434/847] 10.222.0.23 () {56 vars in 1126 bytes} [Tue May 10 05:22:58 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:22:58.439280 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3527ce-a82f-4cc8-909c-5342dcc458f6 None admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:22:58.478041 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef0d473-1be0-4634-a236-2f3b90efade3 None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:22:58.511266 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5efd11-d2b0-43ca-bd21-31197b92a392 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:22:58.512092 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5efd11-d2b0-43ca-bd21-31197b92a392 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:58.512366 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5efd11-d2b0-43ca-bd21-31197b92a392 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:58.512633 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5efd11-d2b0-43ca-bd21-31197b92a392 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:58.523033 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5efd11-d2b0-43ca-bd21-31197b92a392 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:22:58.524533 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5efd11-d2b0-43ca-bd21-31197b92a392 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:22:58.535331 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3527ce-a82f-4cc8-909c-5342dcc458f6 None admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:22:58.541697 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application [None req-8a5efd11-d2b0-43ca-bd21-31197b92a392 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 05:22:58.541697 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 05:22:58.541697 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 05:22:58.541697 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 05:22:58.541697 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 05:22:58.541697 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 05:22:58.541697 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 05:22:58.541697 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 05:22:58.541697 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 05:22:58.541697 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 05:22:58.541697 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 05:22:58.541697 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 05:22:58.541697 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 05:22:58.541697 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 05:22:58.541697 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 05:22:58.542561 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 05:22:58.542561 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 05:22:58.542561 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 05:22:58.542561 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 05:22:58.542561 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 05:22:58.542561 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 05:22:58.542561 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.get_or_create( May 10 05:22:58.542561 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 05:22:58.542561 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application with Lock( May 10 05:22:58.542561 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 05:22:58.542561 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._enter() May 10 05:22:58.542561 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 05:22:58.542561 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 05:22:58.542561 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 05:22:58.542561 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.creator() May 10 05:22:58.542561 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 05:22:58.542561 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application created_value = creator( May 10 05:22:58.548636 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 05:22:58.548636 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 05:22:58.548636 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 05:22:58.548636 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application May 10 05:22:58.548636 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 414/848] 10.222.0.23 () {56 vars in 1108 bytes} [Tue May 10 05:22:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 05:22:58.548636 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5efd11-d2b0-43ca-bd21-31197b92a392 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:22:58.568236 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8128a257-e5f7-4082-a0d0-c2f518ffc2b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:22:58.569172 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8128a257-e5f7-4082-a0d0-c2f518ffc2b0 None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:58.569458 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8128a257-e5f7-4082-a0d0-c2f518ffc2b0 None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:58.569728 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8128a257-e5f7-4082-a0d0-c2f518ffc2b0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:58.579614 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8128a257-e5f7-4082-a0d0-c2f518ffc2b0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 05:22:58.587187 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application [None req-8128a257-e5f7-4082-a0d0-c2f518ffc2b0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 10 05:22:58.587187 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 05:22:58.587187 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 05:22:58.587187 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 05:22:58.587187 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 05:22:58.587187 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 05:22:58.587187 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 05:22:58.587187 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 05:22:58.587187 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 05:22:58.587187 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 05:22:58.587187 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 05:22:58.587187 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 05:22:58.587187 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 05:22:58.587187 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 05:22:58.587187 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 05:22:58.587187 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 05:22:58.588327 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 05:22:58.588327 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 05:22:58.588327 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 05:22:58.588327 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 05:22:58.588327 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 05:22:58.588327 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 05:22:58.588327 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 05:22:58.588327 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 05:22:58.588327 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 05:22:58.588327 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.get_or_create( May 10 05:22:58.588327 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 05:22:58.588327 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application with Lock( May 10 05:22:58.588327 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 05:22:58.588327 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self._enter() May 10 05:22:58.588327 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 05:22:58.588327 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 05:22:58.594322 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 05:22:58.594322 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.creator() May 10 05:22:58.594322 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 05:22:58.594322 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application created_value = creator( May 10 05:22:58.594322 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 05:22:58.594322 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 05:22:58.594322 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 05:22:58.594322 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 05:22:58.594322 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 05:22:58.594322 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 05:22:58.594322 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 10 05:22:58.594322 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application May 10 05:22:58.594322 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 435/849] 10.222.0.23 () {56 vars in 1102 bytes} [Tue May 10 05:22:58 2022] GET /identity/v3/roles/service => generated 85 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 05:22:58.594322 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8128a257-e5f7-4082-a0d0-c2f518ffc2b0 None admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:22:58.638145 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5efd11-d2b0-43ca-bd21-31197b92a392 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:22:58.670696 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd17cb8-3be0-4284-a210-621fdb5f43e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:22:58.671368 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd17cb8-3be0-4284-a210-621fdb5f43e2 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:58.671684 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd17cb8-3be0-4284-a210-621fdb5f43e2 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:58.671957 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd17cb8-3be0-4284-a210-621fdb5f43e2 None admin] PATH_INFO: `/v3/services` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:58.672672 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd17cb8-3be0-4284-a210-621fdb5f43e2 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:22:58.672979 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd17cb8-3be0-4284-a210-621fdb5f43e2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:22:58.674338 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd17cb8-3be0-4284-a210-621fdb5f43e2 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:22:58.678668 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 415/850] 10.222.0.23 () {56 vars in 1126 bytes} [Tue May 10 05:22:58 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:22:58.679444 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd17cb8-3be0-4284-a210-621fdb5f43e2 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:22:58.686070 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8128a257-e5f7-4082-a0d0-c2f518ffc2b0 None admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:22:58.722348 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82829e34-7502-4df7-a835-c2c1e2a4ed2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:22:58.723494 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82829e34-7502-4df7-a835-c2c1e2a4ed2e None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:58.723984 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82829e34-7502-4df7-a835-c2c1e2a4ed2e None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:58.724432 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82829e34-7502-4df7-a835-c2c1e2a4ed2e None admin] PATH_INFO: `/v3/domains` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:58.725364 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82829e34-7502-4df7-a835-c2c1e2a4ed2e None admin] RBAC: Adding query filter params (name=Default) {{(pid=79879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:22:58.725890 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82829e34-7502-4df7-a835-c2c1e2a4ed2e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:22:58.727479 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82829e34-7502-4df7-a835-c2c1e2a4ed2e None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:22:58.740878 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 436/851] 10.222.0.23 () {56 vars in 1109 bytes} [Tue May 10 05:22:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:22:58.752955 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82829e34-7502-4df7-a835-c2c1e2a4ed2e None admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:22:58.793592 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd17cb8-3be0-4284-a210-621fdb5f43e2 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:22:58.829909 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49a948d-dc36-4241-9490-76b22c5a1c62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:22:58.830608 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49a948d-dc36-4241-9490-76b22c5a1c62 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:58.830886 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49a948d-dc36-4241-9490-76b22c5a1c62 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:58.831157 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49a948d-dc36-4241-9490-76b22c5a1c62 None admin] PATH_INFO: `/v3/roles` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:58.832010 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49a948d-dc36-4241-9490-76b22c5a1c62 None admin] RBAC: Adding query filter params (name=service) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:22:58.832316 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49a948d-dc36-4241-9490-76b22c5a1c62 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:22:58.834286 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49a948d-dc36-4241-9490-76b22c5a1c62 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:22:58.848064 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 416/852] 10.222.0.23 () {56 vars in 1103 bytes} [Tue May 10 05:22:58 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:22:58.856925 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49a948d-dc36-4241-9490-76b22c5a1c62 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:22:58.868166 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82829e34-7502-4df7-a835-c2c1e2a4ed2e None admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:22:58.917238 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d216c6f6-8ccf-40f1-9214-d2e0ea088801 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:22:58.918979 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d216c6f6-8ccf-40f1-9214-d2e0ea088801 None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:58.919565 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d216c6f6-8ccf-40f1-9214-d2e0ea088801 None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:58.920058 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d216c6f6-8ccf-40f1-9214-d2e0ea088801 None admin] PATH_INFO: `/v3/users/swift` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:58.930001 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d216c6f6-8ccf-40f1-9214-d2e0ea088801 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:22:58.931879 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d216c6f6-8ccf-40f1-9214-d2e0ea088801 None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:22:58.950643 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application [None req-d216c6f6-8ccf-40f1-9214-d2e0ea088801 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 10 05:22:58.950643 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 05:22:58.950643 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 05:22:58.950643 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 05:22:58.950643 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 05:22:58.950643 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 05:22:58.950643 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 05:22:58.950643 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 05:22:58.950643 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 05:22:58.950643 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 05:22:58.950643 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 05:22:58.950643 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 05:22:58.950643 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 05:22:58.950643 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 05:22:58.950643 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 05:22:58.950643 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 05:22:58.951668 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 05:22:58.951668 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 05:22:58.951668 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 05:22:58.951668 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 05:22:58.951668 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 05:22:58.951668 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 05:22:58.951668 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 05:22:58.951668 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 05:22:58.951668 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 05:22:58.951668 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.get_or_create( May 10 05:22:58.951668 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 05:22:58.951668 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application with Lock( May 10 05:22:58.951668 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 05:22:58.951668 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self._enter() May 10 05:22:58.951668 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 05:22:58.951668 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 05:22:58.951668 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 05:22:58.951668 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.creator() May 10 05:22:58.952613 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 05:22:58.952613 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application created_value = creator( May 10 05:22:58.952613 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 05:22:58.952613 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 05:22:58.952613 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 05:22:58.952613 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 05:22:58.952613 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 05:22:58.952613 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 05:22:58.952613 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 10 05:22:58.952613 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application May 10 05:22:58.953765 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 437/853] 10.222.0.23 () {56 vars in 1096 bytes} [Tue May 10 05:22:58 2022] GET /identity/v3/users/swift => generated 83 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 05:22:58.958833 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d216c6f6-8ccf-40f1-9214-d2e0ea088801 None admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:22:58.971904 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49a948d-dc36-4241-9490-76b22c5a1c62 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:22:59.005348 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b7fd87-f6df-4972-888a-56f322435172 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:22:59.006541 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b7fd87-f6df-4972-888a-56f322435172 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:59.007067 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b7fd87-f6df-4972-888a-56f322435172 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:59.007593 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b7fd87-f6df-4972-888a-56f322435172 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:59.018212 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b7fd87-f6df-4972-888a-56f322435172 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:22:59.020050 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b7fd87-f6df-4972-888a-56f322435172 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:22:59.036757 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application [None req-96b7fd87-f6df-4972-888a-56f322435172 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 05:22:59.036757 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 05:22:59.036757 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 05:22:59.036757 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 05:22:59.036757 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 05:22:59.036757 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 05:22:59.036757 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 05:22:59.036757 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 05:22:59.036757 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 05:22:59.036757 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 05:22:59.036757 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 05:22:59.036757 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 05:22:59.036757 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 05:22:59.036757 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 05:22:59.036757 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 05:22:59.037671 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 05:22:59.037671 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 05:22:59.037671 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 05:22:59.037671 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 05:22:59.037671 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 05:22:59.037671 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 05:22:59.037671 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.get_or_create( May 10 05:22:59.037671 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 05:22:59.037671 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application with Lock( May 10 05:22:59.037671 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 05:22:59.037671 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._enter() May 10 05:22:59.037671 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 05:22:59.037671 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 05:22:59.037671 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 05:22:59.037671 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.creator() May 10 05:22:59.037671 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 05:22:59.037671 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application created_value = creator( May 10 05:22:59.038564 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 05:22:59.038564 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 05:22:59.038564 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 05:22:59.038564 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application May 10 05:22:59.040795 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 417/854] 10.222.0.23 () {56 vars in 1108 bytes} [Tue May 10 05:22:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 05:22:59.046281 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b7fd87-f6df-4972-888a-56f322435172 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:22:59.060641 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d216c6f6-8ccf-40f1-9214-d2e0ea088801 None admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:22:59.095427 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4a7001-b479-4c51-a06b-04541c936e26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:22:59.096207 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4a7001-b479-4c51-a06b-04541c936e26 None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:59.096527 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4a7001-b479-4c51-a06b-04541c936e26 None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:59.096795 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4a7001-b479-4c51-a06b-04541c936e26 None admin] PATH_INFO: `/v3/users` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:59.097678 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4a7001-b479-4c51-a06b-04541c936e26 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:22:59.097984 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4a7001-b479-4c51-a06b-04541c936e26 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:22:59.099475 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4a7001-b479-4c51-a06b-04541c936e26 None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:22:59.121843 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 438/855] 10.222.0.23 () {56 vars in 1135 bytes} [Tue May 10 05:22:58 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 05:22:59.122700 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4a7001-b479-4c51-a06b-04541c936e26 None admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:22:59.146082 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b7fd87-f6df-4972-888a-56f322435172 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:22:59.178944 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84a988f-c92d-4c92-b665-063a1abe1728 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:22:59.180000 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84a988f-c92d-4c92-b665-063a1abe1728 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:59.180502 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84a988f-c92d-4c92-b665-063a1abe1728 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:59.180994 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84a988f-c92d-4c92-b665-063a1abe1728 None admin] PATH_INFO: `/v3/domains` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:59.181913 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84a988f-c92d-4c92-b665-063a1abe1728 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:22:59.182406 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84a988f-c92d-4c92-b665-063a1abe1728 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:22:59.184002 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84a988f-c92d-4c92-b665-063a1abe1728 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:22:59.201566 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 418/856] 10.222.0.23 () {56 vars in 1109 bytes} [Tue May 10 05:22:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 05:22:59.202791 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84a988f-c92d-4c92-b665-063a1abe1728 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:22:59.225540 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4a7001-b479-4c51-a06b-04541c936e26 None admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:22:59.262292 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae24a501-2970-4ff5-b8b8-be2d109239e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:22:59.262999 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae24a501-2970-4ff5-b8b8-be2d109239e7 None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:59.263275 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae24a501-2970-4ff5-b8b8-be2d109239e7 None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:59.263614 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae24a501-2970-4ff5-b8b8-be2d109239e7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:59.304281 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84a988f-c92d-4c92-b665-063a1abe1728 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:22:59.336259 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbbe8bb-cbfb-4df8-8325-568aa8e15880 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:22:59.337077 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbbe8bb-cbfb-4df8-8325-568aa8e15880 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:59.337356 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbbe8bb-cbfb-4df8-8325-568aa8e15880 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:59.337619 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbbe8bb-cbfb-4df8-8325-568aa8e15880 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:59.338029 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae24a501-2970-4ff5-b8b8-be2d109239e7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:22:59.340057 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae24a501-2970-4ff5-b8b8-be2d109239e7 None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:22:59.345078 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbbe8bb-cbfb-4df8-8325-568aa8e15880 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:22:59.346619 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbbe8bb-cbfb-4df8-8325-568aa8e15880 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:22:59.361446 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application [None req-dfbbe8bb-cbfb-4df8-8325-568aa8e15880 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 10 05:22:59.361446 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 05:22:59.361446 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 05:22:59.361446 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 05:22:59.361446 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 05:22:59.361446 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 05:22:59.361446 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 05:22:59.361446 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 05:22:59.361446 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 05:22:59.361446 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 05:22:59.361446 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 05:22:59.361446 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 05:22:59.361446 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 05:22:59.361446 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 05:22:59.361446 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 05:22:59.361446 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 05:22:59.362449 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 05:22:59.362449 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 05:22:59.362449 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 05:22:59.362449 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 05:22:59.362449 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 05:22:59.362449 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 05:22:59.362449 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 05:22:59.362449 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 05:22:59.362449 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 05:22:59.362449 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.get_or_create( May 10 05:22:59.362449 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 05:22:59.362449 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application with Lock( May 10 05:22:59.362449 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 05:22:59.362449 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._enter() May 10 05:22:59.362449 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 05:22:59.362449 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 05:22:59.362449 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 05:22:59.362449 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.creator() May 10 05:22:59.363428 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 05:22:59.363428 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application created_value = creator( May 10 05:22:59.363428 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 05:22:59.363428 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 05:22:59.363428 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 05:22:59.363428 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 05:22:59.363428 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 05:22:59.363428 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 05:22:59.363428 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 10 05:22:59.363428 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application May 10 05:22:59.367352 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 419/857] 10.222.0.23 () {56 vars in 1117 bytes} [Tue May 10 05:22:59 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 05:22:59.368233 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbbe8bb-cbfb-4df8-8325-568aa8e15880 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:22:59.460247 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 439/858] 10.222.0.23 () {58 vars in 1282 bytes} [Tue May 10 05:22:59 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 10 05:22:59.466143 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae24a501-2970-4ff5-b8b8-be2d109239e7 None admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:22:59.479198 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbbe8bb-cbfb-4df8-8325-568aa8e15880 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:22:59.513533 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f3a019-9d6f-459b-9205-21dcaa443da7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:22:59.514210 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f3a019-9d6f-459b-9205-21dcaa443da7 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:59.514471 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f3a019-9d6f-459b-9205-21dcaa443da7 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:59.514739 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f3a019-9d6f-459b-9205-21dcaa443da7 None admin] PATH_INFO: `/v3/users` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:59.515602 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f3a019-9d6f-459b-9205-21dcaa443da7 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:22:59.515904 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f3a019-9d6f-459b-9205-21dcaa443da7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:22:59.517334 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f3a019-9d6f-459b-9205-21dcaa443da7 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:22:59.539543 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 420/859] 10.222.0.23 () {56 vars in 1149 bytes} [Tue May 10 05:22:59 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:22:59.540623 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f3a019-9d6f-459b-9205-21dcaa443da7 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:22:59.573254 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae24a501-2970-4ff5-b8b8-be2d109239e7 None admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:22:59.605842 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cada27-148d-4617-b946-e820d6910cd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:22:59.606655 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cada27-148d-4617-b946-e820d6910cd0 None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:59.606934 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cada27-148d-4617-b946-e820d6910cd0 None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:59.607206 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cada27-148d-4617-b946-e820d6910cd0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:59.617141 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57cada27-148d-4617-b946-e820d6910cd0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:22:59.618599 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57cada27-148d-4617-b946-e820d6910cd0 None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:22:59.636011 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application [None req-57cada27-148d-4617-b946-e820d6910cd0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 05:22:59.636011 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 05:22:59.636011 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 05:22:59.636011 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 05:22:59.636011 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 05:22:59.636011 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 05:22:59.636011 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 05:22:59.636011 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 05:22:59.636011 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 05:22:59.636011 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 05:22:59.636011 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 05:22:59.636011 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 05:22:59.636011 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 05:22:59.636011 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 05:22:59.636011 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 05:22:59.637982 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 05:22:59.637982 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 05:22:59.637982 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 05:22:59.637982 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 05:22:59.637982 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 05:22:59.637982 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 05:22:59.637982 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.get_or_create( May 10 05:22:59.637982 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 05:22:59.637982 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application with Lock( May 10 05:22:59.637982 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 05:22:59.637982 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self._enter() May 10 05:22:59.637982 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 05:22:59.637982 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 05:22:59.637982 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 05:22:59.637982 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.creator() May 10 05:22:59.637982 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 05:22:59.637982 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application created_value = creator( May 10 05:22:59.640078 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 05:22:59.640078 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 05:22:59.640078 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 05:22:59.640078 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application May 10 05:22:59.640567 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f3a019-9d6f-459b-9205-21dcaa443da7 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:22:59.640712 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 440/860] 10.222.0.23 () {56 vars in 1108 bytes} [Tue May 10 05:22:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 05:22:59.644487 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cada27-148d-4617-b946-e820d6910cd0 None admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:22:59.678349 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c434ab8a-d358-4fef-acde-43958fee319a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:22:59.679020 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c434ab8a-d358-4fef-acde-43958fee319a None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:59.679293 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c434ab8a-d358-4fef-acde-43958fee319a None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:59.679597 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c434ab8a-d358-4fef-acde-43958fee319a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:59.739836 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cada27-148d-4617-b946-e820d6910cd0 None admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:22:59.761210 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c434ab8a-d358-4fef-acde-43958fee319a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:22:59.762735 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c434ab8a-d358-4fef-acde-43958fee319a None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:22:59.781613 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac2696e-ce83-47eb-ae1b-67e07394834a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:22:59.782291 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac2696e-ce83-47eb-ae1b-67e07394834a None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:59.782990 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac2696e-ce83-47eb-ae1b-67e07394834a None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:59.783276 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac2696e-ce83-47eb-ae1b-67e07394834a None admin] PATH_INFO: `/v3/domains` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:59.784332 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac2696e-ce83-47eb-ae1b-67e07394834a None admin] RBAC: Adding query filter params (name=Default) {{(pid=79879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:22:59.784642 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac2696e-ce83-47eb-ae1b-67e07394834a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:22:59.786830 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac2696e-ce83-47eb-ae1b-67e07394834a None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:22:59.802746 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 441/861] 10.222.0.23 () {56 vars in 1109 bytes} [Tue May 10 05:22:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 05:22:59.808672 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac2696e-ce83-47eb-ae1b-67e07394834a None admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:22:59.869864 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 421/862] 10.222.0.23 () {58 vars in 1282 bytes} [Tue May 10 05:22:59 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 10 05:22:59.870810 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c434ab8a-d358-4fef-acde-43958fee319a None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:22:59.928941 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac2696e-ce83-47eb-ae1b-67e07394834a None admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:22:59.977342 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9250d808-6d33-45c5-8285-e6e7ed04e49e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:22:59.978566 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9250d808-6d33-45c5-8285-e6e7ed04e49e None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:22:59.979148 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9250d808-6d33-45c5-8285-e6e7ed04e49e None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:22:59.979494 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9250d808-6d33-45c5-8285-e6e7ed04e49e None admin] PATH_INFO: `/v3/projects/service` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:22:59.983555 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c434ab8a-d358-4fef-acde-43958fee319a None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:22:59.988480 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9250d808-6d33-45c5-8285-e6e7ed04e49e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:22:59.990085 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9250d808-6d33-45c5-8285-e6e7ed04e49e None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:23:00.009038 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application [None req-9250d808-6d33-45c5-8285-e6e7ed04e49e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 05:23:00.009038 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 05:23:00.009038 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 05:23:00.009038 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 05:23:00.009038 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 05:23:00.009038 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 05:23:00.009038 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 05:23:00.009038 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 05:23:00.009038 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 05:23:00.009038 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 05:23:00.009038 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 05:23:00.009038 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 05:23:00.009038 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 05:23:00.009038 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 05:23:00.009038 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 05:23:00.011075 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 05:23:00.011075 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 05:23:00.011075 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 05:23:00.011075 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 05:23:00.011075 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 05:23:00.011075 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 05:23:00.011075 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.get_or_create( May 10 05:23:00.011075 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 05:23:00.011075 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application with Lock( May 10 05:23:00.011075 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 05:23:00.011075 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self._enter() May 10 05:23:00.011075 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 05:23:00.011075 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 05:23:00.011075 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 05:23:00.011075 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.creator() May 10 05:23:00.011075 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 05:23:00.011075 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application created_value = creator( May 10 05:23:00.013044 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 05:23:00.013044 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 05:23:00.013044 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 05:23:00.013044 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 05:23:00.013044 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 05:23:00.013044 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 05:23:00.013044 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 05:23:00.013044 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application May 10 05:23:00.013044 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 442/863] 10.222.0.23 () {56 vars in 1111 bytes} [Tue May 10 05:22:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 05:23:00.017274 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9250d808-6d33-45c5-8285-e6e7ed04e49e None admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:23:00.023020 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989e081e-afc1-40d1-9ea3-4badbdcd2143 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:23:00.023854 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989e081e-afc1-40d1-9ea3-4badbdcd2143 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:23:00.024127 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989e081e-afc1-40d1-9ea3-4badbdcd2143 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:23:00.024390 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989e081e-afc1-40d1-9ea3-4badbdcd2143 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:23:00.034569 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989e081e-afc1-40d1-9ea3-4badbdcd2143 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:23:00.036191 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989e081e-afc1-40d1-9ea3-4badbdcd2143 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:23:00.053915 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application [None req-989e081e-afc1-40d1-9ea3-4badbdcd2143 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 05:23:00.053915 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 05:23:00.053915 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 05:23:00.053915 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 05:23:00.053915 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 05:23:00.053915 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 05:23:00.053915 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 05:23:00.053915 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 05:23:00.053915 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 05:23:00.053915 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 05:23:00.053915 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 05:23:00.053915 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 05:23:00.053915 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 05:23:00.053915 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 05:23:00.053915 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 05:23:00.055516 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 05:23:00.055516 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 05:23:00.055516 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 05:23:00.055516 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 05:23:00.055516 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 05:23:00.055516 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 05:23:00.055516 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.get_or_create( May 10 05:23:00.055516 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 05:23:00.055516 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application with Lock( May 10 05:23:00.055516 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 05:23:00.055516 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._enter() May 10 05:23:00.055516 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 05:23:00.055516 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 05:23:00.055516 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 05:23:00.055516 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.creator() May 10 05:23:00.055516 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 05:23:00.055516 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application created_value = creator( May 10 05:23:00.056439 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 05:23:00.056439 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 05:23:00.056439 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 05:23:00.056439 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application May 10 05:23:00.056439 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 422/864] 10.222.0.23 () {56 vars in 1108 bytes} [Tue May 10 05:22:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 05:23:00.060863 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989e081e-afc1-40d1-9ea3-4badbdcd2143 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:23:00.137651 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9250d808-6d33-45c5-8285-e6e7ed04e49e None admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:23:00.166024 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989e081e-afc1-40d1-9ea3-4badbdcd2143 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:23:00.170995 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225c6494-aaf4-4b06-aae0-334d45f47f41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:23:00.171842 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225c6494-aaf4-4b06-aae0-334d45f47f41 None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:23:00.172211 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225c6494-aaf4-4b06-aae0-334d45f47f41 None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:23:00.172635 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225c6494-aaf4-4b06-aae0-334d45f47f41 None admin] PATH_INFO: `/v3/projects` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:23:00.173518 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225c6494-aaf4-4b06-aae0-334d45f47f41 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:23:00.173920 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225c6494-aaf4-4b06-aae0-334d45f47f41 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:23:00.175441 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225c6494-aaf4-4b06-aae0-334d45f47f41 None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:23:00.192351 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 443/865] 10.222.0.23 () {56 vars in 1148 bytes} [Tue May 10 05:23:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:23:00.193420 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225c6494-aaf4-4b06-aae0-334d45f47f41 None admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:23:00.207954 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7122269-44b6-4112-b8b9-2fa1e09c0b08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:23:00.209302 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7122269-44b6-4112-b8b9-2fa1e09c0b08 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:23:00.209773 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7122269-44b6-4112-b8b9-2fa1e09c0b08 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:23:00.210477 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7122269-44b6-4112-b8b9-2fa1e09c0b08 None admin] PATH_INFO: `/v3/domains` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:23:00.212104 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7122269-44b6-4112-b8b9-2fa1e09c0b08 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:23:00.213104 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7122269-44b6-4112-b8b9-2fa1e09c0b08 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:23:00.214710 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7122269-44b6-4112-b8b9-2fa1e09c0b08 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:23:00.232151 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 423/866] 10.222.0.23 () {56 vars in 1109 bytes} [Tue May 10 05:23:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:23:00.237790 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7122269-44b6-4112-b8b9-2fa1e09c0b08 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:23:00.309564 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225c6494-aaf4-4b06-aae0-334d45f47f41 None admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:23:00.349390 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7122269-44b6-4112-b8b9-2fa1e09c0b08 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:23:00.352532 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973a6b2e-b91b-4600-bafe-a974e7b041a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:23:00.353372 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973a6b2e-b91b-4600-bafe-a974e7b041a6 None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:23:00.353823 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973a6b2e-b91b-4600-bafe-a974e7b041a6 None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:23:00.354239 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973a6b2e-b91b-4600-bafe-a974e7b041a6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:23:00.355230 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973a6b2e-b91b-4600-bafe-a974e7b041a6 None admin] RBAC: Adding query filter params (role.id=199ac1dd842441d7913c6ee89d8fbecc, scope.project.id=5f23435f783540199d6dcfd0417c090e, user.id=fd31dacf30804395bd029037b407c12a) {{(pid=79879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:23:00.355742 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973a6b2e-b91b-4600-bafe-a974e7b041a6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:23:00.357784 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973a6b2e-b91b-4600-bafe-a974e7b041a6 None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:23:00.366383 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 444/867] 10.222.0.23 () {56 vars in 1374 bytes} [Tue May 10 05:23:00 2022] GET /identity/v3/role_assignments?user.id=fd31dacf30804395bd029037b407c12a&scope.project.id=5f23435f783540199d6dcfd0417c090e&role.id=199ac1dd842441d7913c6ee89d8fbecc => generated 608 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:23:00.396860 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82cc033-932a-42a0-af48-19a41c3544b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:23:00.397717 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82cc033-932a-42a0-af48-19a41c3544b4 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:23:00.397993 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82cc033-932a-42a0-af48-19a41c3544b4 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:23:00.398261 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82cc033-932a-42a0-af48-19a41c3544b4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:23:00.402231 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15db2dd4-0f0e-444f-abda-9925540f610a None None] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:23:00.402568 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15db2dd4-0f0e-444f-abda-9925540f610a None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:23:00.402851 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15db2dd4-0f0e-444f-abda-9925540f610a None None] PATH_INFO: `/` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:23:00.404828 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 445/868] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 10 05:23:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 05:23:00.405895 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82cc033-932a-42a0-af48-19a41c3544b4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:23:00.407356 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82cc033-932a-42a0-af48-19a41c3544b4 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:23:00.410559 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2942dc9-3317-4e5f-be62-8a97c1701c4c None None] REQUEST_METHOD: `POST` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:23:00.410848 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2942dc9-3317-4e5f-be62-8a97c1701c4c None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:23:00.411179 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2942dc9-3317-4e5f-be62-8a97c1701c4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:23:00.422773 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application [None req-f82cc033-932a-42a0-af48-19a41c3544b4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 05:23:00.422773 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 05:23:00.422773 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 05:23:00.422773 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 05:23:00.422773 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 05:23:00.422773 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 05:23:00.422773 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 05:23:00.422773 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 05:23:00.422773 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 05:23:00.422773 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 05:23:00.422773 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 05:23:00.422773 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 05:23:00.422773 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 05:23:00.422773 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 05:23:00.422773 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 05:23:00.424930 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 05:23:00.424930 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 05:23:00.424930 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 05:23:00.424930 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 05:23:00.424930 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 05:23:00.424930 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 05:23:00.424930 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.get_or_create( May 10 05:23:00.424930 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 05:23:00.424930 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application with Lock( May 10 05:23:00.424930 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 05:23:00.424930 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._enter() May 10 05:23:00.424930 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 05:23:00.424930 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 05:23:00.424930 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 05:23:00.424930 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.creator() May 10 05:23:00.424930 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 05:23:00.424930 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application created_value = creator( May 10 05:23:00.427084 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 05:23:00.427084 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 05:23:00.427084 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 05:23:00.427084 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 05:23:00.427084 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 05:23:00.427084 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 05:23:00.427084 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 05:23:00.427084 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application May 10 05:23:00.427084 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 424/869] 10.222.0.23 () {56 vars in 1111 bytes} [Tue May 10 05:23:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 05:23:00.432586 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.auth.core [None req-f2942dc9-3317-4e5f-be62-8a97c1701c4c None None] MFA Rules not processed for user `44883b22532e44049d846938dc2cf423`. Rule list: `[]` (Enabled: `True`). {{(pid=79879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:23:00.432586 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-f2942dc9-3317-4e5f-be62-8a97c1701c4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:23:00.432867 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82cc033-932a-42a0-af48-19a41c3544b4 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:23:00.520420 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 446/870] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 10 05:23:00 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 10 05:23:00.544699 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2942dc9-3317-4e5f-be62-8a97c1701c4c None None] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:23:00.561677 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82cc033-932a-42a0-af48-19a41c3544b4 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:23:00.602625 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5d191b-1312-43b2-9aed-d3fb23b3fa9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:23:00.603306 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5d191b-1312-43b2-9aed-d3fb23b3fa9c None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:23:00.603615 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5d191b-1312-43b2-9aed-d3fb23b3fa9c None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:23:00.604161 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5d191b-1312-43b2-9aed-d3fb23b3fa9c None admin] PATH_INFO: `/v3/projects` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:23:00.604804 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5d191b-1312-43b2-9aed-d3fb23b3fa9c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:23:00.605106 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5d191b-1312-43b2-9aed-d3fb23b3fa9c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:23:00.606543 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5d191b-1312-43b2-9aed-d3fb23b3fa9c None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:23:00.625095 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 425/871] 10.222.0.23 () {56 vars in 1148 bytes} [Tue May 10 05:23:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 05:23:00.626774 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5d191b-1312-43b2-9aed-d3fb23b3fa9c None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:23:00.668946 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2942dc9-3317-4e5f-be62-8a97c1701c4c None None] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:23:00.704426 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa056ca-ac00-4c30-ad36-e022632ff322 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:23:00.705150 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa056ca-ac00-4c30-ad36-e022632ff322 None admin] REQUEST_METHOD: `POST` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:23:00.705430 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa056ca-ac00-4c30-ad36-e022632ff322 None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:23:00.705698 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa056ca-ac00-4c30-ad36-e022632ff322 None admin] PATH_INFO: `/v3/services` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:23:00.706485 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa056ca-ac00-4c30-ad36-e022632ff322 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:23:00.707968 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa056ca-ac00-4c30-ad36-e022632ff322 None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:23:00.731614 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 447/872] 10.222.0.23 () {60 vars in 1141 bytes} [Tue May 10 05:23:00 2022] POST /identity/v3/services => generated 251 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 05:23:00.753277 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5d191b-1312-43b2-9aed-d3fb23b3fa9c None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:23:00.809027 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026736c9-d278-4493-82b4-dcb7ab48cb7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:23:00.810138 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026736c9-d278-4493-82b4-dcb7ab48cb7a None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:23:00.810645 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026736c9-d278-4493-82b4-dcb7ab48cb7a None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:23:00.811133 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026736c9-d278-4493-82b4-dcb7ab48cb7a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:23:00.812308 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026736c9-d278-4493-82b4-dcb7ab48cb7a None admin] RBAC: Adding query filter params (role.id=8a02b9040d1d4fccababc1eb4dac80e7, scope.project.id=5f23435f783540199d6dcfd0417c090e, user.id=c5281b2a1c9a461995653be826207db4) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:23:00.812919 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026736c9-d278-4493-82b4-dcb7ab48cb7a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:23:00.814673 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026736c9-d278-4493-82b4-dcb7ab48cb7a None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:23:00.827733 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 426/873] 10.222.0.23 () {56 vars in 1374 bytes} [Tue May 10 05:23:00 2022] GET /identity/v3/role_assignments?user.id=c5281b2a1c9a461995653be826207db4&scope.project.id=5f23435f783540199d6dcfd0417c090e&role.id=8a02b9040d1d4fccababc1eb4dac80e7 => generated 608 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 05:23:00.936989 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6fa08f-ba37-49c0-9512-8e7d566eb122 None None] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:23:00.937303 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6fa08f-ba37-49c0-9512-8e7d566eb122 None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:23:00.937554 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6fa08f-ba37-49c0-9512-8e7d566eb122 None None] PATH_INFO: `/` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:23:00.939332 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 448/874] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 10 05:23:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 05:23:00.945343 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06419810-da34-4fce-9083-7918df876bbd None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:23:00.945918 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06419810-da34-4fce-9083-7918df876bbd None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:23:00.946201 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06419810-da34-4fce-9083-7918df876bbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:23:00.964924 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-06419810-da34-4fce-9083-7918df876bbd None None] MFA Rules not processed for user `44883b22532e44049d846938dc2cf423`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:23:00.966187 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-06419810-da34-4fce-9083-7918df876bbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:23:01.039141 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 427/875] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 10 05:23:00 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 10 05:23:01.062512 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6fa08f-ba37-49c0-9512-8e7d566eb122 None None] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:23:01.167924 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6fa08f-ba37-49c0-9512-8e7d566eb122 None None] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:23:01.201234 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be6f722-e378-4e4e-aacf-ddd8b311144f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:23:01.201958 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be6f722-e378-4e4e-aacf-ddd8b311144f None admin] REQUEST_METHOD: `POST` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:23:01.202240 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be6f722-e378-4e4e-aacf-ddd8b311144f None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:23:01.202514 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be6f722-e378-4e4e-aacf-ddd8b311144f None admin] PATH_INFO: `/v3/services` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:23:01.203259 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be6f722-e378-4e4e-aacf-ddd8b311144f None admin] RBAC: Authorizing `identity:create_service()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:23:01.204735 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be6f722-e378-4e4e-aacf-ddd8b311144f None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:23:01.223545 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 449/876] 10.222.0.23 () {60 vars in 1141 bytes} [Tue May 10 05:23:01 2022] POST /identity/v3/services => generated 269 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 05:23:02.705087 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db78e7c9-c0bd-4a1f-9142-c3bb28135356 None None] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:23:02.705615 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db78e7c9-c0bd-4a1f-9142-c3bb28135356 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:23:02.705615 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db78e7c9-c0bd-4a1f-9142-c3bb28135356 None None] PATH_INFO: `/` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:23:02.707294 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 428/877] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 10 05:23:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 05:23:02.712785 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c81efc-bf13-4cf9-a633-7d60346f09f6 None None] REQUEST_METHOD: `POST` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:23:02.713192 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c81efc-bf13-4cf9-a633-7d60346f09f6 None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:23:02.713375 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c81efc-bf13-4cf9-a633-7d60346f09f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:23:02.730554 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.auth.core [None req-58c81efc-bf13-4cf9-a633-7d60346f09f6 None None] MFA Rules not processed for user `44883b22532e44049d846938dc2cf423`. Rule list: `[]` (Enabled: `True`). {{(pid=79879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:23:02.731702 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-58c81efc-bf13-4cf9-a633-7d60346f09f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:23:02.803776 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 450/878] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 10 05:23:02 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 05:23:02.825458 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db78e7c9-c0bd-4a1f-9142-c3bb28135356 None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:23:02.926733 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db78e7c9-c0bd-4a1f-9142-c3bb28135356 None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:23:02.959612 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08378c04-00a8-4431-8bab-bfe14be6ddda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:23:02.960438 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08378c04-00a8-4431-8bab-bfe14be6ddda None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:23:02.960714 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08378c04-00a8-4431-8bab-bfe14be6ddda None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:23:02.960998 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08378c04-00a8-4431-8bab-bfe14be6ddda None admin] PATH_INFO: `/v3/services/object-store` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:23:02.961732 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08378c04-00a8-4431-8bab-bfe14be6ddda None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:23:02.963108 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08378c04-00a8-4431-8bab-bfe14be6ddda None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:23:02.975106 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application [None req-08378c04-00a8-4431-8bab-bfe14be6ddda None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 10 05:23:02.975106 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 05:23:02.975106 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 10 05:23:02.975106 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 10 05:23:02.975106 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 10 05:23:02.975106 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 10 05:23:02.975106 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 10 05:23:02.975106 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 05:23:02.975106 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 10 05:23:02.975106 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application May 10 05:23:02.975106 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 05:23:02.975106 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application May 10 05:23:02.975106 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 05:23:02.975106 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 05:23:02.975106 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 05:23:02.975106 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 05:23:02.975106 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 05:23:02.976372 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 05:23:02.976372 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 05:23:02.976372 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 05:23:02.976372 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 05:23:02.976372 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 05:23:02.976372 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 05:23:02.976372 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 10 05:23:02.976372 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_service(service_id) May 10 05:23:02.976372 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 10 05:23:02.976372 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 10 05:23:02.976372 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 05:23:02.976372 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 05:23:02.976372 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 05:23:02.976372 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 05:23:02.976372 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 05:23:02.976372 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.get_or_create( May 10 05:23:02.977397 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 05:23:02.977397 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application with Lock( May 10 05:23:02.977397 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 05:23:02.977397 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._enter() May 10 05:23:02.977397 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 05:23:02.977397 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 05:23:02.977397 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 05:23:02.977397 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.creator() May 10 05:23:02.977397 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 05:23:02.977397 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application created_value = creator( May 10 05:23:02.977397 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 10 05:23:02.977397 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 05:23:02.977397 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 10 05:23:02.977397 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application May 10 05:23:02.977397 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 429/879] 10.222.0.23 () {56 vars in 1126 bytes} [Tue May 10 05:23:02 2022] GET /identity/v3/services/object-store => generated 93 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 05:23:02.983160 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c81efc-bf13-4cf9-a633-7d60346f09f6 None None] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:23:03.061978 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4606d6c6-253d-45cb-b989-4f2b40a172f4 None None] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:23:03.062411 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4606d6c6-253d-45cb-b989-4f2b40a172f4 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:23:03.062590 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4606d6c6-253d-45cb-b989-4f2b40a172f4 None None] PATH_INFO: `/` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:23:03.064187 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 430/880] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 10 05:23:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 05:23:03.071237 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60196eb4-0b87-42b3-a025-00a38941a20e None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:23:03.071237 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60196eb4-0b87-42b3-a025-00a38941a20e None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:23:03.071237 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60196eb4-0b87-42b3-a025-00a38941a20e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:23:03.087006 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-60196eb4-0b87-42b3-a025-00a38941a20e None None] MFA Rules not processed for user `44883b22532e44049d846938dc2cf423`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:23:03.088612 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-60196eb4-0b87-42b3-a025-00a38941a20e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:23:03.090094 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c81efc-bf13-4cf9-a633-7d60346f09f6 None None] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:23:03.123698 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f834326f-9496-456d-bd5b-f066f3fa8cac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:23:03.124369 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f834326f-9496-456d-bd5b-f066f3fa8cac None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:23:03.124645 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f834326f-9496-456d-bd5b-f066f3fa8cac None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:23:03.124916 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f834326f-9496-456d-bd5b-f066f3fa8cac None admin] PATH_INFO: `/v3/services` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:23:03.125989 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f834326f-9496-456d-bd5b-f066f3fa8cac None admin] RBAC: Adding query filter params (name=object-store) {{(pid=79879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:23:03.125989 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f834326f-9496-456d-bd5b-f066f3fa8cac None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:23:03.127385 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f834326f-9496-456d-bd5b-f066f3fa8cac None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:23:03.132678 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 451/881] 10.222.0.23 () {56 vars in 1122 bytes} [Tue May 10 05:23:02 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:23:03.138190 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f834326f-9496-456d-bd5b-f066f3fa8cac None admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:23:03.163695 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 431/882] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 10 05:23:03 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 10 05:23:03.181202 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60196eb4-0b87-42b3-a025-00a38941a20e None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:23:03.235264 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f834326f-9496-456d-bd5b-f066f3fa8cac None admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:23:03.271822 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6eeec80-c9fe-476d-ac74-228b032203be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:23:03.272483 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6eeec80-c9fe-476d-ac74-228b032203be None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:23:03.272766 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6eeec80-c9fe-476d-ac74-228b032203be None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:23:03.273045 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6eeec80-c9fe-476d-ac74-228b032203be None admin] PATH_INFO: `/v3/services` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:23:03.273760 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6eeec80-c9fe-476d-ac74-228b032203be None admin] RBAC: Adding query filter params (type=object-store) {{(pid=79879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:23:03.274061 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6eeec80-c9fe-476d-ac74-228b032203be None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:23:03.275473 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6eeec80-c9fe-476d-ac74-228b032203be None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:23:03.287640 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60196eb4-0b87-42b3-a025-00a38941a20e None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:23:03.287917 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 452/883] 10.222.0.23 () {56 vars in 1122 bytes} [Tue May 10 05:23:03 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 05:23:03.287917 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0b3ae6-7289-499e-991b-bc7f5f832f2f None None] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:23:03.287917 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0b3ae6-7289-499e-991b-bc7f5f832f2f None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:23:03.287917 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0b3ae6-7289-499e-991b-bc7f5f832f2f None None] PATH_INFO: `/` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:23:03.287917 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 453/884] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 10 05:23:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 05:23:03.290532 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5da536-6fb8-40ab-8b9c-c8f1b7f4e327 None None] REQUEST_METHOD: `POST` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:23:03.290812 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5da536-6fb8-40ab-8b9c-c8f1b7f4e327 None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:23:03.291078 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5da536-6fb8-40ab-8b9c-c8f1b7f4e327 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:23:03.311388 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.auth.core [None req-cb5da536-6fb8-40ab-8b9c-c8f1b7f4e327 None None] MFA Rules not processed for user `44883b22532e44049d846938dc2cf423`. Rule list: `[]` (Enabled: `True`). {{(pid=79879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:23:03.312673 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-cb5da536-6fb8-40ab-8b9c-c8f1b7f4e327 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:23:03.338683 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d111af-bc1d-41cb-ab97-b7ab69aa61f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:23:03.340106 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d111af-bc1d-41cb-ab97-b7ab69aa61f6 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:23:03.340699 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d111af-bc1d-41cb-ab97-b7ab69aa61f6 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:23:03.341158 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d111af-bc1d-41cb-ab97-b7ab69aa61f6 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:23:03.342587 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d111af-bc1d-41cb-ab97-b7ab69aa61f6 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:23:03.344376 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d111af-bc1d-41cb-ab97-b7ab69aa61f6 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:23:03.360046 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application [None req-22d111af-bc1d-41cb-ab97-b7ab69aa61f6 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 10 05:23:03.360046 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 05:23:03.360046 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 10 05:23:03.360046 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 10 05:23:03.360046 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 10 05:23:03.360046 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 10 05:23:03.360046 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 10 05:23:03.360046 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 05:23:03.360046 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 10 05:23:03.360046 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application May 10 05:23:03.360046 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 05:23:03.360046 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application May 10 05:23:03.360046 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 05:23:03.360046 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 05:23:03.360046 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 05:23:03.360046 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 05:23:03.360046 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 05:23:03.361401 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 05:23:03.361401 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 05:23:03.361401 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 05:23:03.361401 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 05:23:03.361401 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 05:23:03.361401 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 05:23:03.361401 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 10 05:23:03.361401 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_service(service_id) May 10 05:23:03.361401 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 10 05:23:03.361401 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 10 05:23:03.361401 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 05:23:03.361401 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 05:23:03.361401 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 05:23:03.361401 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 05:23:03.361401 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 05:23:03.361401 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.get_or_create( May 10 05:23:03.362493 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 05:23:03.362493 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application with Lock( May 10 05:23:03.362493 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 05:23:03.362493 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._enter() May 10 05:23:03.362493 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 05:23:03.362493 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 05:23:03.362493 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 05:23:03.362493 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.creator() May 10 05:23:03.362493 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 05:23:03.362493 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application created_value = creator( May 10 05:23:03.362493 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 10 05:23:03.362493 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 05:23:03.362493 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 10 05:23:03.362493 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application May 10 05:23:03.369996 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 432/885] 10.222.0.23 () {56 vars in 1114 bytes} [Tue May 10 05:23:03 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 05:23:03.373297 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d111af-bc1d-41cb-ab97-b7ab69aa61f6 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:23:03.401689 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 454/886] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 10 05:23:03 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 05:23:03.426903 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5da536-6fb8-40ab-8b9c-c8f1b7f4e327 None None] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:23:03.504963 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d111af-bc1d-41cb-ab97-b7ab69aa61f6 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:23:03.538947 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc4d7ba-15fc-47ac-8618-54c6be3119eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:23:03.539787 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc4d7ba-15fc-47ac-8618-54c6be3119eb None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:23:03.540136 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc4d7ba-15fc-47ac-8618-54c6be3119eb None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:23:03.540425 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc4d7ba-15fc-47ac-8618-54c6be3119eb None admin] PATH_INFO: `/v3/services` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:23:03.541156 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc4d7ba-15fc-47ac-8618-54c6be3119eb None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:23:03.541464 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc4d7ba-15fc-47ac-8618-54c6be3119eb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:23:03.542170 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5da536-6fb8-40ab-8b9c-c8f1b7f4e327 None None] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:23:03.542829 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc4d7ba-15fc-47ac-8618-54c6be3119eb None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:23:03.551752 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 433/887] 10.222.0.23 () {56 vars in 1114 bytes} [Tue May 10 05:23:03 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:23:03.551752 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f625e1-e738-4e5a-86a8-be4bc76fcf21 None None] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:23:03.551752 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f625e1-e738-4e5a-86a8-be4bc76fcf21 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:23:03.551752 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f625e1-e738-4e5a-86a8-be4bc76fcf21 None None] PATH_INFO: `/` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:23:03.551752 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 434/888] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 10 05:23:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 05:23:03.554345 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f625e1-e738-4e5a-86a8-be4bc76fcf21 None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:23:03.579735 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8882fa-9705-47ca-a44b-33018c439e39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:23:03.580558 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8882fa-9705-47ca-a44b-33018c439e39 None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:23:03.580844 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8882fa-9705-47ca-a44b-33018c439e39 None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:23:03.581114 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8882fa-9705-47ca-a44b-33018c439e39 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:23:03.591307 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8882fa-9705-47ca-a44b-33018c439e39 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 05:23:03.599432 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application [None req-da8882fa-9705-47ca-a44b-33018c439e39 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 10 05:23:03.599432 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 05:23:03.599432 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 05:23:03.599432 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 05:23:03.599432 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 05:23:03.599432 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 05:23:03.599432 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 05:23:03.599432 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 05:23:03.599432 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 05:23:03.599432 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 05:23:03.599432 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 05:23:03.599432 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 05:23:03.599432 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 05:23:03.599432 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 05:23:03.599432 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 05:23:03.599432 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 05:23:03.600521 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 05:23:03.600521 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 05:23:03.600521 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 05:23:03.600521 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 05:23:03.600521 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 05:23:03.600521 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 05:23:03.600521 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 05:23:03.600521 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 05:23:03.600521 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 05:23:03.600521 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.get_or_create( May 10 05:23:03.600521 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 05:23:03.600521 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application with Lock( May 10 05:23:03.600521 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 05:23:03.600521 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self._enter() May 10 05:23:03.600521 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 05:23:03.600521 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 05:23:03.606451 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 05:23:03.606451 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.creator() May 10 05:23:03.606451 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 05:23:03.606451 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application created_value = creator( May 10 05:23:03.606451 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 05:23:03.606451 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 05:23:03.606451 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 05:23:03.606451 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 05:23:03.606451 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 05:23:03.606451 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 05:23:03.606451 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 10 05:23:03.606451 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application May 10 05:23:03.606451 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 455/889] 10.222.0.23 () {56 vars in 1120 bytes} [Tue May 10 05:23:03 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 05:23:03.606451 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7fac34-de31-42d1-b6e7-7496b1e52985 None None] REQUEST_METHOD: `POST` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:23:03.607258 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7fac34-de31-42d1-b6e7-7496b1e52985 None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:23:03.607258 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7fac34-de31-42d1-b6e7-7496b1e52985 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:23:03.620751 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.auth.core [None req-9d7fac34-de31-42d1-b6e7-7496b1e52985 None None] MFA Rules not processed for user `44883b22532e44049d846938dc2cf423`. Rule list: `[]` (Enabled: `True`). {{(pid=79879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:23:03.622297 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-9d7fac34-de31-42d1-b6e7-7496b1e52985 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:23:03.657234 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f625e1-e738-4e5a-86a8-be4bc76fcf21 None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:23:03.688909 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 456/890] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 10 05:23:03 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 05:23:03.690205 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7fac34-de31-42d1-b6e7-7496b1e52985 None None] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:23:03.705694 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b8ddf6-d10c-4b73-9c53-564b7b88c343 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:23:03.707377 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b8ddf6-d10c-4b73-9c53-564b7b88c343 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:23:03.707870 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b8ddf6-d10c-4b73-9c53-564b7b88c343 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:23:03.708519 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b8ddf6-d10c-4b73-9c53-564b7b88c343 None admin] PATH_INFO: `/v3/services` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:23:03.709706 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b8ddf6-d10c-4b73-9c53-564b7b88c343 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:23:03.710196 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b8ddf6-d10c-4b73-9c53-564b7b88c343 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:23:03.711992 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b8ddf6-d10c-4b73-9c53-564b7b88c343 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:23:03.717061 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 435/891] 10.222.0.23 () {56 vars in 1114 bytes} [Tue May 10 05:23:03 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:23:03.717900 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b8ddf6-d10c-4b73-9c53-564b7b88c343 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:23:03.789328 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7fac34-de31-42d1-b6e7-7496b1e52985 None None] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:23:03.813608 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b8ddf6-d10c-4b73-9c53-564b7b88c343 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:23:03.821963 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04df4936-71fc-49ec-b00a-177019f7638f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:23:03.822645 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04df4936-71fc-49ec-b00a-177019f7638f None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:23:03.822927 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04df4936-71fc-49ec-b00a-177019f7638f None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:23:03.823196 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04df4936-71fc-49ec-b00a-177019f7638f None admin] PATH_INFO: `/v3/roles` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:23:03.823987 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04df4936-71fc-49ec-b00a-177019f7638f None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:23:03.824299 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04df4936-71fc-49ec-b00a-177019f7638f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:23:03.825662 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04df4936-71fc-49ec-b00a-177019f7638f None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:23:03.833609 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 457/892] 10.222.0.23 () {56 vars in 1115 bytes} [Tue May 10 05:23:03 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:23:03.834402 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04df4936-71fc-49ec-b00a-177019f7638f None admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:23:03.848734 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be2accc-fe51-4cda-9157-7e40d85405ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:23:03.849790 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be2accc-fe51-4cda-9157-7e40d85405ed None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:23:03.850213 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be2accc-fe51-4cda-9157-7e40d85405ed None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:23:03.850639 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be2accc-fe51-4cda-9157-7e40d85405ed None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:23:03.851442 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be2accc-fe51-4cda-9157-7e40d85405ed None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:23:03.853073 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be2accc-fe51-4cda-9157-7e40d85405ed None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:23:03.865507 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application [None req-9be2accc-fe51-4cda-9157-7e40d85405ed None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 10 05:23:03.865507 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 05:23:03.865507 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 10 05:23:03.865507 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 10 05:23:03.865507 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 10 05:23:03.865507 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 10 05:23:03.865507 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 10 05:23:03.865507 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 05:23:03.865507 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 10 05:23:03.865507 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application May 10 05:23:03.865507 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 05:23:03.865507 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application May 10 05:23:03.865507 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 05:23:03.865507 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 05:23:03.865507 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 05:23:03.865507 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 05:23:03.866676 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 05:23:03.866676 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 05:23:03.866676 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 05:23:03.866676 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 05:23:03.866676 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 05:23:03.866676 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 05:23:03.866676 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 05:23:03.866676 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 10 05:23:03.866676 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_service(service_id) May 10 05:23:03.866676 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 10 05:23:03.866676 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 10 05:23:03.866676 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 05:23:03.866676 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 05:23:03.866676 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 05:23:03.866676 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 05:23:03.866676 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 05:23:03.867740 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.get_or_create( May 10 05:23:03.867740 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 05:23:03.867740 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application with Lock( May 10 05:23:03.867740 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 05:23:03.867740 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._enter() May 10 05:23:03.867740 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 05:23:03.867740 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 05:23:03.867740 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 05:23:03.867740 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.creator() May 10 05:23:03.867740 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 05:23:03.867740 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application created_value = creator( May 10 05:23:03.867740 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 10 05:23:03.867740 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 05:23:03.867740 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 10 05:23:03.867740 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application May 10 05:23:03.875299 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 436/893] 10.222.0.23 () {56 vars in 1132 bytes} [Tue May 10 05:23:03 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 05:23:03.876333 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be2accc-fe51-4cda-9157-7e40d85405ed None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:23:03.934362 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04df4936-71fc-49ec-b00a-177019f7638f None admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:23:03.966871 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7eba48a-5219-4be8-8821-7b7b8ec9d8b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:23:03.967533 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7eba48a-5219-4be8-8821-7b7b8ec9d8b5 None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:23:03.967843 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7eba48a-5219-4be8-8821-7b7b8ec9d8b5 None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:23:03.968116 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7eba48a-5219-4be8-8821-7b7b8ec9d8b5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:23:03.968917 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7eba48a-5219-4be8-8821-7b7b8ec9d8b5 None admin] RBAC: Adding query filter params (interface=public, service_id=1186525dd09b414cb987db65e59c9b82, region_id=RegionOne) {{(pid=79879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:23:03.969235 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7eba48a-5219-4be8-8821-7b7b8ec9d8b5 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:23:03.970608 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7eba48a-5219-4be8-8821-7b7b8ec9d8b5 None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:23:03.980247 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 458/894] 10.222.0.23 () {56 vars in 1251 bytes} [Tue May 10 05:23:03 2022] GET /identity/v3/endpoints?service_id=1186525dd09b414cb987db65e59c9b82&interface=public®ion_id=RegionOne => generated 194 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:23:03.980247 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7eba48a-5219-4be8-8821-7b7b8ec9d8b5 None admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:23:03.980482 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be2accc-fe51-4cda-9157-7e40d85405ed None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:23:04.014021 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fa64f3-e997-4b90-9f82-fd07c485f2bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:23:04.014849 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fa64f3-e997-4b90-9f82-fd07c485f2bf None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:23:04.015109 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fa64f3-e997-4b90-9f82-fd07c485f2bf None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:23:04.015379 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fa64f3-e997-4b90-9f82-fd07c485f2bf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:23:04.025685 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fa64f3-e997-4b90-9f82-fd07c485f2bf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:23:04.027141 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fa64f3-e997-4b90-9f82-fd07c485f2bf None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:23:04.044166 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application [None req-d7fa64f3-e997-4b90-9f82-fd07c485f2bf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 05:23:04.044166 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 05:23:04.044166 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 05:23:04.044166 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 05:23:04.044166 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 05:23:04.044166 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 05:23:04.044166 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 05:23:04.044166 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 05:23:04.044166 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 05:23:04.044166 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 05:23:04.044166 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 05:23:04.044166 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 05:23:04.044166 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 05:23:04.044166 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 05:23:04.044166 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 05:23:04.045103 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 05:23:04.045103 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 05:23:04.045103 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 05:23:04.045103 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 05:23:04.045103 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 05:23:04.045103 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 05:23:04.045103 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.get_or_create( May 10 05:23:04.045103 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 05:23:04.045103 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application with Lock( May 10 05:23:04.045103 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 05:23:04.045103 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._enter() May 10 05:23:04.045103 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 05:23:04.045103 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 05:23:04.045103 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 05:23:04.045103 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.creator() May 10 05:23:04.045103 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 05:23:04.045103 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application created_value = creator( May 10 05:23:04.046012 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 05:23:04.046012 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 05:23:04.046012 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 05:23:04.046012 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application May 10 05:23:04.046012 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 437/895] 10.222.0.23 () {56 vars in 1108 bytes} [Tue May 10 05:23:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 05:23:04.046335 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fa64f3-e997-4b90-9f82-fd07c485f2bf None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:23:04.085724 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7eba48a-5219-4be8-8821-7b7b8ec9d8b5 None admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:23:04.118147 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b232e7-8f9c-410b-b284-36261a5d5f52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:23:04.118816 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b232e7-8f9c-410b-b284-36261a5d5f52 None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:23:04.119077 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b232e7-8f9c-410b-b284-36261a5d5f52 None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:23:04.119370 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b232e7-8f9c-410b-b284-36261a5d5f52 None admin] PATH_INFO: `/v3/services` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:23:04.120096 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b232e7-8f9c-410b-b284-36261a5d5f52 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=79879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:23:04.120399 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b232e7-8f9c-410b-b284-36261a5d5f52 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:23:04.122137 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b232e7-8f9c-410b-b284-36261a5d5f52 None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:23:04.126725 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 459/896] 10.222.0.23 () {56 vars in 1126 bytes} [Tue May 10 05:23:03 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:23:04.127516 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b232e7-8f9c-410b-b284-36261a5d5f52 None admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:23:04.151609 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fa64f3-e997-4b90-9f82-fd07c485f2bf None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:23:04.184344 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e600b5e5-9d5d-4968-ad06-3774f89e4371 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:23:04.185248 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e600b5e5-9d5d-4968-ad06-3774f89e4371 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:23:04.185718 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e600b5e5-9d5d-4968-ad06-3774f89e4371 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:23:04.186183 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e600b5e5-9d5d-4968-ad06-3774f89e4371 None admin] PATH_INFO: `/v3/services` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:23:04.187039 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e600b5e5-9d5d-4968-ad06-3774f89e4371 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:23:04.188618 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e600b5e5-9d5d-4968-ad06-3774f89e4371 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:23:04.196905 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 438/897] 10.222.0.23 () {56 vars in 1087 bytes} [Tue May 10 05:23:04 2022] GET /identity/v3/services => generated 1268 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 05:23:04.197980 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e600b5e5-9d5d-4968-ad06-3774f89e4371 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:23:04.228704 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b232e7-8f9c-410b-b284-36261a5d5f52 None admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:23:04.265944 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fd456c-8f95-4444-ae23-85faeba005a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:23:04.266965 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fd456c-8f95-4444-ae23-85faeba005a2 None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:23:04.267446 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fd456c-8f95-4444-ae23-85faeba005a2 None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:23:04.267932 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fd456c-8f95-4444-ae23-85faeba005a2 None admin] PATH_INFO: `/v3/domains` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:23:04.268880 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9fd456c-8f95-4444-ae23-85faeba005a2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:23:04.269468 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9fd456c-8f95-4444-ae23-85faeba005a2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:23:04.271146 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9fd456c-8f95-4444-ae23-85faeba005a2 None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:23:04.284016 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 460/898] 10.222.0.23 () {56 vars in 1109 bytes} [Tue May 10 05:23:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:23:04.290378 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fd456c-8f95-4444-ae23-85faeba005a2 None admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:23:04.342456 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e600b5e5-9d5d-4968-ad06-3774f89e4371 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:23:04.377992 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c75bb50-4764-441b-83cb-de1c04cf1174 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:23:04.379117 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c75bb50-4764-441b-83cb-de1c04cf1174 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:23:04.379655 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c75bb50-4764-441b-83cb-de1c04cf1174 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:23:04.380130 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c75bb50-4764-441b-83cb-de1c04cf1174 None admin] PATH_INFO: `/v3/services` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:23:04.381077 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c75bb50-4764-441b-83cb-de1c04cf1174 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:23:04.381584 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c75bb50-4764-441b-83cb-de1c04cf1174 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:23:04.383193 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c75bb50-4764-441b-83cb-de1c04cf1174 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:23:04.389160 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 439/899] 10.222.0.23 () {56 vars in 1126 bytes} [Tue May 10 05:23:04 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:23:04.394794 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c75bb50-4764-441b-83cb-de1c04cf1174 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:23:04.422514 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fd456c-8f95-4444-ae23-85faeba005a2 None admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:23:04.461177 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfb8c61-cb81-40fb-8ae5-1aab5898d086 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:23:04.462174 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfb8c61-cb81-40fb-8ae5-1aab5898d086 None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:23:04.462733 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfb8c61-cb81-40fb-8ae5-1aab5898d086 None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:23:04.463026 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfb8c61-cb81-40fb-8ae5-1aab5898d086 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:23:04.478705 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfb8c61-cb81-40fb-8ae5-1aab5898d086 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:23:04.480691 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfb8c61-cb81-40fb-8ae5-1aab5898d086 None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:23:04.501568 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application [None req-1bfb8c61-cb81-40fb-8ae5-1aab5898d086 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 10 05:23:04.501568 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 05:23:04.501568 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 05:23:04.501568 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 05:23:04.501568 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 05:23:04.501568 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 05:23:04.501568 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 05:23:04.501568 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 05:23:04.501568 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 05:23:04.501568 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 05:23:04.501568 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 05:23:04.501568 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 05:23:04.501568 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 05:23:04.501568 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 05:23:04.501568 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 05:23:04.501568 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 05:23:04.502592 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 05:23:04.502592 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 05:23:04.502592 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 05:23:04.502592 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 05:23:04.502592 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 05:23:04.502592 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 05:23:04.502592 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 05:23:04.502592 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 05:23:04.502592 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 05:23:04.502592 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.get_or_create( May 10 05:23:04.502592 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 05:23:04.502592 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application with Lock( May 10 05:23:04.502592 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 05:23:04.502592 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self._enter() May 10 05:23:04.502592 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 05:23:04.502592 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 05:23:04.502592 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 05:23:04.502592 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.creator() May 10 05:23:04.503549 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 05:23:04.503549 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application created_value = creator( May 10 05:23:04.503549 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 05:23:04.503549 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 05:23:04.503549 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 05:23:04.503549 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 05:23:04.503549 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 05:23:04.503549 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 05:23:04.503549 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 10 05:23:04.503549 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application May 10 05:23:04.504312 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c75bb50-4764-441b-83cb-de1c04cf1174 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:23:04.504390 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 461/900] 10.222.0.23 () {56 vars in 1117 bytes} [Tue May 10 05:23:04 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 05:23:04.512580 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfb8c61-cb81-40fb-8ae5-1aab5898d086 None admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:23:04.542875 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16baaf1-3ab5-4b97-bc1a-18c02a4e03dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:23:04.543544 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16baaf1-3ab5-4b97-bc1a-18c02a4e03dd None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:23:04.543855 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16baaf1-3ab5-4b97-bc1a-18c02a4e03dd None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:23:04.544131 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16baaf1-3ab5-4b97-bc1a-18c02a4e03dd None admin] PATH_INFO: `/v3/endpoints` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:23:04.544931 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16baaf1-3ab5-4b97-bc1a-18c02a4e03dd None admin] RBAC: Adding query filter params (interface=public, service_id=210839af393e4429b7862c95fbc989e0, region_id=RegionOne) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:23:04.545244 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16baaf1-3ab5-4b97-bc1a-18c02a4e03dd None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:23:04.546614 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16baaf1-3ab5-4b97-bc1a-18c02a4e03dd None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:23:04.552422 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 440/901] 10.222.0.23 () {56 vars in 1251 bytes} [Tue May 10 05:23:04 2022] GET /identity/v3/endpoints?service_id=210839af393e4429b7862c95fbc989e0&interface=public®ion_id=RegionOne => generated 194 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:23:04.560586 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16baaf1-3ab5-4b97-bc1a-18c02a4e03dd None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:23:04.624143 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfb8c61-cb81-40fb-8ae5-1aab5898d086 None admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:23:04.657766 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d450f7e0-1c0d-4a68-94c6-092f55e901a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:23:04.658446 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d450f7e0-1c0d-4a68-94c6-092f55e901a8 None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:23:04.658722 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d450f7e0-1c0d-4a68-94c6-092f55e901a8 None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:23:04.658985 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d450f7e0-1c0d-4a68-94c6-092f55e901a8 None admin] PATH_INFO: `/v3/users` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:23:04.660029 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d450f7e0-1c0d-4a68-94c6-092f55e901a8 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:23:04.660243 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d450f7e0-1c0d-4a68-94c6-092f55e901a8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:23:04.661675 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d450f7e0-1c0d-4a68-94c6-092f55e901a8 None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:23:04.676635 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16baaf1-3ab5-4b97-bc1a-18c02a4e03dd None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:23:04.679743 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 462/902] 10.222.0.23 () {56 vars in 1149 bytes} [Tue May 10 05:23:04 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:23:04.684990 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d450f7e0-1c0d-4a68-94c6-092f55e901a8 None admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:23:04.709833 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee135a57-aaa7-4002-a7ba-93af36d8f113 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:23:04.711105 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee135a57-aaa7-4002-a7ba-93af36d8f113 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:23:04.711517 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee135a57-aaa7-4002-a7ba-93af36d8f113 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:23:04.711962 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee135a57-aaa7-4002-a7ba-93af36d8f113 None admin] PATH_INFO: `/v3/services` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:23:04.712775 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee135a57-aaa7-4002-a7ba-93af36d8f113 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:23:04.714266 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee135a57-aaa7-4002-a7ba-93af36d8f113 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:23:04.720359 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 441/903] 10.222.0.23 () {56 vars in 1087 bytes} [Tue May 10 05:23:04 2022] GET /identity/v3/services => generated 1268 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 05:23:04.788496 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d450f7e0-1c0d-4a68-94c6-092f55e901a8 None admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:23:04.825602 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc594c04-07e1-445c-81f6-4f1d2ac443ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:23:04.826456 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc594c04-07e1-445c-81f6-4f1d2ac443ed None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:23:04.826835 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc594c04-07e1-445c-81f6-4f1d2ac443ed None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:23:04.827205 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc594c04-07e1-445c-81f6-4f1d2ac443ed None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:23:04.899510 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc594c04-07e1-445c-81f6-4f1d2ac443ed None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:23:04.901097 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc594c04-07e1-445c-81f6-4f1d2ac443ed None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:23:04.997702 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 463/904] 10.222.0.23 () {58 vars in 1282 bytes} [Tue May 10 05:23:04 2022] GET /identity/v3/auth/tokens => generated 1362 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 10 05:23:05.003461 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee135a57-aaa7-4002-a7ba-93af36d8f113 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:23:05.103756 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee135a57-aaa7-4002-a7ba-93af36d8f113 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:23:05.137515 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b2fff8-5ad1-4b4e-89a1-d002d1bde2a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:23:05.138490 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b2fff8-5ad1-4b4e-89a1-d002d1bde2a5 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:23:05.138865 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b2fff8-5ad1-4b4e-89a1-d002d1bde2a5 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:23:05.139234 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b2fff8-5ad1-4b4e-89a1-d002d1bde2a5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:23:05.150385 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b2fff8-5ad1-4b4e-89a1-d002d1bde2a5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:23:05.151936 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b2fff8-5ad1-4b4e-89a1-d002d1bde2a5 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:23:05.169310 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application [None req-09b2fff8-5ad1-4b4e-89a1-d002d1bde2a5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 05:23:05.169310 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 05:23:05.169310 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 05:23:05.169310 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 05:23:05.169310 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 05:23:05.169310 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 05:23:05.169310 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 05:23:05.169310 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 05:23:05.169310 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 05:23:05.169310 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 05:23:05.169310 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 05:23:05.169310 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 05:23:05.169310 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 05:23:05.169310 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 05:23:05.169310 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 05:23:05.170370 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 05:23:05.170370 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 05:23:05.170370 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 05:23:05.170370 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 05:23:05.170370 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 05:23:05.170370 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 05:23:05.170370 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.get_or_create( May 10 05:23:05.170370 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 05:23:05.170370 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application with Lock( May 10 05:23:05.170370 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 05:23:05.170370 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._enter() May 10 05:23:05.170370 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 05:23:05.170370 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 05:23:05.170370 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 05:23:05.170370 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.creator() May 10 05:23:05.170370 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 05:23:05.170370 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application created_value = creator( May 10 05:23:05.171483 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 05:23:05.171483 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 05:23:05.171483 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 05:23:05.171483 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application May 10 05:23:05.173045 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 442/905] 10.222.0.23 () {56 vars in 1108 bytes} [Tue May 10 05:23:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 05:23:05.178711 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc594c04-07e1-445c-81f6-4f1d2ac443ed None admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:23:05.276880 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc594c04-07e1-445c-81f6-4f1d2ac443ed None admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:23:05.310110 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929500ac-3259-4eab-9bae-6b94037a4d6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:23:05.310947 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929500ac-3259-4eab-9bae-6b94037a4d6e None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:23:05.311344 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929500ac-3259-4eab-9bae-6b94037a4d6e None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:23:05.311742 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929500ac-3259-4eab-9bae-6b94037a4d6e None admin] PATH_INFO: `/v3/domains` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:23:05.312569 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929500ac-3259-4eab-9bae-6b94037a4d6e None admin] RBAC: Adding query filter params (name=Default) {{(pid=79879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:23:05.313026 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929500ac-3259-4eab-9bae-6b94037a4d6e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:23:05.314539 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929500ac-3259-4eab-9bae-6b94037a4d6e None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:23:05.326375 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 464/906] 10.222.0.23 () {56 vars in 1109 bytes} [Tue May 10 05:23:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:23:05.332051 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b2fff8-5ad1-4b4e-89a1-d002d1bde2a5 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:23:05.436290 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b2fff8-5ad1-4b4e-89a1-d002d1bde2a5 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:23:05.469089 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d51c1cb-0f51-4e73-b5f0-03799263fbc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:23:05.469903 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d51c1cb-0f51-4e73-b5f0-03799263fbc3 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:23:05.470559 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d51c1cb-0f51-4e73-b5f0-03799263fbc3 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:23:05.470559 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d51c1cb-0f51-4e73-b5f0-03799263fbc3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:23:05.477412 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d51c1cb-0f51-4e73-b5f0-03799263fbc3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:23:05.478853 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d51c1cb-0f51-4e73-b5f0-03799263fbc3 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:23:05.492742 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application [None req-2d51c1cb-0f51-4e73-b5f0-03799263fbc3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 05:23:05.492742 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 05:23:05.492742 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 05:23:05.492742 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 05:23:05.492742 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 05:23:05.492742 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 05:23:05.492742 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 05:23:05.492742 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 05:23:05.492742 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 05:23:05.492742 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 05:23:05.492742 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 05:23:05.492742 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 05:23:05.492742 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 05:23:05.492742 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 05:23:05.492742 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 05:23:05.493668 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 05:23:05.493668 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 05:23:05.493668 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 05:23:05.493668 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 05:23:05.493668 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 05:23:05.493668 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 05:23:05.493668 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.get_or_create( May 10 05:23:05.493668 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 05:23:05.493668 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application with Lock( May 10 05:23:05.493668 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 05:23:05.493668 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._enter() May 10 05:23:05.493668 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 05:23:05.493668 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 05:23:05.493668 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 05:23:05.493668 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.creator() May 10 05:23:05.493668 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 05:23:05.493668 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application created_value = creator( May 10 05:23:05.494555 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 05:23:05.494555 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 05:23:05.494555 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 05:23:05.494555 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 05:23:05.494555 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 05:23:05.494555 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 05:23:05.494555 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 05:23:05.494555 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application May 10 05:23:05.494555 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 443/907] 10.222.0.23 () {56 vars in 1111 bytes} [Tue May 10 05:23:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 05:23:05.500146 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929500ac-3259-4eab-9bae-6b94037a4d6e None admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:23:05.542292 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f4be7e-24d4-4054-934c-8c86778ccce6 None None] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:23:05.542638 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f4be7e-24d4-4054-934c-8c86778ccce6 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:23:05.542897 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f4be7e-24d4-4054-934c-8c86778ccce6 None None] PATH_INFO: `/` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:23:05.544680 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 444/908] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 10 05:23:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 05:23:05.549969 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0c44b6-81f8-434f-8062-d4ec1b502deb None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:23:05.550247 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0c44b6-81f8-434f-8062-d4ec1b502deb None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:23:05.550565 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0c44b6-81f8-434f-8062-d4ec1b502deb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:23:05.570439 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-ec0c44b6-81f8-434f-8062-d4ec1b502deb None None] MFA Rules not processed for user `44883b22532e44049d846938dc2cf423`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:23:05.572270 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-ec0c44b6-81f8-434f-8062-d4ec1b502deb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:23:05.610761 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929500ac-3259-4eab-9bae-6b94037a4d6e None admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:23:05.653535 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 445/909] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 10 05:23:05 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 10 05:23:05.659709 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f097644-0aaf-4c7e-85fb-a53f98ce1ac2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:23:05.659709 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f097644-0aaf-4c7e-85fb-a53f98ce1ac2 None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:23:05.659709 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f097644-0aaf-4c7e-85fb-a53f98ce1ac2 None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:23:05.659709 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f097644-0aaf-4c7e-85fb-a53f98ce1ac2 None admin] PATH_INFO: `/v3/projects` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:23:05.660081 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f097644-0aaf-4c7e-85fb-a53f98ce1ac2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:23:05.660081 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f097644-0aaf-4c7e-85fb-a53f98ce1ac2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:23:05.660081 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f097644-0aaf-4c7e-85fb-a53f98ce1ac2 None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:23:05.670315 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 465/910] 10.222.0.23 () {56 vars in 1148 bytes} [Tue May 10 05:23:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:23:05.676669 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0c44b6-81f8-434f-8062-d4ec1b502deb None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:23:05.679230 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f097644-0aaf-4c7e-85fb-a53f98ce1ac2 None admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:23:05.772434 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0c44b6-81f8-434f-8062-d4ec1b502deb None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:23:05.775825 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f097644-0aaf-4c7e-85fb-a53f98ce1ac2 None admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:23:05.806056 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7283c8-f042-4a1f-93d8-15563f721bee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:23:05.807269 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7283c8-f042-4a1f-93d8-15563f721bee None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:23:05.807869 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7283c8-f042-4a1f-93d8-15563f721bee None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:23:05.808388 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7283c8-f042-4a1f-93d8-15563f721bee None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:23:05.809672 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7283c8-f042-4a1f-93d8-15563f721bee None admin] RBAC: Adding query filter params (role.id=635210106d69457ba45e9fa6dd0b9754, scope.project.id=5f23435f783540199d6dcfd0417c090e, user.id=c5281b2a1c9a461995653be826207db4) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:23:05.810146 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2af414-dd17-467b-9530-2bfbbe7f92e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:23:05.810369 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7283c8-f042-4a1f-93d8-15563f721bee None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:23:05.810959 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2af414-dd17-467b-9530-2bfbbe7f92e4 None admin] REQUEST_METHOD: `POST` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:23:05.811307 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2af414-dd17-467b-9530-2bfbbe7f92e4 None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:23:05.811676 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2af414-dd17-467b-9530-2bfbbe7f92e4 None admin] PATH_INFO: `/v3/services` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:23:05.812489 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2af414-dd17-467b-9530-2bfbbe7f92e4 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:23:05.812853 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7283c8-f042-4a1f-93d8-15563f721bee None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:23:05.813971 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2af414-dd17-467b-9530-2bfbbe7f92e4 None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:23:05.818865 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 446/911] 10.222.0.23 () {56 vars in 1374 bytes} [Tue May 10 05:23:05 2022] GET /identity/v3/role_assignments?user.id=c5281b2a1c9a461995653be826207db4&scope.project.id=5f23435f783540199d6dcfd0417c090e&role.id=635210106d69457ba45e9fa6dd0b9754 => generated 259 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:23:05.839835 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 466/912] 10.222.0.23 () {60 vars in 1141 bytes} [Tue May 10 05:23:05 2022] POST /identity/v3/services => generated 241 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 05:23:06.557931 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1063af8c-8c3b-4409-a2f0-a4f35d9d3b21 None None] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:23:06.558206 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1063af8c-8c3b-4409-a2f0-a4f35d9d3b21 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:23:06.558476 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1063af8c-8c3b-4409-a2f0-a4f35d9d3b21 None None] PATH_INFO: `/` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:23:06.560147 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 447/913] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 10 05:23:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 05:23:06.565316 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6d4261-8d3e-42b7-9d57-d99450bcd0a8 None None] REQUEST_METHOD: `POST` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:23:06.565603 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6d4261-8d3e-42b7-9d57-d99450bcd0a8 None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:23:06.565888 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6d4261-8d3e-42b7-9d57-d99450bcd0a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:23:06.582571 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.auth.core [None req-8c6d4261-8d3e-42b7-9d57-d99450bcd0a8 None None] MFA Rules not processed for user `44883b22532e44049d846938dc2cf423`. Rule list: `[]` (Enabled: `True`). {{(pid=79879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:23:06.583795 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-8c6d4261-8d3e-42b7-9d57-d99450bcd0a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:23:06.660340 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 467/914] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 10 05:23:06 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 05:23:06.682324 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1063af8c-8c3b-4409-a2f0-a4f35d9d3b21 None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:23:06.781926 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1063af8c-8c3b-4409-a2f0-a4f35d9d3b21 None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:23:06.818433 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c8eb2d-c2f6-48a8-ac8d-c89e3b59333c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:23:06.819694 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c8eb2d-c2f6-48a8-ac8d-c89e3b59333c None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:23:06.820178 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c8eb2d-c2f6-48a8-ac8d-c89e3b59333c None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:23:06.820669 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c8eb2d-c2f6-48a8-ac8d-c89e3b59333c None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:23:06.821545 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c8eb2d-c2f6-48a8-ac8d-c89e3b59333c None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:23:06.823141 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c8eb2d-c2f6-48a8-ac8d-c89e3b59333c None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:23:06.835818 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application [None req-73c8eb2d-c2f6-48a8-ac8d-c89e3b59333c None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 10 05:23:06.835818 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 05:23:06.835818 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 10 05:23:06.835818 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 10 05:23:06.835818 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 10 05:23:06.835818 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 10 05:23:06.835818 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 10 05:23:06.835818 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 05:23:06.835818 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 10 05:23:06.835818 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application May 10 05:23:06.835818 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 05:23:06.835818 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application May 10 05:23:06.835818 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 05:23:06.835818 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 05:23:06.835818 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 05:23:06.835818 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 05:23:06.835818 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 05:23:06.836831 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 05:23:06.836831 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 05:23:06.836831 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 05:23:06.836831 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 05:23:06.836831 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 05:23:06.836831 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 05:23:06.836831 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 10 05:23:06.836831 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_service(service_id) May 10 05:23:06.836831 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 10 05:23:06.836831 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 10 05:23:06.836831 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 05:23:06.836831 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 05:23:06.836831 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 05:23:06.836831 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 05:23:06.836831 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 05:23:06.836831 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.get_or_create( May 10 05:23:06.837681 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 05:23:06.837681 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application with Lock( May 10 05:23:06.837681 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 05:23:06.837681 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._enter() May 10 05:23:06.837681 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 05:23:06.837681 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 05:23:06.837681 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 05:23:06.837681 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.creator() May 10 05:23:06.837681 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 05:23:06.837681 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application created_value = creator( May 10 05:23:06.837681 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 10 05:23:06.837681 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 05:23:06.837681 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 10 05:23:06.837681 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application May 10 05:23:06.840580 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 448/915] 10.222.0.23 () {56 vars in 1114 bytes} [Tue May 10 05:23:06 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 05:23:06.846578 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6d4261-8d3e-42b7-9d57-d99450bcd0a8 None None] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:23:06.940010 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6d4261-8d3e-42b7-9d57-d99450bcd0a8 None None] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:23:06.972694 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feaec481-45db-4a17-ac66-6dd3641607d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:23:06.973362 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feaec481-45db-4a17-ac66-6dd3641607d3 None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:23:06.973639 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feaec481-45db-4a17-ac66-6dd3641607d3 None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:23:06.973911 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feaec481-45db-4a17-ac66-6dd3641607d3 None admin] PATH_INFO: `/v3/services` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:23:06.974623 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feaec481-45db-4a17-ac66-6dd3641607d3 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=79879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:23:06.974924 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feaec481-45db-4a17-ac66-6dd3641607d3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:23:06.976333 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feaec481-45db-4a17-ac66-6dd3641607d3 None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:23:06.980114 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8761bb5b-77c3-4dbe-b01c-1a0dab0b07c8 None None] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:23:06.980397 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8761bb5b-77c3-4dbe-b01c-1a0dab0b07c8 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:23:06.980670 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8761bb5b-77c3-4dbe-b01c-1a0dab0b07c8 None None] PATH_INFO: `/` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:23:06.981569 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 468/916] 10.222.0.23 () {56 vars in 1114 bytes} [Tue May 10 05:23:06 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:23:06.982246 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 449/917] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 10 05:23:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 05:23:06.986922 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8761bb5b-77c3-4dbe-b01c-1a0dab0b07c8 None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:23:06.987337 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9361d26-55ba-4671-ae0f-6cde4d5a34da None None] REQUEST_METHOD: `POST` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:23:06.987584 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9361d26-55ba-4671-ae0f-6cde4d5a34da None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:23:06.987873 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9361d26-55ba-4671-ae0f-6cde4d5a34da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:23:07.007512 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.auth.core [None req-b9361d26-55ba-4671-ae0f-6cde4d5a34da None None] MFA Rules not processed for user `44883b22532e44049d846938dc2cf423`. Rule list: `[]` (Enabled: `True`). {{(pid=79879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:23:07.008740 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-b9361d26-55ba-4671-ae0f-6cde4d5a34da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:23:07.076007 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 469/918] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 10 05:23:06 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 05:23:07.099484 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9361d26-55ba-4671-ae0f-6cde4d5a34da None None] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:23:07.110149 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8761bb5b-77c3-4dbe-b01c-1a0dab0b07c8 None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:23:07.153840 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275052dd-1627-4651-9f94-b1a7db2a3b59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:23:07.155049 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275052dd-1627-4651-9f94-b1a7db2a3b59 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:23:07.155849 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275052dd-1627-4651-9f94-b1a7db2a3b59 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:23:07.156344 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275052dd-1627-4651-9f94-b1a7db2a3b59 None admin] PATH_INFO: `/v3/services` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:23:07.157264 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275052dd-1627-4651-9f94-b1a7db2a3b59 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:23:07.157774 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275052dd-1627-4651-9f94-b1a7db2a3b59 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:23:07.160098 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275052dd-1627-4651-9f94-b1a7db2a3b59 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:23:07.167427 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 450/919] 10.222.0.23 () {56 vars in 1114 bytes} [Tue May 10 05:23:06 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 05:23:07.173330 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275052dd-1627-4651-9f94-b1a7db2a3b59 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:23:07.214798 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9361d26-55ba-4671-ae0f-6cde4d5a34da None None] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:23:07.254110 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a9177f-8e7f-448a-9173-0e63911f6667 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:23:07.254946 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a9177f-8e7f-448a-9173-0e63911f6667 None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:23:07.255269 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a9177f-8e7f-448a-9173-0e63911f6667 None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:23:07.255541 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a9177f-8e7f-448a-9173-0e63911f6667 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:23:07.256231 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a9177f-8e7f-448a-9173-0e63911f6667 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:23:07.257623 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a9177f-8e7f-448a-9173-0e63911f6667 None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:23:07.269971 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application [None req-90a9177f-8e7f-448a-9173-0e63911f6667 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 10 05:23:07.269971 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 05:23:07.269971 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 10 05:23:07.269971 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 10 05:23:07.269971 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 10 05:23:07.269971 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 10 05:23:07.269971 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 10 05:23:07.269971 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 05:23:07.269971 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 10 05:23:07.269971 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application May 10 05:23:07.269971 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 05:23:07.269971 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application May 10 05:23:07.269971 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 05:23:07.269971 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 05:23:07.269971 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 05:23:07.269971 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 05:23:07.270933 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 05:23:07.270933 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 05:23:07.270933 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 05:23:07.270933 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 05:23:07.270933 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 05:23:07.270933 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 05:23:07.270933 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 05:23:07.270933 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 10 05:23:07.270933 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self._get_service(service_id) May 10 05:23:07.270933 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 10 05:23:07.270933 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 10 05:23:07.270933 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 05:23:07.270933 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 05:23:07.270933 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 05:23:07.270933 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 05:23:07.270933 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 05:23:07.271806 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.get_or_create( May 10 05:23:07.271806 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 05:23:07.271806 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application with Lock( May 10 05:23:07.271806 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 05:23:07.271806 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self._enter() May 10 05:23:07.271806 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 05:23:07.271806 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 05:23:07.271806 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 05:23:07.271806 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.creator() May 10 05:23:07.271806 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 05:23:07.271806 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application created_value = creator( May 10 05:23:07.271806 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 10 05:23:07.271806 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 05:23:07.271806 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 10 05:23:07.271806 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application May 10 05:23:07.276294 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 470/920] 10.222.0.23 () {56 vars in 1132 bytes} [Tue May 10 05:23:07 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 05:23:07.277579 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a9177f-8e7f-448a-9173-0e63911f6667 None admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:23:07.289091 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275052dd-1627-4651-9f94-b1a7db2a3b59 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:23:07.329797 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4710dc53-1201-4d47-b8b0-6bfeb19e1bc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:23:07.331322 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4710dc53-1201-4d47-b8b0-6bfeb19e1bc4 None admin] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:23:07.332085 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4710dc53-1201-4d47-b8b0-6bfeb19e1bc4 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:23:07.332766 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4710dc53-1201-4d47-b8b0-6bfeb19e1bc4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:23:07.334265 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4710dc53-1201-4d47-b8b0-6bfeb19e1bc4 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:23:07.336302 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4710dc53-1201-4d47-b8b0-6bfeb19e1bc4 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:23:07.371757 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 451/921] 10.222.0.23 () {60 vars in 1144 bytes} [Tue May 10 05:23:07 2022] POST /identity/v3/endpoints => generated 346 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 05:23:07.381490 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a9177f-8e7f-448a-9173-0e63911f6667 None admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:23:07.425289 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db40ab0-c515-4a7b-b8de-81e515fd09ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:23:07.426513 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db40ab0-c515-4a7b-b8de-81e515fd09ea None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:23:07.427018 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db40ab0-c515-4a7b-b8de-81e515fd09ea None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:23:07.427506 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db40ab0-c515-4a7b-b8de-81e515fd09ea None admin] PATH_INFO: `/v3/services` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:23:07.428530 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db40ab0-c515-4a7b-b8de-81e515fd09ea None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=79879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:23:07.429074 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db40ab0-c515-4a7b-b8de-81e515fd09ea None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:23:07.430763 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db40ab0-c515-4a7b-b8de-81e515fd09ea None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:23:07.437417 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 471/922] 10.222.0.23 () {56 vars in 1126 bytes} [Tue May 10 05:23:07 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 05:23:07.447796 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4710dc53-1201-4d47-b8b0-6bfeb19e1bc4 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:23:07.569841 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4710dc53-1201-4d47-b8b0-6bfeb19e1bc4 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:23:07.605352 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78b75de-a582-44d1-a0cd-6b64ec56c0f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:23:07.605949 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78b75de-a582-44d1-a0cd-6b64ec56c0f4 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:23:07.606228 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78b75de-a582-44d1-a0cd-6b64ec56c0f4 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:23:07.606494 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78b75de-a582-44d1-a0cd-6b64ec56c0f4 None admin] PATH_INFO: `/v3/services` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:23:07.607208 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78b75de-a582-44d1-a0cd-6b64ec56c0f4 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:23:07.607508 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78b75de-a582-44d1-a0cd-6b64ec56c0f4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:23:07.608899 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78b75de-a582-44d1-a0cd-6b64ec56c0f4 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:23:07.613936 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 452/923] 10.222.0.23 () {56 vars in 1126 bytes} [Tue May 10 05:23:07 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:23:07.619936 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db40ab0-c515-4a7b-b8de-81e515fd09ea None admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:23:07.723498 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db40ab0-c515-4a7b-b8de-81e515fd09ea None admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:23:07.757448 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c55c9d-1111-4094-9721-451b57b32ac8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:23:07.758121 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c55c9d-1111-4094-9721-451b57b32ac8 None admin] REQUEST_METHOD: `POST` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:23:07.758401 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c55c9d-1111-4094-9721-451b57b32ac8 None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:23:07.758675 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c55c9d-1111-4094-9721-451b57b32ac8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:23:07.759445 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c55c9d-1111-4094-9721-451b57b32ac8 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:23:07.760899 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c55c9d-1111-4094-9721-451b57b32ac8 None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:23:07.787014 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 472/924] 10.222.0.23 () {60 vars in 1144 bytes} [Tue May 10 05:23:07 2022] POST /identity/v3/endpoints => generated 347 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 05:23:08.122315 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a799ed2-6fca-4a70-aeab-8ad32d4578bb None None] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:23:08.122881 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a799ed2-6fca-4a70-aeab-8ad32d4578bb None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:23:08.122881 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a799ed2-6fca-4a70-aeab-8ad32d4578bb None None] PATH_INFO: `/` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:23:08.124731 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 453/925] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 10 05:23:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 05:23:08.132184 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdb79e9-fac0-40bd-9988-27edbf431431 None None] REQUEST_METHOD: `POST` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:23:08.132650 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdb79e9-fac0-40bd-9988-27edbf431431 None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:23:08.132760 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdb79e9-fac0-40bd-9988-27edbf431431 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:23:08.146777 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa2654e-949e-4f6e-a119-d2569d0d4517 None None] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:23:08.147056 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa2654e-949e-4f6e-a119-d2569d0d4517 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:23:08.147330 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa2654e-949e-4f6e-a119-d2569d0d4517 None None] PATH_INFO: `/` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:23:08.148993 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 454/926] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 10 05:23:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 05:23:08.152632 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.auth.core [None req-8bdb79e9-fac0-40bd-9988-27edbf431431 None None] MFA Rules not processed for user `44883b22532e44049d846938dc2cf423`. Rule list: `[]` (Enabled: `True`). {{(pid=79879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:23:08.154102 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-8bdb79e9-fac0-40bd-9988-27edbf431431 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:23:08.154213 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6814549f-31d2-4e51-8dfc-e5ceb1b3a660 None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:23:08.154423 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6814549f-31d2-4e51-8dfc-e5ceb1b3a660 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:23:08.154699 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6814549f-31d2-4e51-8dfc-e5ceb1b3a660 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:23:08.171246 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-6814549f-31d2-4e51-8dfc-e5ceb1b3a660 None None] MFA Rules not processed for user `44883b22532e44049d846938dc2cf423`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:23:08.172457 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-6814549f-31d2-4e51-8dfc-e5ceb1b3a660 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:23:08.227614 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 473/927] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 10 05:23:08 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 05:23:08.238991 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 455/928] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 10 05:23:08 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 10 05:23:08.251215 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdb79e9-fac0-40bd-9988-27edbf431431 None None] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:23:08.261272 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6814549f-31d2-4e51-8dfc-e5ceb1b3a660 None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:23:08.354118 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdb79e9-fac0-40bd-9988-27edbf431431 None None] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:23:08.356410 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6814549f-31d2-4e51-8dfc-e5ceb1b3a660 None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:23:08.391700 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf6a5c6-5966-4bfc-9ac7-1fb352789412 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:23:08.392865 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf6a5c6-5966-4bfc-9ac7-1fb352789412 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:23:08.393260 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf6a5c6-5966-4bfc-9ac7-1fb352789412 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:23:08.393533 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf6a5c6-5966-4bfc-9ac7-1fb352789412 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:23:08.394346 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf6a5c6-5966-4bfc-9ac7-1fb352789412 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:23:08.395905 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf6a5c6-5966-4bfc-9ac7-1fb352789412 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:23:08.396969 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bd4caa-d98c-43d3-89b5-6649edfd3606 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:23:08.398015 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bd4caa-d98c-43d3-89b5-6649edfd3606 None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:23:08.398620 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bd4caa-d98c-43d3-89b5-6649edfd3606 None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:23:08.398967 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bd4caa-d98c-43d3-89b5-6649edfd3606 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:23:08.409466 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application [None req-3bf6a5c6-5966-4bfc-9ac7-1fb352789412 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 10 05:23:08.409466 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 05:23:08.409466 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 10 05:23:08.409466 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 10 05:23:08.409466 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 10 05:23:08.409466 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 10 05:23:08.409466 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 10 05:23:08.409466 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 05:23:08.409466 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 10 05:23:08.409466 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application May 10 05:23:08.409466 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 05:23:08.409466 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application May 10 05:23:08.409466 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 05:23:08.409466 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 05:23:08.409466 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 05:23:08.409466 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 05:23:08.409466 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 05:23:08.410740 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 05:23:08.410740 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 05:23:08.410740 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 05:23:08.410740 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 05:23:08.410740 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 05:23:08.410740 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 05:23:08.410740 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 10 05:23:08.410740 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_service(service_id) May 10 05:23:08.410740 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 10 05:23:08.410740 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 10 05:23:08.410740 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 05:23:08.410740 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 05:23:08.410740 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 05:23:08.410740 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 05:23:08.410740 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 05:23:08.410740 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.get_or_create( May 10 05:23:08.411800 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 05:23:08.411800 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application with Lock( May 10 05:23:08.411800 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 05:23:08.411800 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._enter() May 10 05:23:08.411800 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 05:23:08.411800 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 05:23:08.411800 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 05:23:08.411800 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.creator() May 10 05:23:08.411800 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 05:23:08.411800 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application created_value = creator( May 10 05:23:08.411800 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 10 05:23:08.411800 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 05:23:08.411800 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 10 05:23:08.411800 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application May 10 05:23:08.412715 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7bd4caa-d98c-43d3-89b5-6649edfd3606 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 05:23:08.417776 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 456/929] 10.222.0.23 () {56 vars in 1126 bytes} [Tue May 10 05:23:08 2022] GET /identity/v3/services/object-store => generated 93 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 05:23:08.418719 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf6a5c6-5966-4bfc-9ac7-1fb352789412 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:23:08.420857 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application [None req-e7bd4caa-d98c-43d3-89b5-6649edfd3606 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 10 05:23:08.420857 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 05:23:08.420857 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 05:23:08.420857 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 05:23:08.420857 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 05:23:08.420857 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 05:23:08.420857 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 05:23:08.420857 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 05:23:08.420857 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 05:23:08.420857 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 05:23:08.420857 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 05:23:08.420857 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 05:23:08.420857 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 05:23:08.420857 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 05:23:08.420857 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 05:23:08.420857 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 05:23:08.422592 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 05:23:08.422592 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 05:23:08.422592 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 05:23:08.422592 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 05:23:08.422592 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 05:23:08.422592 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 05:23:08.422592 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 05:23:08.422592 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 05:23:08.422592 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 05:23:08.422592 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.get_or_create( May 10 05:23:08.422592 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 05:23:08.422592 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application with Lock( May 10 05:23:08.422592 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 05:23:08.422592 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self._enter() May 10 05:23:08.422592 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 05:23:08.422592 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 05:23:08.423680 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 05:23:08.423680 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.creator() May 10 05:23:08.423680 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 05:23:08.423680 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application created_value = creator( May 10 05:23:08.423680 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 05:23:08.423680 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 05:23:08.423680 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 05:23:08.423680 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 05:23:08.423680 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 05:23:08.423680 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 05:23:08.423680 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 10 05:23:08.423680 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application May 10 05:23:08.423680 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 474/930] 10.222.0.23 () {56 vars in 1120 bytes} [Tue May 10 05:23:08 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 05:23:08.430183 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bd4caa-d98c-43d3-89b5-6649edfd3606 None admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:23:08.542523 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bd4caa-d98c-43d3-89b5-6649edfd3606 None admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:23:08.545462 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf6a5c6-5966-4bfc-9ac7-1fb352789412 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:23:08.575130 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf15f26-b725-4b33-9e4d-0f4b66e1cfca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:23:08.575887 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf15f26-b725-4b33-9e4d-0f4b66e1cfca None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:23:08.576168 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf15f26-b725-4b33-9e4d-0f4b66e1cfca None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:23:08.576439 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf15f26-b725-4b33-9e4d-0f4b66e1cfca None admin] PATH_INFO: `/v3/roles` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:23:08.577196 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf15f26-b725-4b33-9e4d-0f4b66e1cfca None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:23:08.577500 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf15f26-b725-4b33-9e4d-0f4b66e1cfca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:23:08.578884 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf15f26-b725-4b33-9e4d-0f4b66e1cfca None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:23:08.586544 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc357030-700e-4786-9d64-0617968bc2ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:23:08.587721 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc357030-700e-4786-9d64-0617968bc2ac None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:23:08.587850 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 475/931] 10.222.0.23 () {56 vars in 1115 bytes} [Tue May 10 05:23:08 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 05:23:08.589234 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc357030-700e-4786-9d64-0617968bc2ac None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:23:08.589743 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc357030-700e-4786-9d64-0617968bc2ac None admin] PATH_INFO: `/v3/services` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:23:08.594179 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc357030-700e-4786-9d64-0617968bc2ac None admin] RBAC: Adding query filter params (name=object-store) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:23:08.594179 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc357030-700e-4786-9d64-0617968bc2ac None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:23:08.594179 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc357030-700e-4786-9d64-0617968bc2ac None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:23:08.596328 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf15f26-b725-4b33-9e4d-0f4b66e1cfca None admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:23:08.600230 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 457/932] 10.222.0.23 () {56 vars in 1122 bytes} [Tue May 10 05:23:08 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:23:08.606435 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc357030-700e-4786-9d64-0617968bc2ac None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:23:08.705554 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc357030-700e-4786-9d64-0617968bc2ac None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:23:08.718073 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf15f26-b725-4b33-9e4d-0f4b66e1cfca None admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:23:08.738624 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df643df1-cb68-41bf-a85a-8f573996fd1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:23:08.739717 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df643df1-cb68-41bf-a85a-8f573996fd1c None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:23:08.740193 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df643df1-cb68-41bf-a85a-8f573996fd1c None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:23:08.740655 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df643df1-cb68-41bf-a85a-8f573996fd1c None admin] PATH_INFO: `/v3/services` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:23:08.741579 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df643df1-cb68-41bf-a85a-8f573996fd1c None admin] RBAC: Adding query filter params (type=object-store) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:23:08.742085 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df643df1-cb68-41bf-a85a-8f573996fd1c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:23:08.743833 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df643df1-cb68-41bf-a85a-8f573996fd1c None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:23:08.754042 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa31b48-4225-46fc-b6b2-fa1e940e31de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:23:08.754594 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 458/933] 10.222.0.23 () {56 vars in 1122 bytes} [Tue May 10 05:23:08 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 05:23:08.754700 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa31b48-4225-46fc-b6b2-fa1e940e31de None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:23:08.754970 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa31b48-4225-46fc-b6b2-fa1e940e31de None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:23:08.755249 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa31b48-4225-46fc-b6b2-fa1e940e31de None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:23:08.756150 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df643df1-cb68-41bf-a85a-8f573996fd1c None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:23:08.766376 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa31b48-4225-46fc-b6b2-fa1e940e31de None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:23:08.767925 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa31b48-4225-46fc-b6b2-fa1e940e31de None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:23:08.784980 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application [None req-2aa31b48-4225-46fc-b6b2-fa1e940e31de None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 05:23:08.784980 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 05:23:08.784980 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 05:23:08.784980 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 05:23:08.784980 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 05:23:08.784980 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 05:23:08.784980 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 05:23:08.784980 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 05:23:08.784980 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 05:23:08.784980 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 05:23:08.784980 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 05:23:08.784980 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 05:23:08.784980 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 05:23:08.784980 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 05:23:08.784980 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 05:23:08.785899 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 05:23:08.785899 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 05:23:08.785899 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 05:23:08.785899 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 05:23:08.785899 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 05:23:08.785899 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 05:23:08.785899 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.get_or_create( May 10 05:23:08.785899 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 05:23:08.785899 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application with Lock( May 10 05:23:08.785899 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 05:23:08.785899 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self._enter() May 10 05:23:08.785899 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 05:23:08.785899 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 05:23:08.785899 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 05:23:08.785899 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.creator() May 10 05:23:08.785899 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 05:23:08.785899 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application created_value = creator( May 10 05:23:08.786783 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 05:23:08.786783 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 05:23:08.786783 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 05:23:08.786783 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application May 10 05:23:08.790944 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 476/934] 10.222.0.23 () {56 vars in 1108 bytes} [Tue May 10 05:23:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 05:23:08.792235 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa31b48-4225-46fc-b6b2-fa1e940e31de None admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:23:08.854729 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df643df1-cb68-41bf-a85a-8f573996fd1c None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:23:08.890630 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa31b48-4225-46fc-b6b2-fa1e940e31de None admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:23:08.892581 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032d853c-8063-430d-ae45-2ffdcd976695 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:23:08.894108 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032d853c-8063-430d-ae45-2ffdcd976695 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:23:08.894519 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032d853c-8063-430d-ae45-2ffdcd976695 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:23:08.894865 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032d853c-8063-430d-ae45-2ffdcd976695 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:23:08.895785 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032d853c-8063-430d-ae45-2ffdcd976695 None admin] RBAC: Adding query filter params (interface=public, service_id=b6b1349f073b4faab824caf493037bf3, region_id=RegionOne) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:23:08.896167 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032d853c-8063-430d-ae45-2ffdcd976695 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:23:08.897605 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032d853c-8063-430d-ae45-2ffdcd976695 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:23:08.904520 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 459/935] 10.222.0.23 () {56 vars in 1251 bytes} [Tue May 10 05:23:08 2022] GET /identity/v3/endpoints?service_id=b6b1349f073b4faab824caf493037bf3&interface=public®ion_id=RegionOne => generated 194 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:23:08.912552 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032d853c-8063-430d-ae45-2ffdcd976695 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:23:08.932170 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4033ade-016f-4bfe-979d-20ef8cb3126f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:23:08.933000 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4033ade-016f-4bfe-979d-20ef8cb3126f None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:23:08.933343 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4033ade-016f-4bfe-979d-20ef8cb3126f None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:23:08.933684 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4033ade-016f-4bfe-979d-20ef8cb3126f None admin] PATH_INFO: `/v3/domains` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:23:08.934909 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4033ade-016f-4bfe-979d-20ef8cb3126f None admin] RBAC: Adding query filter params (name=Default) {{(pid=79879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:23:08.935275 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4033ade-016f-4bfe-979d-20ef8cb3126f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:23:08.936998 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4033ade-016f-4bfe-979d-20ef8cb3126f None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:23:08.955769 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 477/936] 10.222.0.23 () {56 vars in 1109 bytes} [Tue May 10 05:23:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 05:23:08.962188 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4033ade-016f-4bfe-979d-20ef8cb3126f None admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:23:09.033452 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032d853c-8063-430d-ae45-2ffdcd976695 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:23:09.065317 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4033ade-016f-4bfe-979d-20ef8cb3126f None admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:23:09.072276 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e3c9a5-7382-4888-8d9f-e02b0ec2ab30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:23:09.073181 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e3c9a5-7382-4888-8d9f-e02b0ec2ab30 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:23:09.073634 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e3c9a5-7382-4888-8d9f-e02b0ec2ab30 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:23:09.074105 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e3c9a5-7382-4888-8d9f-e02b0ec2ab30 None admin] PATH_INFO: `/v3/services` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:23:09.074958 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e3c9a5-7382-4888-8d9f-e02b0ec2ab30 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:23:09.076509 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e3c9a5-7382-4888-8d9f-e02b0ec2ab30 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:23:09.091911 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 460/937] 10.222.0.23 () {56 vars in 1087 bytes} [Tue May 10 05:23:08 2022] GET /identity/v3/services => generated 1497 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 05:23:09.103080 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53946bb-dd39-4ae6-bd60-5370f24140be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:23:09.103963 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53946bb-dd39-4ae6-bd60-5370f24140be None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:23:09.104247 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53946bb-dd39-4ae6-bd60-5370f24140be None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:23:09.104520 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53946bb-dd39-4ae6-bd60-5370f24140be None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:23:09.113310 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53946bb-dd39-4ae6-bd60-5370f24140be None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:23:09.114809 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53946bb-dd39-4ae6-bd60-5370f24140be None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:23:09.132025 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application [None req-f53946bb-dd39-4ae6-bd60-5370f24140be None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 10 05:23:09.132025 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 05:23:09.132025 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 05:23:09.132025 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 05:23:09.132025 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 05:23:09.132025 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 05:23:09.132025 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 05:23:09.132025 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 05:23:09.132025 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 05:23:09.132025 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 05:23:09.132025 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 05:23:09.132025 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 05:23:09.132025 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 05:23:09.132025 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 05:23:09.132025 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 05:23:09.132025 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 05:23:09.133458 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 05:23:09.133458 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 05:23:09.133458 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 05:23:09.133458 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 05:23:09.133458 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 05:23:09.133458 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 05:23:09.133458 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 05:23:09.133458 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 05:23:09.133458 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 05:23:09.133458 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.get_or_create( May 10 05:23:09.133458 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 05:23:09.133458 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application with Lock( May 10 05:23:09.133458 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 05:23:09.133458 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self._enter() May 10 05:23:09.133458 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 05:23:09.133458 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 05:23:09.133458 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 05:23:09.133458 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.creator() May 10 05:23:09.134389 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 05:23:09.134389 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application created_value = creator( May 10 05:23:09.134389 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 05:23:09.134389 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 05:23:09.134389 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 05:23:09.134389 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 05:23:09.134389 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 05:23:09.134389 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 05:23:09.134389 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 10 05:23:09.134389 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application May 10 05:23:09.138174 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 478/938] 10.222.0.23 () {56 vars in 1117 bytes} [Tue May 10 05:23:08 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 05:23:09.139563 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e3c9a5-7382-4888-8d9f-e02b0ec2ab30 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:23:09.247127 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e3c9a5-7382-4888-8d9f-e02b0ec2ab30 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:23:09.282020 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807375bc-e9c1-452d-a78e-20f8d73696fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:23:09.282720 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807375bc-e9c1-452d-a78e-20f8d73696fa None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:23:09.283003 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807375bc-e9c1-452d-a78e-20f8d73696fa None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:23:09.283277 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807375bc-e9c1-452d-a78e-20f8d73696fa None admin] PATH_INFO: `/v3/users` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:23:09.284236 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807375bc-e9c1-452d-a78e-20f8d73696fa None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:23:09.284537 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807375bc-e9c1-452d-a78e-20f8d73696fa None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:23:09.286132 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807375bc-e9c1-452d-a78e-20f8d73696fa None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:23:09.306188 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 461/939] 10.222.0.23 () {56 vars in 1149 bytes} [Tue May 10 05:23:09 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:23:09.309948 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53946bb-dd39-4ae6-bd60-5370f24140be None admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:23:09.414161 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53946bb-dd39-4ae6-bd60-5370f24140be None admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:23:09.448127 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1049ba8-048e-4852-b2fa-f405a6d23e6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:23:09.448958 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1049ba8-048e-4852-b2fa-f405a6d23e6c None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:23:09.449240 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1049ba8-048e-4852-b2fa-f405a6d23e6c None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:23:09.449514 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1049ba8-048e-4852-b2fa-f405a6d23e6c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:23:09.459689 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1049ba8-048e-4852-b2fa-f405a6d23e6c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:23:09.461176 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1049ba8-048e-4852-b2fa-f405a6d23e6c None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:23:09.490187 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application [None req-a1049ba8-048e-4852-b2fa-f405a6d23e6c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 05:23:09.490187 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 05:23:09.490187 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 05:23:09.490187 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 05:23:09.490187 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 05:23:09.490187 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 05:23:09.490187 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 05:23:09.490187 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 05:23:09.490187 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 05:23:09.490187 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 05:23:09.490187 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 05:23:09.490187 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 05:23:09.490187 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 05:23:09.490187 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 05:23:09.490187 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 05:23:09.492276 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 05:23:09.492276 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 05:23:09.492276 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 05:23:09.492276 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 05:23:09.492276 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 05:23:09.492276 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 05:23:09.492276 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.get_or_create( May 10 05:23:09.492276 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 05:23:09.492276 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application with Lock( May 10 05:23:09.492276 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 05:23:09.492276 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self._enter() May 10 05:23:09.492276 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 05:23:09.492276 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 05:23:09.492276 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 05:23:09.492276 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.creator() May 10 05:23:09.492276 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 05:23:09.492276 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application created_value = creator( May 10 05:23:09.494302 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 05:23:09.494302 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 05:23:09.494302 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 05:23:09.494302 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application May 10 05:23:09.496680 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 479/940] 10.222.0.23 () {56 vars in 1108 bytes} [Tue May 10 05:23:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 05:23:09.497977 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807375bc-e9c1-452d-a78e-20f8d73696fa None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:23:09.598835 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807375bc-e9c1-452d-a78e-20f8d73696fa None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:23:09.637169 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f94aa1f-f213-4599-9d05-b8999b60d6fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:23:09.637908 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f94aa1f-f213-4599-9d05-b8999b60d6fb None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:23:09.638234 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f94aa1f-f213-4599-9d05-b8999b60d6fb None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:23:09.638511 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f94aa1f-f213-4599-9d05-b8999b60d6fb None admin] PATH_INFO: `/v3/domains` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:23:09.639253 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f94aa1f-f213-4599-9d05-b8999b60d6fb None admin] RBAC: Adding query filter params (name=Default) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:23:09.639551 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f94aa1f-f213-4599-9d05-b8999b60d6fb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:23:09.640968 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f94aa1f-f213-4599-9d05-b8999b60d6fb None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:23:09.657483 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 462/941] 10.222.0.23 () {56 vars in 1109 bytes} [Tue May 10 05:23:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:23:09.658864 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1049ba8-048e-4852-b2fa-f405a6d23e6c None admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:23:09.758662 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1049ba8-048e-4852-b2fa-f405a6d23e6c None admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:23:09.783327 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a291d892-2f3e-451a-a540-a8e9763380ac None None] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:23:09.783706 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a291d892-2f3e-451a-a540-a8e9763380ac None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:23:09.783940 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a291d892-2f3e-451a-a540-a8e9763380ac None None] PATH_INFO: `/` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:23:09.785832 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 463/942] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 10 05:23:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 05:23:09.790849 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e6f2c8-2fc8-4a3f-af9a-a378c8a42cbb None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:23:09.791134 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e6f2c8-2fc8-4a3f-af9a-a378c8a42cbb None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:23:09.791414 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e6f2c8-2fc8-4a3f-af9a-a378c8a42cbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:23:09.793516 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5624ad3e-2af0-4b4a-ab5f-931c6728257e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:23:09.794323 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5624ad3e-2af0-4b4a-ab5f-931c6728257e None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:23:09.794604 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5624ad3e-2af0-4b4a-ab5f-931c6728257e None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:23:09.794868 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5624ad3e-2af0-4b4a-ab5f-931c6728257e None admin] PATH_INFO: `/v3/projects/service` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:23:09.803684 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5624ad3e-2af0-4b4a-ab5f-931c6728257e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:23:09.805441 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5624ad3e-2af0-4b4a-ab5f-931c6728257e None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:23:09.808325 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-d8e6f2c8-2fc8-4a3f-af9a-a378c8a42cbb None None] MFA Rules not processed for user `44883b22532e44049d846938dc2cf423`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:23:09.809505 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-d8e6f2c8-2fc8-4a3f-af9a-a378c8a42cbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:23:09.821904 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application [None req-5624ad3e-2af0-4b4a-ab5f-931c6728257e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 05:23:09.821904 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 05:23:09.821904 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 05:23:09.821904 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 05:23:09.821904 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 05:23:09.821904 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 05:23:09.821904 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 05:23:09.821904 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 05:23:09.821904 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 05:23:09.821904 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 05:23:09.821904 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 05:23:09.821904 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 05:23:09.821904 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 05:23:09.821904 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 05:23:09.821904 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 05:23:09.823161 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 05:23:09.823161 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 05:23:09.823161 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 05:23:09.823161 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 05:23:09.823161 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 05:23:09.823161 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 05:23:09.823161 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.get_or_create( May 10 05:23:09.823161 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 05:23:09.823161 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application with Lock( May 10 05:23:09.823161 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 05:23:09.823161 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self._enter() May 10 05:23:09.823161 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 05:23:09.823161 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 05:23:09.823161 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 05:23:09.823161 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.creator() May 10 05:23:09.823161 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 05:23:09.823161 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application created_value = creator( May 10 05:23:09.824340 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 05:23:09.824340 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 05:23:09.824340 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 05:23:09.824340 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 05:23:09.824340 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 05:23:09.824340 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 05:23:09.824340 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 05:23:09.824340 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application May 10 05:23:09.827666 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 480/943] 10.222.0.23 () {56 vars in 1111 bytes} [Tue May 10 05:23:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 05:23:09.829967 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5624ad3e-2af0-4b4a-ab5f-931c6728257e None admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:23:09.887750 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 464/944] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 10 05:23:09 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 10 05:23:09.904891 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e6f2c8-2fc8-4a3f-af9a-a378c8a42cbb None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:23:09.952254 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5624ad3e-2af0-4b4a-ab5f-931c6728257e None admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:23:09.986823 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298f92e5-ff20-481e-b9a6-fa53135e1eab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:23:09.987697 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298f92e5-ff20-481e-b9a6-fa53135e1eab None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:23:09.988125 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298f92e5-ff20-481e-b9a6-fa53135e1eab None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:23:09.988491 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298f92e5-ff20-481e-b9a6-fa53135e1eab None admin] PATH_INFO: `/v3/projects` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:23:09.989393 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298f92e5-ff20-481e-b9a6-fa53135e1eab None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:23:09.989801 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298f92e5-ff20-481e-b9a6-fa53135e1eab None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:23:09.991347 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298f92e5-ff20-481e-b9a6-fa53135e1eab None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:23:10.009168 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 481/945] 10.222.0.23 () {56 vars in 1148 bytes} [Tue May 10 05:23:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 05:23:10.010076 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298f92e5-ff20-481e-b9a6-fa53135e1eab None admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:23:10.013157 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e6f2c8-2fc8-4a3f-af9a-a378c8a42cbb None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:23:10.054484 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fc0c17-b01b-4bde-bf28-31cb376fbc2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:23:10.055433 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fc0c17-b01b-4bde-bf28-31cb376fbc2f None admin] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:23:10.055750 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fc0c17-b01b-4bde-bf28-31cb376fbc2f None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:23:10.056025 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fc0c17-b01b-4bde-bf28-31cb376fbc2f None admin] PATH_INFO: `/v3/projects` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:23:10.056911 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6fc0c17-b01b-4bde-bf28-31cb376fbc2f None admin] RBAC: Authorizing `identity:create_project()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:23:10.059014 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6fc0c17-b01b-4bde-bf28-31cb376fbc2f None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:23:10.060853 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: WARNING keystone.server.flask.common [None req-b6fc0c17-b01b-4bde-bf28-31cb376fbc2f None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. May 10 05:23:10.078503 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.sql.core [None req-b6fc0c17-b01b-4bde-bf28-31cb376fbc2f None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 10 05:23:10.078503 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] May 10 05:23:10.078503 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [parameters: {'id': '170bdbc9dc3646c7a4efd89249c97c42', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] May 10 05:23:10.078503 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=79880) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 10 05:23:10.094696 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application [None req-b6fc0c17-b01b-4bde-bf28-31cb376fbc2f None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 170bdbc9dc3646c7a4efd89249c97c42.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 170bdbc9dc3646c7a4efd89249c97c42. May 10 05:23:10.094696 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 05:23:10.094696 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 10 05:23:10.094696 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application self.dialect.do_execute( May 10 05:23:10.094696 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 10 05:23:10.094696 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 10 05:23:10.094696 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 10 05:23:10.094696 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application result = self._query(query) May 10 05:23:10.094696 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 10 05:23:10.094696 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application conn.query(q) May 10 05:23:10.094696 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 10 05:23:10.094696 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 10 05:23:10.094696 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 10 05:23:10.095801 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application result.read() May 10 05:23:10.095801 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 10 05:23:10.095801 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 10 05:23:10.095801 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 10 05:23:10.095801 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application packet.raise_for_error() May 10 05:23:10.095801 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 10 05:23:10.095801 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 10 05:23:10.095801 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 10 05:23:10.095801 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 10 05:23:10.095801 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 10 05:23:10.095801 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application May 10 05:23:10.095801 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 10 05:23:10.095801 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application May 10 05:23:10.095801 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 05:23:10.095801 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 10 05:23:10.095801 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 10 05:23:10.095801 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project May 10 05:23:10.095801 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return project_ref.to_dict() May 10 05:23:10.096781 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 10 05:23:10.096781 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application next(self.gen) May 10 05:23:10.096781 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 10 05:23:10.096781 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application yield resource May 10 05:23:10.096781 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 10 05:23:10.096781 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application next(self.gen) May 10 05:23:10.096781 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 10 05:23:10.096781 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application self.session.rollback() May 10 05:23:10.096781 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 10 05:23:10.096781 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application self.force_reraise() May 10 05:23:10.096781 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 10 05:23:10.096781 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application raise self.value May 10 05:23:10.096781 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 10 05:23:10.096781 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 10 05:23:10.096781 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 10 05:23:10.096781 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application session.commit() May 10 05:23:10.096781 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 10 05:23:10.097856 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 10 05:23:10.097856 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 10 05:23:10.097856 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application self._prepare_impl() May 10 05:23:10.097856 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 10 05:23:10.097856 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application self.session.flush() May 10 05:23:10.097856 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 10 05:23:10.097856 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application self._flush(objects) May 10 05:23:10.097856 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 10 05:23:10.097856 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 10 05:23:10.097856 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 10 05:23:10.097856 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application compat.raise_( May 10 05:23:10.097856 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 10 05:23:10.097856 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application raise exception May 10 05:23:10.097856 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 10 05:23:10.097856 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application flush_context.execute() May 10 05:23:10.097856 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 10 05:23:10.097856 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application rec.execute(self) May 10 05:23:10.098759 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 10 05:23:10.098759 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 10 05:23:10.098759 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 10 05:23:10.098759 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application _emit_insert_statements( May 10 05:23:10.098759 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements May 10 05:23:10.098759 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application c = connection._execute_20( May 10 05:23:10.098759 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 10 05:23:10.098759 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 10 05:23:10.098759 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 10 05:23:10.098759 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 10 05:23:10.098759 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 10 05:23:10.098759 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application ret = self._execute_context( May 10 05:23:10.098759 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 10 05:23:10.098759 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 10 05:23:10.098759 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 10 05:23:10.099568 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 10 05:23:10.099568 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 10 05:23:10.099568 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application raise exception May 10 05:23:10.099568 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 10 05:23:10.099568 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application self.dialect.do_execute( May 10 05:23:10.099568 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 10 05:23:10.099568 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 10 05:23:10.099568 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 10 05:23:10.099568 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application result = self._query(query) May 10 05:23:10.099568 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 10 05:23:10.099568 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application conn.query(q) May 10 05:23:10.099568 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 10 05:23:10.099568 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 10 05:23:10.099568 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 10 05:23:10.099568 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application result.read() May 10 05:23:10.099568 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 10 05:23:10.099568 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 10 05:23:10.100493 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 10 05:23:10.100493 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application packet.raise_for_error() May 10 05:23:10.100493 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 10 05:23:10.100493 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 10 05:23:10.100493 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 10 05:23:10.100493 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 10 05:23:10.100493 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 10 05:23:10.100493 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] May 10 05:23:10.100493 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application [parameters: {'id': '170bdbc9dc3646c7a4efd89249c97c42', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] May 10 05:23:10.100493 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 10 05:23:10.100493 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application May 10 05:23:10.100493 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 05:23:10.100493 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application May 10 05:23:10.100493 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 05:23:10.100493 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project May 10 05:23:10.101556 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) May 10 05:23:10.101556 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 10 05:23:10.101556 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 10 05:23:10.101556 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. May 10 05:23:10.101556 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application May 10 05:23:10.101556 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 05:23:10.101556 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application May 10 05:23:10.101556 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 05:23:10.101556 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 05:23:10.101556 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 05:23:10.101556 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 05:23:10.101556 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 05:23:10.101556 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 05:23:10.101556 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 05:23:10.101556 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 05:23:10.101556 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 05:23:10.101556 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 05:23:10.102491 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 05:23:10.102491 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post May 10 05:23:10.102491 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( May 10 05:23:10.102491 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 05:23:10.102491 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 05:23:10.102491 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project May 10 05:23:10.102491 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application raise exception.Conflict( May 10 05:23:10.102491 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 170bdbc9dc3646c7a4efd89249c97c42. May 10 05:23:10.102491 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application May 10 05:23:10.102491 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 465/946] 10.222.0.23 () {60 vars in 1140 bytes} [Tue May 10 05:23:09 2022] POST /identity/v3/projects => generated 262 bytes in 192 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) May 10 05:23:10.102491 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad09d43f-01b4-43fc-ab63-50807388fa80 None None] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:23:10.102491 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad09d43f-01b4-43fc-ab63-50807388fa80 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:23:10.103174 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad09d43f-01b4-43fc-ab63-50807388fa80 None None] PATH_INFO: `/` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:23:10.103174 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 466/947] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 10 05:23:10 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 05:23:10.105196 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad09d43f-01b4-43fc-ab63-50807388fa80 None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:23:10.117507 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298f92e5-ff20-481e-b9a6-fa53135e1eab None admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:23:10.150560 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8725ced5-858e-412b-8a38-10da60ae34f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:23:10.151599 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8725ced5-858e-412b-8a38-10da60ae34f3 None admin] REQUEST_METHOD: `PUT` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:23:10.152300 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8725ced5-858e-412b-8a38-10da60ae34f3 None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:23:10.152555 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8725ced5-858e-412b-8a38-10da60ae34f3 None admin] PATH_INFO: `/v3/projects/5f23435f783540199d6dcfd0417c090e/users/c5281b2a1c9a461995653be826207db4/roles/635210106d69457ba45e9fa6dd0b9754` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:23:10.154750 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8725ced5-858e-412b-8a38-10da60ae34f3 None admin] RBAC: Authorizing `identity:create_grant(project_id=5f23435f783540199d6dcfd0417c090e, user_id=c5281b2a1c9a461995653be826207db4, role_id=635210106d69457ba45e9fa6dd0b9754)` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:23:10.156252 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8725ced5-858e-412b-8a38-10da60ae34f3 None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:23:10.175623 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 482/948] 10.222.0.23 () {58 vars in 1439 bytes} [Tue May 10 05:23:10 2022] PUT /identity/v3/projects/5f23435f783540199d6dcfd0417c090e/users/c5281b2a1c9a461995653be826207db4/roles/635210106d69457ba45e9fa6dd0b9754 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 05:23:10.175623 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22314fc-8dd0-4299-9bbe-1a13aaa64b5d None None] REQUEST_METHOD: `POST` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:23:10.175623 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22314fc-8dd0-4299-9bbe-1a13aaa64b5d None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:23:10.175623 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22314fc-8dd0-4299-9bbe-1a13aaa64b5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:23:10.196580 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.auth.core [None req-b22314fc-8dd0-4299-9bbe-1a13aaa64b5d None None] MFA Rules not processed for user `44883b22532e44049d846938dc2cf423`. Rule list: `[]` (Enabled: `True`). {{(pid=79879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:23:10.197862 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-b22314fc-8dd0-4299-9bbe-1a13aaa64b5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:23:10.217062 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad09d43f-01b4-43fc-ab63-50807388fa80 None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:23:10.253364 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d97bd4-1ae0-49a1-90de-9efa9bfc908a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:23:10.254275 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d97bd4-1ae0-49a1-90de-9efa9bfc908a None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:23:10.254550 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d97bd4-1ae0-49a1-90de-9efa9bfc908a None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:23:10.254818 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d97bd4-1ae0-49a1-90de-9efa9bfc908a None admin] PATH_INFO: `/v3/projects/service` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:23:10.262409 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d97bd4-1ae0-49a1-90de-9efa9bfc908a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:23:10.263976 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d97bd4-1ae0-49a1-90de-9efa9bfc908a None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:23:10.279622 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application [None req-51d97bd4-1ae0-49a1-90de-9efa9bfc908a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 05:23:10.279622 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 05:23:10.279622 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 05:23:10.279622 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 05:23:10.279622 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 05:23:10.279622 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 05:23:10.279622 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 05:23:10.279622 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 05:23:10.279622 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 05:23:10.279622 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 05:23:10.279622 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 05:23:10.279622 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 05:23:10.279622 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 05:23:10.279622 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 05:23:10.279622 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 05:23:10.280624 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 05:23:10.280624 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 05:23:10.280624 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 05:23:10.280624 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 05:23:10.280624 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 05:23:10.280624 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 05:23:10.280624 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.get_or_create( May 10 05:23:10.280624 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 05:23:10.280624 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application with Lock( May 10 05:23:10.280624 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 05:23:10.280624 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._enter() May 10 05:23:10.280624 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 05:23:10.280624 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 05:23:10.280624 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 05:23:10.280624 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.creator() May 10 05:23:10.280624 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 05:23:10.280624 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application created_value = creator( May 10 05:23:10.281529 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 05:23:10.281529 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 05:23:10.281529 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 05:23:10.281529 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 05:23:10.281529 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 05:23:10.281529 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 05:23:10.281529 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 05:23:10.281529 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application May 10 05:23:10.281529 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 467/949] 10.222.0.23 () {56 vars in 1111 bytes} [Tue May 10 05:23:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 05:23:10.289831 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d97bd4-1ae0-49a1-90de-9efa9bfc908a None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:23:10.299390 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 483/950] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 10 05:23:10 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 05:23:10.323212 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22314fc-8dd0-4299-9bbe-1a13aaa64b5d None None] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:23:10.415203 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d97bd4-1ae0-49a1-90de-9efa9bfc908a None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:23:10.427469 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22314fc-8dd0-4299-9bbe-1a13aaa64b5d None None] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:23:10.456262 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28745d2d-6a67-4723-a754-ab08b913357b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:23:10.457019 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28745d2d-6a67-4723-a754-ab08b913357b None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:23:10.457455 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28745d2d-6a67-4723-a754-ab08b913357b None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:23:10.457737 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28745d2d-6a67-4723-a754-ab08b913357b None admin] PATH_INFO: `/v3/projects` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:23:10.459091 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28745d2d-6a67-4723-a754-ab08b913357b None admin] RBAC: Adding query filter params (name=service) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:23:10.459405 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28745d2d-6a67-4723-a754-ab08b913357b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:23:10.461502 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28745d2d-6a67-4723-a754-ab08b913357b None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:23:10.475301 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca36ec26-efef-4b59-a904-3a712235dea2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:23:10.476153 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca36ec26-efef-4b59-a904-3a712235dea2 None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:23:10.476430 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca36ec26-efef-4b59-a904-3a712235dea2 None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:23:10.476701 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca36ec26-efef-4b59-a904-3a712235dea2 None admin] PATH_INFO: `/v3/services/compute` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:23:10.477371 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca36ec26-efef-4b59-a904-3a712235dea2 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:23:10.478760 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca36ec26-efef-4b59-a904-3a712235dea2 None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:23:10.491015 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application [None req-ca36ec26-efef-4b59-a904-3a712235dea2 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 10 05:23:10.491015 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 05:23:10.491015 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 10 05:23:10.491015 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 10 05:23:10.491015 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 10 05:23:10.491015 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 10 05:23:10.491015 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 10 05:23:10.491015 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 05:23:10.491015 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 10 05:23:10.491015 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application May 10 05:23:10.491015 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 05:23:10.491015 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application May 10 05:23:10.491015 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 05:23:10.491015 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 05:23:10.491015 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 05:23:10.491015 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 05:23:10.491015 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 05:23:10.492176 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 05:23:10.492176 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 05:23:10.492176 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 05:23:10.492176 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 05:23:10.492176 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 05:23:10.492176 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 05:23:10.492176 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 10 05:23:10.492176 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self._get_service(service_id) May 10 05:23:10.492176 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 10 05:23:10.492176 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 10 05:23:10.492176 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 05:23:10.492176 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 05:23:10.492176 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 05:23:10.492176 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 05:23:10.492176 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 05:23:10.492176 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.get_or_create( May 10 05:23:10.493488 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 05:23:10.493488 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application with Lock( May 10 05:23:10.493488 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 05:23:10.493488 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self._enter() May 10 05:23:10.493488 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 05:23:10.493488 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 05:23:10.493488 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 05:23:10.493488 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.creator() May 10 05:23:10.493488 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 05:23:10.493488 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application created_value = creator( May 10 05:23:10.493488 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 10 05:23:10.493488 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 05:23:10.493488 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 10 05:23:10.493488 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application May 10 05:23:10.493488 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 484/952] 10.222.0.23 () {56 vars in 1111 bytes} [Tue May 10 05:23:10 2022] GET /identity/v3/services/compute => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 05:23:10.494799 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 468/952] 10.222.0.23 () {56 vars in 1112 bytes} [Tue May 10 05:23:10 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 05:23:10.498999 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca36ec26-efef-4b59-a904-3a712235dea2 None admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:23:10.605992 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca36ec26-efef-4b59-a904-3a712235dea2 None admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:23:10.641806 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6348bcc-11b9-4999-901e-07aee54af58e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:23:10.642506 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6348bcc-11b9-4999-901e-07aee54af58e None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:23:10.642785 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6348bcc-11b9-4999-901e-07aee54af58e None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:23:10.643060 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6348bcc-11b9-4999-901e-07aee54af58e None admin] PATH_INFO: `/v3/services` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:23:10.643812 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6348bcc-11b9-4999-901e-07aee54af58e None admin] RBAC: Adding query filter params (name=compute) {{(pid=79879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:23:10.644118 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6348bcc-11b9-4999-901e-07aee54af58e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:23:10.645589 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6348bcc-11b9-4999-901e-07aee54af58e None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:23:10.651243 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 485/953] 10.222.0.23 () {56 vars in 1112 bytes} [Tue May 10 05:23:10 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:23:10.657101 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28745d2d-6a67-4723-a754-ab08b913357b None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:23:10.761605 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28745d2d-6a67-4723-a754-ab08b913357b None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:23:10.797299 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2707617f-63ee-4821-a835-b0d827b7bbc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:23:10.797975 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2707617f-63ee-4821-a835-b0d827b7bbc5 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:23:10.798254 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2707617f-63ee-4821-a835-b0d827b7bbc5 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:23:10.798526 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2707617f-63ee-4821-a835-b0d827b7bbc5 None admin] PATH_INFO: `/v3/services` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:23:10.799252 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2707617f-63ee-4821-a835-b0d827b7bbc5 None admin] RBAC: Adding query filter params (type=compute) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:23:10.799553 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2707617f-63ee-4821-a835-b0d827b7bbc5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:23:10.801018 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2707617f-63ee-4821-a835-b0d827b7bbc5 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:23:10.806182 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 469/954] 10.222.0.23 () {56 vars in 1112 bytes} [Tue May 10 05:23:10 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:23:11.406038 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b171b7-33fa-47ca-b191-af3f2e15029a None None] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:23:11.406769 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b171b7-33fa-47ca-b191-af3f2e15029a None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:23:11.406769 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b171b7-33fa-47ca-b191-af3f2e15029a None None] PATH_INFO: `/` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:23:11.408126 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 486/955] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 10 05:23:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 05:23:11.416267 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf7cd40-6dbf-4042-9a7d-05e2e9123ad5 None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:23:11.416267 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf7cd40-6dbf-4042-9a7d-05e2e9123ad5 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:23:11.416267 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf7cd40-6dbf-4042-9a7d-05e2e9123ad5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:23:11.433119 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-5bf7cd40-6dbf-4042-9a7d-05e2e9123ad5 None None] MFA Rules not processed for user `44883b22532e44049d846938dc2cf423`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:23:11.434950 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-5bf7cd40-6dbf-4042-9a7d-05e2e9123ad5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:23:11.506692 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 470/956] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 10 05:23:11 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 05:23:11.537397 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b171b7-33fa-47ca-b191-af3f2e15029a None None] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:23:11.640714 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b171b7-33fa-47ca-b191-af3f2e15029a None None] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:23:11.673780 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d589ea74-085b-4000-b617-e9cef225cb4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:23:11.674525 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d589ea74-085b-4000-b617-e9cef225cb4c None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:23:11.674805 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d589ea74-085b-4000-b617-e9cef225cb4c None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:23:11.675076 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d589ea74-085b-4000-b617-e9cef225cb4c None admin] PATH_INFO: `/v3/services/object-store` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:23:11.675816 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d589ea74-085b-4000-b617-e9cef225cb4c None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:23:11.677203 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d589ea74-085b-4000-b617-e9cef225cb4c None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:23:11.689087 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application [None req-d589ea74-085b-4000-b617-e9cef225cb4c None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 10 05:23:11.689087 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 05:23:11.689087 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 10 05:23:11.689087 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 10 05:23:11.689087 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 10 05:23:11.689087 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 10 05:23:11.689087 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 10 05:23:11.689087 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 05:23:11.689087 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 10 05:23:11.689087 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application May 10 05:23:11.689087 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 05:23:11.689087 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application May 10 05:23:11.689087 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 05:23:11.689087 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 05:23:11.689087 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 05:23:11.689087 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 05:23:11.689087 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 05:23:11.690050 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 05:23:11.690050 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 05:23:11.690050 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 05:23:11.690050 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 05:23:11.690050 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 05:23:11.690050 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 05:23:11.690050 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 10 05:23:11.690050 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self._get_service(service_id) May 10 05:23:11.690050 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 10 05:23:11.690050 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 10 05:23:11.690050 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 05:23:11.690050 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 05:23:11.690050 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 05:23:11.690050 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 05:23:11.690050 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 05:23:11.690050 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.get_or_create( May 10 05:23:11.690933 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 05:23:11.690933 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application with Lock( May 10 05:23:11.690933 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 05:23:11.690933 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self._enter() May 10 05:23:11.690933 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 05:23:11.690933 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 05:23:11.690933 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 05:23:11.690933 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.creator() May 10 05:23:11.690933 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 05:23:11.690933 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application created_value = creator( May 10 05:23:11.690933 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 10 05:23:11.690933 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 05:23:11.690933 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 10 05:23:11.690933 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application May 10 05:23:11.690933 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 487/957] 10.222.0.23 () {56 vars in 1126 bytes} [Tue May 10 05:23:11 2022] GET /identity/v3/services/object-store => generated 93 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 05:23:11.698553 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf7cd40-6dbf-4042-9a7d-05e2e9123ad5 None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:23:11.800000 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf7cd40-6dbf-4042-9a7d-05e2e9123ad5 None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:23:11.838881 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342c6029-5588-4065-85fd-c7757fc64219 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:23:11.839965 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342c6029-5588-4065-85fd-c7757fc64219 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:23:11.840472 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342c6029-5588-4065-85fd-c7757fc64219 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:23:11.840963 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342c6029-5588-4065-85fd-c7757fc64219 None admin] PATH_INFO: `/v3/services` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:23:11.841902 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342c6029-5588-4065-85fd-c7757fc64219 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:23:11.842485 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342c6029-5588-4065-85fd-c7757fc64219 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:23:11.844113 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342c6029-5588-4065-85fd-c7757fc64219 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:23:11.849568 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 471/958] 10.222.0.23 () {56 vars in 1122 bytes} [Tue May 10 05:23:11 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:23:11.855913 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d589ea74-085b-4000-b617-e9cef225cb4c None admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:23:11.961378 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d589ea74-085b-4000-b617-e9cef225cb4c None admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:23:11.995162 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df14ced-3c2d-4de8-a2f7-f49cde893346 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:23:11.995876 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df14ced-3c2d-4de8-a2f7-f49cde893346 None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:23:11.996521 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df14ced-3c2d-4de8-a2f7-f49cde893346 None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:23:11.996798 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df14ced-3c2d-4de8-a2f7-f49cde893346 None admin] PATH_INFO: `/v3/services` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:23:11.997515 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df14ced-3c2d-4de8-a2f7-f49cde893346 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=79879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:23:11.997817 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df14ced-3c2d-4de8-a2f7-f49cde893346 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:23:11.999196 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df14ced-3c2d-4de8-a2f7-f49cde893346 None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:23:12.004540 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 488/959] 10.222.0.23 () {56 vars in 1122 bytes} [Tue May 10 05:23:11 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:23:12.010336 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342c6029-5588-4065-85fd-c7757fc64219 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:23:12.107277 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342c6029-5588-4065-85fd-c7757fc64219 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:23:12.141041 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864ee32c-b4be-4d5f-af3c-7653bcc471c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:23:12.142139 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864ee32c-b4be-4d5f-af3c-7653bcc471c5 None admin] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:23:12.142616 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864ee32c-b4be-4d5f-af3c-7653bcc471c5 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:23:12.143103 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864ee32c-b4be-4d5f-af3c-7653bcc471c5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:23:12.144082 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864ee32c-b4be-4d5f-af3c-7653bcc471c5 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:23:12.145692 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864ee32c-b4be-4d5f-af3c-7653bcc471c5 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:23:12.166609 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 472/960] 10.222.0.23 () {60 vars in 1144 bytes} [Tue May 10 05:23:12 2022] POST /identity/v3/endpoints => generated 349 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 05:23:12.517813 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9aa0cad-1fe2-489c-b58f-42448dd03a19 None None] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:23:12.518346 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9aa0cad-1fe2-489c-b58f-42448dd03a19 None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:23:12.518424 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9aa0cad-1fe2-489c-b58f-42448dd03a19 None None] PATH_INFO: `/` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:23:12.520332 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 489/961] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 10 05:23:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 05:23:12.525848 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38ba2d6-eb82-4cfd-844d-cc40dd168969 None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:23:12.526296 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38ba2d6-eb82-4cfd-844d-cc40dd168969 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:23:12.526400 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38ba2d6-eb82-4cfd-844d-cc40dd168969 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:23:12.543483 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-e38ba2d6-eb82-4cfd-844d-cc40dd168969 None None] MFA Rules not processed for user `44883b22532e44049d846938dc2cf423`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:23:12.544710 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-e38ba2d6-eb82-4cfd-844d-cc40dd168969 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:23:12.617558 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 473/962] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 10 05:23:12 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 05:23:12.640902 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9aa0cad-1fe2-489c-b58f-42448dd03a19 None None] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:23:12.748067 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9aa0cad-1fe2-489c-b58f-42448dd03a19 None None] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:23:12.782358 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af670df-5713-4753-9af9-01c9a31251da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:23:12.783183 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af670df-5713-4753-9af9-01c9a31251da None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:23:12.783459 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af670df-5713-4753-9af9-01c9a31251da None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:23:12.783757 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af670df-5713-4753-9af9-01c9a31251da None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:23:12.795009 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af670df-5713-4753-9af9-01c9a31251da None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 05:23:12.803407 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application [None req-3af670df-5713-4753-9af9-01c9a31251da None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 10 05:23:12.803407 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 05:23:12.803407 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 05:23:12.803407 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 05:23:12.803407 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 05:23:12.803407 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 05:23:12.803407 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 05:23:12.803407 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 05:23:12.803407 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 05:23:12.803407 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 05:23:12.803407 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 05:23:12.803407 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 05:23:12.803407 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 05:23:12.803407 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 05:23:12.803407 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 05:23:12.803407 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 05:23:12.804394 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 05:23:12.804394 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 05:23:12.804394 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 05:23:12.804394 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 05:23:12.804394 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 05:23:12.804394 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 05:23:12.804394 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 05:23:12.804394 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 05:23:12.804394 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 05:23:12.804394 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.get_or_create( May 10 05:23:12.804394 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 05:23:12.804394 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application with Lock( May 10 05:23:12.804394 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 05:23:12.804394 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self._enter() May 10 05:23:12.804394 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 05:23:12.804394 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 05:23:12.805223 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 05:23:12.805223 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.creator() May 10 05:23:12.805223 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 05:23:12.805223 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application created_value = creator( May 10 05:23:12.805223 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 05:23:12.805223 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 05:23:12.805223 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 05:23:12.805223 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 05:23:12.805223 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 05:23:12.805223 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 05:23:12.805223 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 10 05:23:12.805223 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application May 10 05:23:12.805223 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 490/963] 10.222.0.23 () {56 vars in 1120 bytes} [Tue May 10 05:23:12 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 05:23:12.810565 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38ba2d6-eb82-4cfd-844d-cc40dd168969 None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:23:12.858093 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc67692d-8974-42ab-98d3-ed9241003996 None None] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:23:12.858406 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc67692d-8974-42ab-98d3-ed9241003996 None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:23:12.858645 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc67692d-8974-42ab-98d3-ed9241003996 None None] PATH_INFO: `/` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:23:12.861369 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 491/964] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 10 05:23:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 05:23:12.865346 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d986ddb-da70-4dd2-b4d8-1472f1782df3 None None] REQUEST_METHOD: `POST` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:23:12.865633 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d986ddb-da70-4dd2-b4d8-1472f1782df3 None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:23:12.865910 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d986ddb-da70-4dd2-b4d8-1472f1782df3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:23:12.885494 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.auth.core [None req-8d986ddb-da70-4dd2-b4d8-1472f1782df3 None None] MFA Rules not processed for user `44883b22532e44049d846938dc2cf423`. Rule list: `[]` (Enabled: `True`). {{(pid=79879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:23:12.887031 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-8d986ddb-da70-4dd2-b4d8-1472f1782df3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:23:12.908420 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38ba2d6-eb82-4cfd-844d-cc40dd168969 None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:23:12.944468 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd4bd4b-84b0-4881-9d8e-bebc585eb1c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:23:12.945161 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd4bd4b-84b0-4881-9d8e-bebc585eb1c8 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:23:12.945444 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd4bd4b-84b0-4881-9d8e-bebc585eb1c8 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:23:12.945717 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd4bd4b-84b0-4881-9d8e-bebc585eb1c8 None admin] PATH_INFO: `/v3/roles` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:23:12.946484 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd4bd4b-84b0-4881-9d8e-bebc585eb1c8 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:23:12.946794 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd4bd4b-84b0-4881-9d8e-bebc585eb1c8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:23:12.948240 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd4bd4b-84b0-4881-9d8e-bebc585eb1c8 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:23:12.962090 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 474/965] 10.222.0.23 () {56 vars in 1115 bytes} [Tue May 10 05:23:12 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:23:12.963041 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd4bd4b-84b0-4881-9d8e-bebc585eb1c8 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:23:12.971916 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 492/966] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 10 05:23:12 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 10 05:23:13.004432 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d986ddb-da70-4dd2-b4d8-1472f1782df3 None None] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:23:13.065766 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd4bd4b-84b0-4881-9d8e-bebc585eb1c8 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:23:13.097897 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4543199c-6116-4718-a8a2-bee4a3b95932 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:23:13.098702 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4543199c-6116-4718-a8a2-bee4a3b95932 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:23:13.098993 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4543199c-6116-4718-a8a2-bee4a3b95932 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:23:13.099266 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4543199c-6116-4718-a8a2-bee4a3b95932 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:23:13.109630 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4543199c-6116-4718-a8a2-bee4a3b95932 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:23:13.111083 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4543199c-6116-4718-a8a2-bee4a3b95932 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:23:13.124834 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d986ddb-da70-4dd2-b4d8-1472f1782df3 None None] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:23:13.128152 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application [None req-4543199c-6116-4718-a8a2-bee4a3b95932 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 05:23:13.128152 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 05:23:13.128152 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 05:23:13.128152 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 05:23:13.128152 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 05:23:13.128152 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 05:23:13.128152 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 05:23:13.128152 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 05:23:13.128152 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 05:23:13.128152 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 05:23:13.128152 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 05:23:13.128152 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 05:23:13.128152 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 05:23:13.128152 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 05:23:13.128152 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 05:23:13.129141 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 05:23:13.129141 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 05:23:13.129141 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 05:23:13.129141 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 05:23:13.129141 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 05:23:13.129141 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 05:23:13.129141 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.get_or_create( May 10 05:23:13.129141 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 05:23:13.129141 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application with Lock( May 10 05:23:13.129141 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 05:23:13.129141 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._enter() May 10 05:23:13.129141 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 05:23:13.129141 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 05:23:13.129141 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 05:23:13.129141 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.creator() May 10 05:23:13.129141 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 05:23:13.129141 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application created_value = creator( May 10 05:23:13.130059 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 05:23:13.130059 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 05:23:13.130059 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 05:23:13.130059 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application May 10 05:23:13.135599 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 475/967] 10.222.0.23 () {56 vars in 1108 bytes} [Tue May 10 05:23:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 05:23:13.135599 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27542a1d-5460-49c7-a4c7-92e37b3b0439 None None] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:23:13.135792 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27542a1d-5460-49c7-a4c7-92e37b3b0439 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:23:13.136030 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27542a1d-5460-49c7-a4c7-92e37b3b0439 None None] PATH_INFO: `/` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:23:13.137355 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 476/968] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 10 05:23:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 05:23:13.138050 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27542a1d-5460-49c7-a4c7-92e37b3b0439 None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:23:13.168934 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e74d589-a1fc-45fa-9a22-43229a8e851b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:23:13.170125 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e74d589-a1fc-45fa-9a22-43229a8e851b None admin] REQUEST_METHOD: `POST` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:23:13.170706 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e74d589-a1fc-45fa-9a22-43229a8e851b None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:23:13.171178 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e74d589-a1fc-45fa-9a22-43229a8e851b None admin] PATH_INFO: `/v3/users` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:23:13.172127 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e74d589-a1fc-45fa-9a22-43229a8e851b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:23:13.173738 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e74d589-a1fc-45fa-9a22-43229a8e851b None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:23:13.175269 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: WARNING keystone.server.flask.common [None req-8e74d589-a1fc-45fa-9a22-43229a8e851b None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. May 10 05:23:13.188780 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.sql.core [None req-8e74d589-a1fc-45fa-9a22-43229a8e851b None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 10 05:23:13.188780 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] May 10 05:23:13.188780 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [parameters: {'user_id': '1b48b26b4c3848889b6cc53128316d99', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] May 10 05:23:13.188780 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=79879) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 10 05:23:13.196806 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application [None req-8e74d589-a1fc-45fa-9a22-43229a8e851b None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. May 10 05:23:13.196806 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 05:23:13.196806 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 10 05:23:13.196806 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application self.dialect.do_execute( May 10 05:23:13.196806 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 10 05:23:13.196806 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 10 05:23:13.196806 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 10 05:23:13.196806 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application result = self._query(query) May 10 05:23:13.196806 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 10 05:23:13.196806 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application conn.query(q) May 10 05:23:13.196806 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 10 05:23:13.196806 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 10 05:23:13.196806 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 10 05:23:13.196806 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application result.read() May 10 05:23:13.196806 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 10 05:23:13.197721 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 10 05:23:13.197721 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 10 05:23:13.197721 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application packet.raise_for_error() May 10 05:23:13.197721 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 10 05:23:13.197721 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 10 05:23:13.197721 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 10 05:23:13.197721 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 10 05:23:13.197721 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 10 05:23:13.197721 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application May 10 05:23:13.197721 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 10 05:23:13.197721 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application May 10 05:23:13.197721 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 05:23:13.197721 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 10 05:23:13.197721 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 10 05:23:13.197721 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user May 10 05:23:13.197721 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) May 10 05:23:13.197721 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 10 05:23:13.197721 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application next(self.gen) May 10 05:23:13.198671 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 10 05:23:13.198671 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application yield resource May 10 05:23:13.198671 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 10 05:23:13.198671 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application next(self.gen) May 10 05:23:13.198671 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 10 05:23:13.198671 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application self.session.rollback() May 10 05:23:13.198671 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 10 05:23:13.198671 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application self.force_reraise() May 10 05:23:13.198671 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 10 05:23:13.198671 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application raise self.value May 10 05:23:13.198671 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 10 05:23:13.198671 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 10 05:23:13.198671 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 10 05:23:13.198671 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application session.commit() May 10 05:23:13.198671 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 10 05:23:13.198671 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 10 05:23:13.198671 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 10 05:23:13.199615 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application self._prepare_impl() May 10 05:23:13.199615 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 10 05:23:13.199615 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application self.session.flush() May 10 05:23:13.199615 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 10 05:23:13.199615 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application self._flush(objects) May 10 05:23:13.199615 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 10 05:23:13.199615 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 10 05:23:13.199615 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 10 05:23:13.199615 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application compat.raise_( May 10 05:23:13.199615 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 10 05:23:13.199615 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application raise exception May 10 05:23:13.199615 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 10 05:23:13.199615 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application flush_context.execute() May 10 05:23:13.199615 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 10 05:23:13.199615 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application rec.execute(self) May 10 05:23:13.199615 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 10 05:23:13.199615 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 10 05:23:13.200573 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 10 05:23:13.200573 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application _emit_insert_statements( May 10 05:23:13.200573 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements May 10 05:23:13.200573 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application result = connection._execute_20( May 10 05:23:13.200573 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 10 05:23:13.200573 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 10 05:23:13.200573 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 10 05:23:13.200573 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 10 05:23:13.200573 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 10 05:23:13.200573 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application ret = self._execute_context( May 10 05:23:13.200573 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 10 05:23:13.200573 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 10 05:23:13.200573 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 10 05:23:13.200573 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 10 05:23:13.200573 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 10 05:23:13.200573 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application raise exception May 10 05:23:13.201597 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 10 05:23:13.201597 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application self.dialect.do_execute( May 10 05:23:13.201597 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 10 05:23:13.201597 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 10 05:23:13.201597 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 10 05:23:13.201597 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application result = self._query(query) May 10 05:23:13.201597 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 10 05:23:13.201597 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application conn.query(q) May 10 05:23:13.201597 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 10 05:23:13.201597 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 10 05:23:13.201597 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 10 05:23:13.201597 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application result.read() May 10 05:23:13.201597 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 10 05:23:13.201597 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 10 05:23:13.201597 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 10 05:23:13.201597 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application packet.raise_for_error() May 10 05:23:13.202991 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 10 05:23:13.202991 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 10 05:23:13.202991 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 10 05:23:13.202991 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 10 05:23:13.202991 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 10 05:23:13.202991 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] May 10 05:23:13.202991 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application [parameters: {'user_id': '1b48b26b4c3848889b6cc53128316d99', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] May 10 05:23:13.202991 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 10 05:23:13.202991 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application May 10 05:23:13.202991 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 05:23:13.202991 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application May 10 05:23:13.202991 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 05:23:13.202991 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 05:23:13.202991 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 05:23:13.202991 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 05:23:13.203973 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 05:23:13.203973 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 05:23:13.203973 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 05:23:13.203973 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 05:23:13.203973 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 05:23:13.203973 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 05:23:13.203973 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 05:23:13.203973 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post May 10 05:23:13.203973 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( May 10 05:23:13.203973 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 05:23:13.203973 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 05:23:13.203973 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 05:23:13.203973 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 05:23:13.203973 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 05:23:13.203973 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 05:23:13.203973 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user May 10 05:23:13.203973 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) May 10 05:23:13.205097 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects May 10 05:23:13.205097 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) May 10 05:23:13.205097 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 10 05:23:13.205097 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 10 05:23:13.205097 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. May 10 05:23:13.205097 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application May 10 05:23:13.207022 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 493/969] 10.222.0.23 () {60 vars in 1131 bytes} [Tue May 10 05:23:13 2022] POST /identity/v3/users => generated 160 bytes in 203 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) May 10 05:23:13.211960 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe801f2-1244-4737-984a-addccd366b12 None None] REQUEST_METHOD: `POST` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:23:13.211960 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe801f2-1244-4737-984a-addccd366b12 None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:23:13.211960 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe801f2-1244-4737-984a-addccd366b12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:23:13.228949 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.auth.core [None req-7fe801f2-1244-4737-984a-addccd366b12 None None] MFA Rules not processed for user `44883b22532e44049d846938dc2cf423`. Rule list: `[]` (Enabled: `True`). {{(pid=79879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:23:13.230488 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-7fe801f2-1244-4737-984a-addccd366b12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:23:13.238362 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27542a1d-5460-49c7-a4c7-92e37b3b0439 None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:23:13.273372 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f7bf05-de2c-49f4-9acf-132977943dee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:23:13.273974 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f7bf05-de2c-49f4-9acf-132977943dee None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:23:13.274256 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f7bf05-de2c-49f4-9acf-132977943dee None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:23:13.274530 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f7bf05-de2c-49f4-9acf-132977943dee None admin] PATH_INFO: `/v3/domains` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:23:13.275263 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f7bf05-de2c-49f4-9acf-132977943dee None admin] RBAC: Adding query filter params (name=Default) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:23:13.275584 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f7bf05-de2c-49f4-9acf-132977943dee None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:23:13.276990 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f7bf05-de2c-49f4-9acf-132977943dee None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:23:13.290770 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 477/970] 10.222.0.23 () {56 vars in 1109 bytes} [Tue May 10 05:23:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:23:13.291846 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f7bf05-de2c-49f4-9acf-132977943dee None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:23:13.307622 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 494/971] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 10 05:23:13 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 05:23:13.307622 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe801f2-1244-4737-984a-addccd366b12 None None] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:23:13.403637 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe801f2-1244-4737-984a-addccd366b12 None None] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:23:13.404082 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f7bf05-de2c-49f4-9acf-132977943dee None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:23:13.435106 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3bcb0e-bff6-45ba-a4f6-10356a85077d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:23:13.435952 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3bcb0e-bff6-45ba-a4f6-10356a85077d None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:23:13.436170 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e08dd9a-83be-4c78-a11e-d68dd3908a28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:23:13.436296 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3bcb0e-bff6-45ba-a4f6-10356a85077d None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:23:13.436479 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3bcb0e-bff6-45ba-a4f6-10356a85077d None admin] PATH_INFO: `/v3/users/cinder` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:23:13.436987 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e08dd9a-83be-4c78-a11e-d68dd3908a28 None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:23:13.437422 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e08dd9a-83be-4c78-a11e-d68dd3908a28 None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:23:13.437694 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e08dd9a-83be-4c78-a11e-d68dd3908a28 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:23:13.443664 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3bcb0e-bff6-45ba-a4f6-10356a85077d None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:23:13.444994 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e08dd9a-83be-4c78-a11e-d68dd3908a28 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:23:13.445101 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3bcb0e-bff6-45ba-a4f6-10356a85077d None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:23:13.446889 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e08dd9a-83be-4c78-a11e-d68dd3908a28 None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:23:13.459277 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application [None req-9e3bcb0e-bff6-45ba-a4f6-10356a85077d None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 10 05:23:13.459277 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 05:23:13.459277 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 05:23:13.459277 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 05:23:13.459277 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 05:23:13.459277 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 05:23:13.459277 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 05:23:13.459277 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 05:23:13.459277 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 05:23:13.459277 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 05:23:13.459277 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 05:23:13.459277 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 05:23:13.459277 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 05:23:13.459277 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 05:23:13.459277 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 05:23:13.459277 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 05:23:13.460332 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 05:23:13.460332 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 05:23:13.460332 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 05:23:13.460332 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 05:23:13.460332 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 05:23:13.460332 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 05:23:13.460332 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 05:23:13.460332 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 05:23:13.460332 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 05:23:13.460332 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.get_or_create( May 10 05:23:13.460332 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 05:23:13.460332 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application with Lock( May 10 05:23:13.460332 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 05:23:13.460332 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._enter() May 10 05:23:13.460332 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 05:23:13.460332 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 05:23:13.460332 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 05:23:13.460332 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.creator() May 10 05:23:13.475928 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 05:23:13.475928 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application created_value = creator( May 10 05:23:13.475928 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 05:23:13.475928 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 05:23:13.475928 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 05:23:13.475928 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 05:23:13.475928 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 05:23:13.475928 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 05:23:13.475928 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 10 05:23:13.475928 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application May 10 05:23:13.475928 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 478/972] 10.222.0.23 () {56 vars in 1099 bytes} [Tue May 10 05:23:13 2022] GET /identity/v3/users/cinder => generated 84 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 05:23:13.476684 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application [None req-5e08dd9a-83be-4c78-a11e-d68dd3908a28 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 10 05:23:13.476684 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 05:23:13.476684 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 05:23:13.476684 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 05:23:13.476684 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 05:23:13.476684 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 05:23:13.476684 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 05:23:13.476684 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 05:23:13.476684 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 05:23:13.476684 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 05:23:13.476684 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 05:23:13.476684 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 05:23:13.476684 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 05:23:13.476684 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 05:23:13.476684 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 05:23:13.476684 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 05:23:13.477733 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 05:23:13.477733 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 05:23:13.477733 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 05:23:13.477733 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 05:23:13.477733 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 05:23:13.477733 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 05:23:13.477733 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 05:23:13.477733 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 05:23:13.477733 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 05:23:13.477733 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.get_or_create( May 10 05:23:13.477733 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 05:23:13.477733 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application with Lock( May 10 05:23:13.477733 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 05:23:13.477733 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self._enter() May 10 05:23:13.477733 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 05:23:13.477733 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 05:23:13.477733 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 05:23:13.477733 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.creator() May 10 05:23:13.478778 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 05:23:13.478778 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application created_value = creator( May 10 05:23:13.478778 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 05:23:13.478778 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 05:23:13.478778 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 05:23:13.478778 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 05:23:13.478778 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 05:23:13.478778 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 05:23:13.478778 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 10 05:23:13.478778 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application May 10 05:23:13.479438 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3bcb0e-bff6-45ba-a4f6-10356a85077d None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:23:13.479529 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 495/973] 10.222.0.23 () {56 vars in 1117 bytes} [Tue May 10 05:23:13 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 05:23:13.479529 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e08dd9a-83be-4c78-a11e-d68dd3908a28 None admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:23:13.569680 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3bcb0e-bff6-45ba-a4f6-10356a85077d None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:23:13.575746 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e08dd9a-83be-4c78-a11e-d68dd3908a28 None admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:23:13.603082 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c7d41e-b39d-44d0-ad7e-04f7f38c6ff6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:23:13.603787 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c7d41e-b39d-44d0-ad7e-04f7f38c6ff6 None admin] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:23:13.604066 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c7d41e-b39d-44d0-ad7e-04f7f38c6ff6 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:23:13.604364 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c7d41e-b39d-44d0-ad7e-04f7f38c6ff6 None admin] PATH_INFO: `/v3/services` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:23:13.605092 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c7d41e-b39d-44d0-ad7e-04f7f38c6ff6 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:23:13.606478 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c7d41e-b39d-44d0-ad7e-04f7f38c6ff6 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:23:13.607272 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d044bcdc-84ed-4f2a-b450-3adac470df9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:23:13.607967 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d044bcdc-84ed-4f2a-b450-3adac470df9a None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:23:13.608248 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d044bcdc-84ed-4f2a-b450-3adac470df9a None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:23:13.608522 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d044bcdc-84ed-4f2a-b450-3adac470df9a None admin] PATH_INFO: `/v3/users` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:23:13.609331 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d044bcdc-84ed-4f2a-b450-3adac470df9a None admin] RBAC: Adding query filter params (name=cinder) {{(pid=79879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:23:13.609631 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d044bcdc-84ed-4f2a-b450-3adac470df9a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:23:13.611052 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d044bcdc-84ed-4f2a-b450-3adac470df9a None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:23:13.620550 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 479/974] 10.222.0.23 () {60 vars in 1141 bytes} [Tue May 10 05:23:13 2022] POST /identity/v3/services => generated 242 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 05:23:13.622683 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c7d41e-b39d-44d0-ad7e-04f7f38c6ff6 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:23:13.660221 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 496/975] 10.222.0.23 () {56 vars in 1101 bytes} [Tue May 10 05:23:13 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 05:23:13.759265 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c7d41e-b39d-44d0-ad7e-04f7f38c6ff6 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:23:13.801137 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23c3a5c-a512-45d4-8071-4d2a1b832236 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:23:13.802282 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23c3a5c-a512-45d4-8071-4d2a1b832236 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:23:13.802814 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23c3a5c-a512-45d4-8071-4d2a1b832236 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:23:13.803298 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23c3a5c-a512-45d4-8071-4d2a1b832236 None admin] PATH_INFO: `/v3/users` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:23:13.804452 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23c3a5c-a512-45d4-8071-4d2a1b832236 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:23:13.805057 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23c3a5c-a512-45d4-8071-4d2a1b832236 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:23:13.806887 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23c3a5c-a512-45d4-8071-4d2a1b832236 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:23:13.829313 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 480/976] 10.222.0.23 () {56 vars in 1149 bytes} [Tue May 10 05:23:13 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:23:13.834939 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d044bcdc-84ed-4f2a-b450-3adac470df9a None admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:23:13.938955 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d044bcdc-84ed-4f2a-b450-3adac470df9a None admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:23:13.972099 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0d6792-96bb-4b61-807c-5f55e99b3343 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:23:13.972789 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0d6792-96bb-4b61-807c-5f55e99b3343 None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:23:13.973065 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0d6792-96bb-4b61-807c-5f55e99b3343 None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:23:13.973332 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0d6792-96bb-4b61-807c-5f55e99b3343 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:23:14.040542 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0d6792-96bb-4b61-807c-5f55e99b3343 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:23:14.042012 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0d6792-96bb-4b61-807c-5f55e99b3343 None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:23:14.137302 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 497/977] 10.222.0.23 () {58 vars in 1282 bytes} [Tue May 10 05:23:13 2022] GET /identity/v3/auth/tokens => generated 1560 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 10 05:23:14.143204 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23c3a5c-a512-45d4-8071-4d2a1b832236 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:23:14.245798 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23c3a5c-a512-45d4-8071-4d2a1b832236 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:23:14.285599 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d903fbcc-7fd9-4b31-afcb-d29e0218c3e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:23:14.286409 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d903fbcc-7fd9-4b31-afcb-d29e0218c3e9 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:23:14.286687 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d903fbcc-7fd9-4b31-afcb-d29e0218c3e9 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:23:14.286953 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d903fbcc-7fd9-4b31-afcb-d29e0218c3e9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:23:14.297851 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d903fbcc-7fd9-4b31-afcb-d29e0218c3e9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:23:14.299325 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d903fbcc-7fd9-4b31-afcb-d29e0218c3e9 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:23:14.316762 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application [None req-d903fbcc-7fd9-4b31-afcb-d29e0218c3e9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 05:23:14.316762 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 05:23:14.316762 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 05:23:14.316762 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 05:23:14.316762 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 05:23:14.316762 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 05:23:14.316762 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 05:23:14.316762 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 05:23:14.316762 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 05:23:14.316762 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 05:23:14.316762 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 05:23:14.316762 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 05:23:14.316762 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 05:23:14.316762 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 05:23:14.316762 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 05:23:14.317711 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 05:23:14.317711 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 05:23:14.317711 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 05:23:14.317711 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 05:23:14.317711 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 05:23:14.317711 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 05:23:14.317711 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.get_or_create( May 10 05:23:14.317711 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 05:23:14.317711 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application with Lock( May 10 05:23:14.317711 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 05:23:14.317711 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._enter() May 10 05:23:14.317711 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 05:23:14.317711 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 05:23:14.317711 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 05:23:14.317711 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.creator() May 10 05:23:14.317711 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 05:23:14.317711 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application created_value = creator( May 10 05:23:14.323392 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 05:23:14.323392 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 05:23:14.323392 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 05:23:14.323392 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application May 10 05:23:14.323392 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 481/978] 10.222.0.23 () {56 vars in 1108 bytes} [Tue May 10 05:23:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 05:23:14.325234 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0d6792-96bb-4b61-807c-5f55e99b3343 None admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:23:14.422141 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0d6792-96bb-4b61-807c-5f55e99b3343 None admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:23:14.450868 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637175a0-71f4-43ff-a25f-d89935afdf9f None None] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:23:14.451138 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637175a0-71f4-43ff-a25f-d89935afdf9f None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:23:14.451407 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637175a0-71f4-43ff-a25f-d89935afdf9f None None] PATH_INFO: `/` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:23:14.453065 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 482/979] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 10 05:23:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 05:23:14.457997 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93d1a13-d07b-4d1a-a698-da572aaea97a None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:23:14.458276 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93d1a13-d07b-4d1a-a698-da572aaea97a None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:23:14.458544 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93d1a13-d07b-4d1a-a698-da572aaea97a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:23:14.459618 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af56b2fc-6bd8-4e39-a3b0-2f811cbd79e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:23:14.460378 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af56b2fc-6bd8-4e39-a3b0-2f811cbd79e5 None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:23:14.460659 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af56b2fc-6bd8-4e39-a3b0-2f811cbd79e5 None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:23:14.460930 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af56b2fc-6bd8-4e39-a3b0-2f811cbd79e5 None admin] PATH_INFO: `/v3/domains` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:23:14.461658 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af56b2fc-6bd8-4e39-a3b0-2f811cbd79e5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:23:14.461959 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af56b2fc-6bd8-4e39-a3b0-2f811cbd79e5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:23:14.467623 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af56b2fc-6bd8-4e39-a3b0-2f811cbd79e5 None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:23:14.475918 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-c93d1a13-d07b-4d1a-a698-da572aaea97a None None] MFA Rules not processed for user `44883b22532e44049d846938dc2cf423`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:23:14.477106 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-c93d1a13-d07b-4d1a-a698-da572aaea97a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:23:14.480429 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 498/980] 10.222.0.23 () {56 vars in 1109 bytes} [Tue May 10 05:23:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:23:14.485771 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af56b2fc-6bd8-4e39-a3b0-2f811cbd79e5 None admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:23:14.542978 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 483/981] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 10 05:23:14 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 10 05:23:14.565179 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93d1a13-d07b-4d1a-a698-da572aaea97a None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:23:14.581936 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af56b2fc-6bd8-4e39-a3b0-2f811cbd79e5 None admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:23:14.613589 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604eb618-dbcb-4c6c-9301-b61ab72fa971 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:23:14.614389 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604eb618-dbcb-4c6c-9301-b61ab72fa971 None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:23:14.614670 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604eb618-dbcb-4c6c-9301-b61ab72fa971 None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:23:14.614946 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604eb618-dbcb-4c6c-9301-b61ab72fa971 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:23:14.621918 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604eb618-dbcb-4c6c-9301-b61ab72fa971 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:23:14.623593 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604eb618-dbcb-4c6c-9301-b61ab72fa971 None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:23:14.637528 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application [None req-604eb618-dbcb-4c6c-9301-b61ab72fa971 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 05:23:14.637528 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 05:23:14.637528 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 05:23:14.637528 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 05:23:14.637528 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 05:23:14.637528 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 05:23:14.637528 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 05:23:14.637528 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 05:23:14.637528 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 05:23:14.637528 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 05:23:14.637528 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 05:23:14.637528 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 05:23:14.637528 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 05:23:14.637528 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 05:23:14.637528 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 05:23:14.638432 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 05:23:14.638432 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 05:23:14.638432 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 05:23:14.638432 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 05:23:14.638432 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 05:23:14.638432 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 05:23:14.638432 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.get_or_create( May 10 05:23:14.638432 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 05:23:14.638432 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application with Lock( May 10 05:23:14.638432 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 05:23:14.638432 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self._enter() May 10 05:23:14.638432 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 05:23:14.638432 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 05:23:14.638432 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 05:23:14.638432 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.creator() May 10 05:23:14.638432 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 05:23:14.638432 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application created_value = creator( May 10 05:23:14.639526 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 05:23:14.639526 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 05:23:14.639526 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 05:23:14.639526 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 05:23:14.639526 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 05:23:14.639526 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 05:23:14.639526 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 05:23:14.639526 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application May 10 05:23:14.639526 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 499/982] 10.222.0.23 () {56 vars in 1111 bytes} [Tue May 10 05:23:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 05:23:14.644510 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604eb618-dbcb-4c6c-9301-b61ab72fa971 None admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:23:14.661395 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93d1a13-d07b-4d1a-a698-da572aaea97a None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:23:14.694255 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde0efe9-22bb-4e97-a9f3-ab2d044a4225 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:23:14.695004 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde0efe9-22bb-4e97-a9f3-ab2d044a4225 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:23:14.695292 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde0efe9-22bb-4e97-a9f3-ab2d044a4225 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:23:14.695590 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde0efe9-22bb-4e97-a9f3-ab2d044a4225 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:23:14.696258 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde0efe9-22bb-4e97-a9f3-ab2d044a4225 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:23:14.697637 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde0efe9-22bb-4e97-a9f3-ab2d044a4225 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:23:14.709512 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application [None req-bde0efe9-22bb-4e97-a9f3-ab2d044a4225 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 10 05:23:14.709512 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 05:23:14.709512 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 10 05:23:14.709512 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 10 05:23:14.709512 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 10 05:23:14.709512 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 10 05:23:14.709512 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 10 05:23:14.709512 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 05:23:14.709512 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 10 05:23:14.709512 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application May 10 05:23:14.709512 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 05:23:14.709512 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application May 10 05:23:14.709512 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 05:23:14.709512 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 05:23:14.709512 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 05:23:14.709512 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 05:23:14.709512 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 05:23:14.710591 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 05:23:14.710591 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 05:23:14.710591 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 05:23:14.710591 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 05:23:14.710591 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 05:23:14.710591 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 05:23:14.710591 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 10 05:23:14.710591 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_service(service_id) May 10 05:23:14.710591 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 10 05:23:14.710591 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 10 05:23:14.710591 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 05:23:14.710591 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 05:23:14.710591 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 05:23:14.710591 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 05:23:14.710591 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 05:23:14.710591 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.get_or_create( May 10 05:23:14.711464 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 05:23:14.711464 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application with Lock( May 10 05:23:14.711464 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 05:23:14.711464 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._enter() May 10 05:23:14.711464 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 05:23:14.711464 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 05:23:14.711464 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 05:23:14.711464 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.creator() May 10 05:23:14.711464 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 05:23:14.711464 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application created_value = creator( May 10 05:23:14.711464 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 10 05:23:14.711464 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 05:23:14.711464 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 10 05:23:14.711464 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application May 10 05:23:14.715952 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 484/983] 10.222.0.23 () {56 vars in 1126 bytes} [Tue May 10 05:23:14 2022] GET /identity/v3/services/object-store => generated 93 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 05:23:14.716645 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde0efe9-22bb-4e97-a9f3-ab2d044a4225 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:23:14.737799 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604eb618-dbcb-4c6c-9301-b61ab72fa971 None admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:23:14.771450 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b3a5ce-af74-470d-bd3c-bda980223ca0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:23:14.772140 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b3a5ce-af74-470d-bd3c-bda980223ca0 None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:23:14.772416 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b3a5ce-af74-470d-bd3c-bda980223ca0 None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:23:14.772689 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b3a5ce-af74-470d-bd3c-bda980223ca0 None admin] PATH_INFO: `/v3/projects` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:23:14.773591 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b3a5ce-af74-470d-bd3c-bda980223ca0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:23:14.773777 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b3a5ce-af74-470d-bd3c-bda980223ca0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:23:14.775209 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b3a5ce-af74-470d-bd3c-bda980223ca0 None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:23:14.794714 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 500/984] 10.222.0.23 () {56 vars in 1148 bytes} [Tue May 10 05:23:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 05:23:14.795806 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b3a5ce-af74-470d-bd3c-bda980223ca0 None admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:23:14.816464 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde0efe9-22bb-4e97-a9f3-ab2d044a4225 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:23:14.851865 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1366f9e-0f4a-4c6f-b056-30bc91138f9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:23:14.852725 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1366f9e-0f4a-4c6f-b056-30bc91138f9f None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:23:14.853016 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1366f9e-0f4a-4c6f-b056-30bc91138f9f None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:23:14.853291 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1366f9e-0f4a-4c6f-b056-30bc91138f9f None admin] PATH_INFO: `/v3/services` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:23:14.854333 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1366f9e-0f4a-4c6f-b056-30bc91138f9f None admin] RBAC: Adding query filter params (name=object-store) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:23:14.854674 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1366f9e-0f4a-4c6f-b056-30bc91138f9f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:23:14.856089 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1366f9e-0f4a-4c6f-b056-30bc91138f9f None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:23:14.860979 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 485/985] 10.222.0.23 () {56 vars in 1122 bytes} [Tue May 10 05:23:14 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 05:23:14.866717 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1366f9e-0f4a-4c6f-b056-30bc91138f9f None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:23:14.906052 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b3a5ce-af74-470d-bd3c-bda980223ca0 None admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:23:14.941135 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0887127c-402d-4141-9a5c-074b79f724cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:23:14.941809 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0887127c-402d-4141-9a5c-074b79f724cf None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:23:14.942092 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0887127c-402d-4141-9a5c-074b79f724cf None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:23:14.942363 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0887127c-402d-4141-9a5c-074b79f724cf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:23:14.943296 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0887127c-402d-4141-9a5c-074b79f724cf None admin] RBAC: Adding query filter params (role.id=635210106d69457ba45e9fa6dd0b9754, scope.project.id=5f23435f783540199d6dcfd0417c090e, user.id=c5281b2a1c9a461995653be826207db4) {{(pid=79879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:23:14.943625 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0887127c-402d-4141-9a5c-074b79f724cf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:23:14.945142 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0887127c-402d-4141-9a5c-074b79f724cf None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:23:14.955983 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 501/986] 10.222.0.23 () {56 vars in 1374 bytes} [Tue May 10 05:23:14 2022] GET /identity/v3/role_assignments?user.id=c5281b2a1c9a461995653be826207db4&scope.project.id=5f23435f783540199d6dcfd0417c090e&role.id=635210106d69457ba45e9fa6dd0b9754 => generated 608 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:23:14.981504 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1366f9e-0f4a-4c6f-b056-30bc91138f9f None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:23:15.019365 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d5755b-4324-456d-b6dc-3f727ed21998 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:23:15.020175 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d5755b-4324-456d-b6dc-3f727ed21998 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:23:15.020464 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d5755b-4324-456d-b6dc-3f727ed21998 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:23:15.020788 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d5755b-4324-456d-b6dc-3f727ed21998 None admin] PATH_INFO: `/v3/services` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:23:15.021544 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d5755b-4324-456d-b6dc-3f727ed21998 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:23:15.021849 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d5755b-4324-456d-b6dc-3f727ed21998 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:23:15.023296 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d5755b-4324-456d-b6dc-3f727ed21998 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:23:15.029360 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 486/987] 10.222.0.23 () {56 vars in 1122 bytes} [Tue May 10 05:23:14 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 05:23:15.035617 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0887127c-402d-4141-9a5c-074b79f724cf None admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:23:15.142174 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0887127c-402d-4141-9a5c-074b79f724cf None admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:23:15.177258 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801ea65c-bb4f-4f65-9c81-42e79a4111e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:23:15.177931 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801ea65c-bb4f-4f65-9c81-42e79a4111e8 None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:23:15.178218 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801ea65c-bb4f-4f65-9c81-42e79a4111e8 None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:23:15.178495 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801ea65c-bb4f-4f65-9c81-42e79a4111e8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:23:15.179306 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801ea65c-bb4f-4f65-9c81-42e79a4111e8 None admin] RBAC: Adding query filter params (interface=admin, service_id=b6b1349f073b4faab824caf493037bf3, region_id=RegionOne) {{(pid=79879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:23:15.179652 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801ea65c-bb4f-4f65-9c81-42e79a4111e8 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:23:15.181037 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801ea65c-bb4f-4f65-9c81-42e79a4111e8 None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:23:15.186657 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 502/988] 10.222.0.23 () {56 vars in 1249 bytes} [Tue May 10 05:23:15 2022] GET /identity/v3/endpoints?service_id=b6b1349f073b4faab824caf493037bf3&interface=admin®ion_id=RegionOne => generated 193 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:23:15.192304 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d5755b-4324-456d-b6dc-3f727ed21998 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:23:15.291591 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d5755b-4324-456d-b6dc-3f727ed21998 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:23:15.325213 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcaf375-bace-403d-9a28-6ff81f587d56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:23:15.325890 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcaf375-bace-403d-9a28-6ff81f587d56 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:23:15.326172 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcaf375-bace-403d-9a28-6ff81f587d56 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:23:15.326452 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcaf375-bace-403d-9a28-6ff81f587d56 None admin] PATH_INFO: `/v3/services` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:23:15.327146 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fcaf375-bace-403d-9a28-6ff81f587d56 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:23:15.328624 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fcaf375-bace-403d-9a28-6ff81f587d56 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:23:15.335109 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 487/989] 10.222.0.23 () {56 vars in 1087 bytes} [Tue May 10 05:23:15 2022] GET /identity/v3/services => generated 1727 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 05:23:15.911630 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab4e0a8-083c-4c7e-8a9c-24a90a9fddf1 None None] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:23:15.912186 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab4e0a8-083c-4c7e-8a9c-24a90a9fddf1 None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:23:15.912186 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab4e0a8-083c-4c7e-8a9c-24a90a9fddf1 None None] PATH_INFO: `/` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:23:15.913839 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 503/990] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 10 05:23:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 05:23:15.919160 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b48736-53b1-44b6-ab95-ec437f77843a None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:23:15.919600 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b48736-53b1-44b6-ab95-ec437f77843a None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:23:15.919711 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b48736-53b1-44b6-ab95-ec437f77843a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:23:15.936585 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-81b48736-53b1-44b6-ab95-ec437f77843a None None] MFA Rules not processed for user `44883b22532e44049d846938dc2cf423`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:23:15.937740 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-81b48736-53b1-44b6-ab95-ec437f77843a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:23:16.002087 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 488/991] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 10 05:23:15 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 05:23:16.028319 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab4e0a8-083c-4c7e-8a9c-24a90a9fddf1 None None] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:23:16.130535 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab4e0a8-083c-4c7e-8a9c-24a90a9fddf1 None None] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:23:16.163296 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d91e201-f986-4e7d-8334-d37c74fb2a83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:23:16.164045 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d91e201-f986-4e7d-8334-d37c74fb2a83 None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:23:16.164323 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d91e201-f986-4e7d-8334-d37c74fb2a83 None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:23:16.164593 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d91e201-f986-4e7d-8334-d37c74fb2a83 None admin] PATH_INFO: `/v3/services/compute` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:23:16.165241 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d91e201-f986-4e7d-8334-d37c74fb2a83 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:23:16.166620 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d91e201-f986-4e7d-8334-d37c74fb2a83 None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:23:16.178308 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application [None req-2d91e201-f986-4e7d-8334-d37c74fb2a83 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 10 05:23:16.178308 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 05:23:16.178308 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 10 05:23:16.178308 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 10 05:23:16.178308 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 10 05:23:16.178308 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 10 05:23:16.178308 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 10 05:23:16.178308 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 05:23:16.178308 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 10 05:23:16.178308 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application May 10 05:23:16.178308 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 05:23:16.178308 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application May 10 05:23:16.178308 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 05:23:16.178308 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 05:23:16.178308 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 05:23:16.178308 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 05:23:16.178308 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 05:23:16.179335 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 05:23:16.179335 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 05:23:16.179335 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 05:23:16.179335 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 05:23:16.179335 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 05:23:16.179335 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 05:23:16.179335 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 10 05:23:16.179335 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self._get_service(service_id) May 10 05:23:16.179335 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 10 05:23:16.179335 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 10 05:23:16.179335 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 05:23:16.179335 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 05:23:16.179335 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 05:23:16.179335 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 05:23:16.179335 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 05:23:16.179335 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.get_or_create( May 10 05:23:16.180523 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 05:23:16.180523 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application with Lock( May 10 05:23:16.180523 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 05:23:16.180523 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self._enter() May 10 05:23:16.180523 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 05:23:16.180523 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 05:23:16.180523 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 05:23:16.180523 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.creator() May 10 05:23:16.180523 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 05:23:16.180523 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application created_value = creator( May 10 05:23:16.180523 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 10 05:23:16.180523 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 05:23:16.180523 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 10 05:23:16.180523 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application May 10 05:23:16.183910 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 504/992] 10.222.0.23 () {56 vars in 1111 bytes} [Tue May 10 05:23:16 2022] GET /identity/v3/services/compute => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 05:23:16.185832 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b48736-53b1-44b6-ab95-ec437f77843a None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:23:16.281023 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b48736-53b1-44b6-ab95-ec437f77843a None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:23:16.315065 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797a1de9-fd8b-4306-8018-d90708f0cc04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:23:16.315761 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797a1de9-fd8b-4306-8018-d90708f0cc04 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:23:16.316070 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797a1de9-fd8b-4306-8018-d90708f0cc04 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:23:16.316331 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797a1de9-fd8b-4306-8018-d90708f0cc04 None admin] PATH_INFO: `/v3/services` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:23:16.317035 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797a1de9-fd8b-4306-8018-d90708f0cc04 None admin] RBAC: Adding query filter params (name=compute) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:23:16.317334 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797a1de9-fd8b-4306-8018-d90708f0cc04 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:23:16.318695 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797a1de9-fd8b-4306-8018-d90708f0cc04 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:23:16.328082 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 489/993] 10.222.0.23 () {56 vars in 1112 bytes} [Tue May 10 05:23:16 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:23:16.329380 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d91e201-f986-4e7d-8334-d37c74fb2a83 None admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:23:16.438577 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d91e201-f986-4e7d-8334-d37c74fb2a83 None admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:23:16.478125 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06333e7-f0b6-434e-bd1d-8322e9120abd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:23:16.478813 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06333e7-f0b6-434e-bd1d-8322e9120abd None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:23:16.479155 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06333e7-f0b6-434e-bd1d-8322e9120abd None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:23:16.479435 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06333e7-f0b6-434e-bd1d-8322e9120abd None admin] PATH_INFO: `/v3/services` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:23:16.480265 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06333e7-f0b6-434e-bd1d-8322e9120abd None admin] RBAC: Adding query filter params (type=compute) {{(pid=79879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:23:16.480575 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06333e7-f0b6-434e-bd1d-8322e9120abd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:23:16.481959 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06333e7-f0b6-434e-bd1d-8322e9120abd None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:23:16.495751 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 505/994] 10.222.0.23 () {56 vars in 1112 bytes} [Tue May 10 05:23:16 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:23:16.501046 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797a1de9-fd8b-4306-8018-d90708f0cc04 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:23:16.598423 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797a1de9-fd8b-4306-8018-d90708f0cc04 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:23:16.632619 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa43df9-b667-4bcc-8a21-4a5810a1cbee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:23:16.633289 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa43df9-b667-4bcc-8a21-4a5810a1cbee None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:23:16.633571 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa43df9-b667-4bcc-8a21-4a5810a1cbee None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:23:16.633837 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa43df9-b667-4bcc-8a21-4a5810a1cbee None admin] PATH_INFO: `/v3/endpoints` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:23:16.634640 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa43df9-b667-4bcc-8a21-4a5810a1cbee None admin] RBAC: Adding query filter params (interface=public, service_id=7b838811c7b0448bb8c2aaebb2046971, region_id=RegionOne) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:23:16.634950 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa43df9-b667-4bcc-8a21-4a5810a1cbee None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:23:16.636357 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa43df9-b667-4bcc-8a21-4a5810a1cbee None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:23:16.641468 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 490/995] 10.222.0.23 () {56 vars in 1251 bytes} [Tue May 10 05:23:16 2022] GET /identity/v3/endpoints?service_id=7b838811c7b0448bb8c2aaebb2046971&interface=public®ion_id=RegionOne => generated 194 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:23:16.647254 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06333e7-f0b6-434e-bd1d-8322e9120abd None admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:23:16.743074 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06333e7-f0b6-434e-bd1d-8322e9120abd None admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:23:16.776466 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebe9d09-7bf0-4c0b-b532-6811ca315c88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:23:16.777138 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebe9d09-7bf0-4c0b-b532-6811ca315c88 None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:23:16.777417 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebe9d09-7bf0-4c0b-b532-6811ca315c88 None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:23:16.777674 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebe9d09-7bf0-4c0b-b532-6811ca315c88 None admin] PATH_INFO: `/v3/services` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:23:16.778361 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebe9d09-7bf0-4c0b-b532-6811ca315c88 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:23:16.779793 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebe9d09-7bf0-4c0b-b532-6811ca315c88 None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:23:16.786250 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 506/996] 10.222.0.23 () {56 vars in 1087 bytes} [Tue May 10 05:23:16 2022] GET /identity/v3/services => generated 1727 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 05:23:17.206974 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56f65b4-1681-4677-81f7-35b594b9a715 None None] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:23:17.207533 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56f65b4-1681-4677-81f7-35b594b9a715 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:23:17.207533 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56f65b4-1681-4677-81f7-35b594b9a715 None None] PATH_INFO: `/` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:23:17.208927 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 491/997] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 10 05:23:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 05:23:17.214517 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267b1e8e-2be3-43c1-8d6e-e5dc9b785c51 None None] REQUEST_METHOD: `POST` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:23:17.214944 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267b1e8e-2be3-43c1-8d6e-e5dc9b785c51 None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:23:17.215121 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267b1e8e-2be3-43c1-8d6e-e5dc9b785c51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:23:17.232459 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.auth.core [None req-267b1e8e-2be3-43c1-8d6e-e5dc9b785c51 None None] MFA Rules not processed for user `44883b22532e44049d846938dc2cf423`. Rule list: `[]` (Enabled: `True`). {{(pid=79879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:23:17.233662 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-267b1e8e-2be3-43c1-8d6e-e5dc9b785c51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:23:17.303898 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 507/998] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 10 05:23:17 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 05:23:17.325754 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56f65b4-1681-4677-81f7-35b594b9a715 None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:23:17.432846 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56f65b4-1681-4677-81f7-35b594b9a715 None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:23:17.475110 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684e3132-93e6-49a9-ac5a-46d9480cffea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:23:17.475953 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684e3132-93e6-49a9-ac5a-46d9480cffea None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:23:17.476239 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684e3132-93e6-49a9-ac5a-46d9480cffea None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:23:17.476518 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684e3132-93e6-49a9-ac5a-46d9480cffea None admin] PATH_INFO: `/v3/services/image` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:23:17.477183 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684e3132-93e6-49a9-ac5a-46d9480cffea None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:23:17.478556 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684e3132-93e6-49a9-ac5a-46d9480cffea None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:23:17.490612 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application [None req-684e3132-93e6-49a9-ac5a-46d9480cffea None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 10 05:23:17.490612 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 05:23:17.490612 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 10 05:23:17.490612 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 10 05:23:17.490612 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 10 05:23:17.490612 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 10 05:23:17.490612 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 10 05:23:17.490612 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 05:23:17.490612 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 10 05:23:17.490612 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application May 10 05:23:17.490612 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 05:23:17.490612 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application May 10 05:23:17.490612 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 05:23:17.490612 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 05:23:17.490612 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 05:23:17.490612 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 05:23:17.490612 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 05:23:17.491731 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 05:23:17.491731 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 05:23:17.491731 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 05:23:17.491731 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 05:23:17.491731 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 05:23:17.491731 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 05:23:17.491731 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 10 05:23:17.491731 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_service(service_id) May 10 05:23:17.491731 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 10 05:23:17.491731 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 10 05:23:17.491731 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 05:23:17.491731 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 05:23:17.491731 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 05:23:17.491731 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 05:23:17.491731 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 05:23:17.491731 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.get_or_create( May 10 05:23:17.498256 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 05:23:17.498256 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application with Lock( May 10 05:23:17.498256 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 05:23:17.498256 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._enter() May 10 05:23:17.498256 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 05:23:17.498256 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 05:23:17.498256 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 05:23:17.498256 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.creator() May 10 05:23:17.498256 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 05:23:17.498256 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application created_value = creator( May 10 05:23:17.498256 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 10 05:23:17.498256 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 05:23:17.498256 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 10 05:23:17.498256 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application May 10 05:23:17.498256 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 492/999] 10.222.0.23 () {56 vars in 1105 bytes} [Tue May 10 05:23:17 2022] GET /identity/v3/services/image => generated 86 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 05:23:17.500716 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267b1e8e-2be3-43c1-8d6e-e5dc9b785c51 None None] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:23:17.567341 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4418eb4b-d150-467f-8bc3-e3d3315c7c17 None None] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:23:17.567958 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4418eb4b-d150-467f-8bc3-e3d3315c7c17 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:23:17.568418 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4418eb4b-d150-467f-8bc3-e3d3315c7c17 None None] PATH_INFO: `/` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:23:17.570015 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 493/1000] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 10 05:23:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 05:23:17.575220 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1062e9-d1b8-47c6-84d4-e7361e7f9698 None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:23:17.575486 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1062e9-d1b8-47c6-84d4-e7361e7f9698 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:23:17.575794 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1062e9-d1b8-47c6-84d4-e7361e7f9698 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:23:17.592419 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-5a1062e9-d1b8-47c6-84d4-e7361e7f9698 None None] MFA Rules not processed for user `44883b22532e44049d846938dc2cf423`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:23:17.593857 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-5a1062e9-d1b8-47c6-84d4-e7361e7f9698 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:23:17.608950 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267b1e8e-2be3-43c1-8d6e-e5dc9b785c51 None None] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:23:17.643497 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def75fc7-c7bf-405d-950c-0ad84728019b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:23:17.644252 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def75fc7-c7bf-405d-950c-0ad84728019b None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:23:17.644535 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def75fc7-c7bf-405d-950c-0ad84728019b None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:23:17.644807 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def75fc7-c7bf-405d-950c-0ad84728019b None admin] PATH_INFO: `/v3/services` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:23:17.645517 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def75fc7-c7bf-405d-950c-0ad84728019b None admin] RBAC: Adding query filter params (name=image) {{(pid=79879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:23:17.645823 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def75fc7-c7bf-405d-950c-0ad84728019b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:23:17.647212 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def75fc7-c7bf-405d-950c-0ad84728019b None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:23:17.652176 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 508/1001] 10.222.0.23 () {56 vars in 1108 bytes} [Tue May 10 05:23:17 2022] GET /identity/v3/services?name=image => generated 122 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:23:17.657668 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def75fc7-c7bf-405d-950c-0ad84728019b None admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:23:17.667709 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 494/1002] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 10 05:23:17 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 10 05:23:17.689328 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1062e9-d1b8-47c6-84d4-e7361e7f9698 None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:23:17.763334 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def75fc7-c7bf-405d-950c-0ad84728019b None admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:23:17.787160 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1062e9-d1b8-47c6-84d4-e7361e7f9698 None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:23:17.796073 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d0eb61-546d-4071-900b-10002b510d51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:23:17.796688 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d0eb61-546d-4071-900b-10002b510d51 None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:23:17.796993 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d0eb61-546d-4071-900b-10002b510d51 None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:23:17.797268 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d0eb61-546d-4071-900b-10002b510d51 None admin] PATH_INFO: `/v3/services` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:23:17.797954 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d0eb61-546d-4071-900b-10002b510d51 None admin] RBAC: Adding query filter params (type=image) {{(pid=79879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:23:17.798243 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d0eb61-546d-4071-900b-10002b510d51 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:23:17.799653 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d0eb61-546d-4071-900b-10002b510d51 None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:23:17.804160 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 509/1003] 10.222.0.23 () {56 vars in 1108 bytes} [Tue May 10 05:23:17 2022] GET /identity/v3/services?type=image => generated 122 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 05:23:17.822174 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085de571-9075-414e-a8f4-c8c986404eee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:23:17.823031 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085de571-9075-414e-a8f4-c8c986404eee None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:23:17.823314 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085de571-9075-414e-a8f4-c8c986404eee None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:23:17.823606 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085de571-9075-414e-a8f4-c8c986404eee None admin] PATH_INFO: `/v3/services/object-store` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:23:17.824312 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085de571-9075-414e-a8f4-c8c986404eee None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:23:17.825750 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085de571-9075-414e-a8f4-c8c986404eee None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:23:17.839083 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application [None req-085de571-9075-414e-a8f4-c8c986404eee None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 10 05:23:17.839083 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 05:23:17.839083 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 10 05:23:17.839083 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 10 05:23:17.839083 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 10 05:23:17.839083 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 10 05:23:17.839083 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 10 05:23:17.839083 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 05:23:17.839083 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 10 05:23:17.839083 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application May 10 05:23:17.839083 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 05:23:17.839083 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application May 10 05:23:17.839083 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 05:23:17.839083 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 05:23:17.839083 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 05:23:17.839083 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 05:23:17.839083 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 05:23:17.840405 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 05:23:17.840405 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 05:23:17.840405 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 05:23:17.840405 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 05:23:17.840405 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 05:23:17.840405 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 05:23:17.840405 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 10 05:23:17.840405 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_service(service_id) May 10 05:23:17.840405 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 10 05:23:17.840405 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 10 05:23:17.840405 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 05:23:17.840405 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 05:23:17.840405 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 05:23:17.840405 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 05:23:17.840405 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 05:23:17.840405 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.get_or_create( May 10 05:23:17.841331 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 05:23:17.841331 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application with Lock( May 10 05:23:17.841331 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 05:23:17.841331 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._enter() May 10 05:23:17.841331 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 05:23:17.841331 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 05:23:17.841331 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 05:23:17.841331 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.creator() May 10 05:23:17.841331 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 05:23:17.841331 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application created_value = creator( May 10 05:23:17.841331 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 10 05:23:17.841331 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 05:23:17.841331 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 10 05:23:17.841331 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application May 10 05:23:17.843974 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 495/1004] 10.222.0.23 () {56 vars in 1126 bytes} [Tue May 10 05:23:17 2022] GET /identity/v3/services/object-store => generated 93 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 05:23:17.846804 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d0eb61-546d-4071-900b-10002b510d51 None admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:23:17.957360 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d0eb61-546d-4071-900b-10002b510d51 None admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:23:17.994307 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfe684c-0075-4170-9435-23789edbc55b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:23:17.994988 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfe684c-0075-4170-9435-23789edbc55b None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:23:17.995268 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfe684c-0075-4170-9435-23789edbc55b None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:23:17.995554 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfe684c-0075-4170-9435-23789edbc55b None admin] PATH_INFO: `/v3/services` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:23:17.996902 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dfe684c-0075-4170-9435-23789edbc55b None admin] RBAC: Adding query filter params (name=object-store) {{(pid=79879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:23:17.997007 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dfe684c-0075-4170-9435-23789edbc55b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:23:17.998379 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dfe684c-0075-4170-9435-23789edbc55b None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:23:18.003392 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 510/1005] 10.222.0.23 () {56 vars in 1122 bytes} [Tue May 10 05:23:17 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:23:18.009229 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085de571-9075-414e-a8f4-c8c986404eee None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:23:18.114268 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085de571-9075-414e-a8f4-c8c986404eee None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:23:18.148127 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9611c80-c3c2-4a13-b649-9bb7b09c18b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:23:18.148799 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9611c80-c3c2-4a13-b649-9bb7b09c18b0 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:23:18.149078 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9611c80-c3c2-4a13-b649-9bb7b09c18b0 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:23:18.149352 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9611c80-c3c2-4a13-b649-9bb7b09c18b0 None admin] PATH_INFO: `/v3/services` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:23:18.150070 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9611c80-c3c2-4a13-b649-9bb7b09c18b0 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:23:18.150373 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9611c80-c3c2-4a13-b649-9bb7b09c18b0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:23:18.151778 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9611c80-c3c2-4a13-b649-9bb7b09c18b0 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:23:18.156640 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 496/1006] 10.222.0.23 () {56 vars in 1122 bytes} [Tue May 10 05:23:18 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:23:18.163034 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfe684c-0075-4170-9435-23789edbc55b None admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:23:18.261736 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfe684c-0075-4170-9435-23789edbc55b None admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:23:18.295475 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78bdb78-72d3-466a-97fd-b6d33d0cbaf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:23:18.296164 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78bdb78-72d3-466a-97fd-b6d33d0cbaf0 None admin] REQUEST_METHOD: `POST` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:23:18.296443 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78bdb78-72d3-466a-97fd-b6d33d0cbaf0 None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:23:18.296717 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78bdb78-72d3-466a-97fd-b6d33d0cbaf0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:23:18.297469 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78bdb78-72d3-466a-97fd-b6d33d0cbaf0 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:23:18.298813 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78bdb78-72d3-466a-97fd-b6d33d0cbaf0 None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:23:18.316449 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 511/1007] 10.222.0.23 () {60 vars in 1144 bytes} [Tue May 10 05:23:18 2022] POST /identity/v3/endpoints => generated 325 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 05:23:19.022699 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118f0cd1-edac-46cd-9fa9-0f289714ca9d None None] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:23:19.023256 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118f0cd1-edac-46cd-9fa9-0f289714ca9d None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:23:19.023256 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118f0cd1-edac-46cd-9fa9-0f289714ca9d None None] PATH_INFO: `/` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:23:19.024914 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 497/1008] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 10 05:23:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 05:23:19.030085 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b883c1a-bc6c-44ff-98de-354531207d20 None None] REQUEST_METHOD: `POST` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:23:19.030327 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b883c1a-bc6c-44ff-98de-354531207d20 None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:23:19.030632 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b883c1a-bc6c-44ff-98de-354531207d20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:23:19.048242 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.auth.core [None req-5b883c1a-bc6c-44ff-98de-354531207d20 None None] MFA Rules not processed for user `44883b22532e44049d846938dc2cf423`. Rule list: `[]` (Enabled: `True`). {{(pid=79879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:23:19.049401 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-5b883c1a-bc6c-44ff-98de-354531207d20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:23:19.122418 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 512/1009] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 10 05:23:19 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 10 05:23:19.144517 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118f0cd1-edac-46cd-9fa9-0f289714ca9d None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:23:19.244405 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118f0cd1-edac-46cd-9fa9-0f289714ca9d None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:23:19.276209 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a85307-e42f-49af-b656-89e8e39c5f4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:23:19.276938 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a85307-e42f-49af-b656-89e8e39c5f4e None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:23:19.277213 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a85307-e42f-49af-b656-89e8e39c5f4e None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:23:19.277478 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a85307-e42f-49af-b656-89e8e39c5f4e None admin] PATH_INFO: `/v3/services/compute` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:23:19.278126 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a85307-e42f-49af-b656-89e8e39c5f4e None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:23:19.279479 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a85307-e42f-49af-b656-89e8e39c5f4e None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:23:19.290875 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application [None req-f5a85307-e42f-49af-b656-89e8e39c5f4e None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 10 05:23:19.290875 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 05:23:19.290875 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 10 05:23:19.290875 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 10 05:23:19.290875 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 10 05:23:19.290875 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 10 05:23:19.290875 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 10 05:23:19.290875 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 05:23:19.290875 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 10 05:23:19.290875 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application May 10 05:23:19.290875 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 05:23:19.290875 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application May 10 05:23:19.290875 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 05:23:19.290875 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 05:23:19.290875 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 05:23:19.290875 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 05:23:19.290875 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 05:23:19.292088 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 05:23:19.292088 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 05:23:19.292088 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 05:23:19.292088 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 05:23:19.292088 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 05:23:19.292088 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 05:23:19.292088 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 10 05:23:19.292088 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_service(service_id) May 10 05:23:19.292088 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 10 05:23:19.292088 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 10 05:23:19.292088 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 05:23:19.292088 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 05:23:19.292088 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 05:23:19.292088 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 05:23:19.292088 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 05:23:19.292088 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.get_or_create( May 10 05:23:19.292939 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 05:23:19.292939 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application with Lock( May 10 05:23:19.292939 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 05:23:19.292939 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._enter() May 10 05:23:19.292939 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 05:23:19.292939 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 05:23:19.292939 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 05:23:19.292939 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.creator() May 10 05:23:19.292939 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 05:23:19.292939 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application created_value = creator( May 10 05:23:19.292939 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 10 05:23:19.292939 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 05:23:19.292939 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 10 05:23:19.292939 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application May 10 05:23:19.295933 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 498/1010] 10.222.0.23 () {56 vars in 1111 bytes} [Tue May 10 05:23:19 2022] GET /identity/v3/services/compute => generated 88 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 05:23:19.298076 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b883c1a-bc6c-44ff-98de-354531207d20 None None] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:23:19.394980 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b883c1a-bc6c-44ff-98de-354531207d20 None None] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:23:19.427345 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c1e4c3-692d-4fcb-af12-7b0c5db8e6d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:23:19.428075 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c1e4c3-692d-4fcb-af12-7b0c5db8e6d4 None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:23:19.428355 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c1e4c3-692d-4fcb-af12-7b0c5db8e6d4 None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:23:19.428624 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c1e4c3-692d-4fcb-af12-7b0c5db8e6d4 None admin] PATH_INFO: `/v3/services` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:23:19.429362 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c1e4c3-692d-4fcb-af12-7b0c5db8e6d4 None admin] RBAC: Adding query filter params (name=compute) {{(pid=79879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:23:19.429662 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c1e4c3-692d-4fcb-af12-7b0c5db8e6d4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:23:19.431119 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c1e4c3-692d-4fcb-af12-7b0c5db8e6d4 None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:23:19.441548 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 513/1011] 10.222.0.23 () {56 vars in 1112 bytes} [Tue May 10 05:23:19 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:23:19.443302 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a85307-e42f-49af-b656-89e8e39c5f4e None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:23:19.551070 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a85307-e42f-49af-b656-89e8e39c5f4e None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:23:19.584921 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418f11b8-ce3e-49a0-a6d6-c66e6f910f43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:23:19.585666 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418f11b8-ce3e-49a0-a6d6-c66e6f910f43 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:23:19.585933 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418f11b8-ce3e-49a0-a6d6-c66e6f910f43 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:23:19.586257 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418f11b8-ce3e-49a0-a6d6-c66e6f910f43 None admin] PATH_INFO: `/v3/services` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:23:19.586983 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418f11b8-ce3e-49a0-a6d6-c66e6f910f43 None admin] RBAC: Adding query filter params (type=compute) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:23:19.587329 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418f11b8-ce3e-49a0-a6d6-c66e6f910f43 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:23:19.588849 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418f11b8-ce3e-49a0-a6d6-c66e6f910f43 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:23:19.594096 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 499/1012] 10.222.0.23 () {56 vars in 1112 bytes} [Tue May 10 05:23:19 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:23:19.599899 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c1e4c3-692d-4fcb-af12-7b0c5db8e6d4 None admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:23:19.702202 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c1e4c3-692d-4fcb-af12-7b0c5db8e6d4 None admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:23:19.734597 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba17a3a-b9c0-49cb-8a01-cf2c4e4e08aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:23:19.735262 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba17a3a-b9c0-49cb-8a01-cf2c4e4e08aa None admin] REQUEST_METHOD: `POST` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:23:19.735631 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba17a3a-b9c0-49cb-8a01-cf2c4e4e08aa None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:23:19.735903 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba17a3a-b9c0-49cb-8a01-cf2c4e4e08aa None admin] PATH_INFO: `/v3/endpoints` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:23:19.736672 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba17a3a-b9c0-49cb-8a01-cf2c4e4e08aa None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:23:19.738084 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba17a3a-b9c0-49cb-8a01-cf2c4e4e08aa None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:23:19.763599 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 514/1013] 10.222.0.23 () {60 vars in 1144 bytes} [Tue May 10 05:23:19 2022] POST /identity/v3/endpoints => generated 334 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 05:23:20.024424 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8fa4b5-0f2b-429f-ab3f-9d23d870444e None None] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:23:20.024940 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8fa4b5-0f2b-429f-ab3f-9d23d870444e None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:23:20.024940 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8fa4b5-0f2b-429f-ab3f-9d23d870444e None None] PATH_INFO: `/` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:23:20.026316 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 500/1014] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 10 05:23:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 05:23:20.032049 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb66ace-fb06-41f2-9f6c-b13ffbdab089 None None] REQUEST_METHOD: `POST` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:23:20.032331 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb66ace-fb06-41f2-9f6c-b13ffbdab089 None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:23:20.032605 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb66ace-fb06-41f2-9f6c-b13ffbdab089 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:23:20.050345 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.auth.core [None req-5cb66ace-fb06-41f2-9f6c-b13ffbdab089 None None] MFA Rules not processed for user `44883b22532e44049d846938dc2cf423`. Rule list: `[]` (Enabled: `True`). {{(pid=79879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:23:20.051659 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-5cb66ace-fb06-41f2-9f6c-b13ffbdab089 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:23:20.124437 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 515/1015] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 10 05:23:20 2022] POST /identity/v3/auth/tokens => generated 1863 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 05:23:20.147306 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8fa4b5-0f2b-429f-ab3f-9d23d870444e None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:23:20.248663 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8fa4b5-0f2b-429f-ab3f-9d23d870444e None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:23:20.281646 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49756f58-d7ae-45b7-a613-aad278f8d4bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:23:20.282237 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49756f58-d7ae-45b7-a613-aad278f8d4bf None admin] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:23:20.282513 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49756f58-d7ae-45b7-a613-aad278f8d4bf None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:23:20.282787 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49756f58-d7ae-45b7-a613-aad278f8d4bf None admin] PATH_INFO: `/v3/services` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:23:20.283688 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49756f58-d7ae-45b7-a613-aad278f8d4bf None admin] RBAC: Authorizing `identity:create_service()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:23:20.285226 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49756f58-d7ae-45b7-a613-aad278f8d4bf None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:23:20.307619 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 501/1016] 10.222.0.23 () {60 vars in 1141 bytes} [Tue May 10 05:23:20 2022] POST /identity/v3/services => generated 242 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 05:23:20.539081 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebaf540-ca93-4d5e-a73f-92bd86945dd9 None None] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:23:20.539608 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebaf540-ca93-4d5e-a73f-92bd86945dd9 None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:23:20.539693 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebaf540-ca93-4d5e-a73f-92bd86945dd9 None None] PATH_INFO: `/` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:23:20.541222 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 516/1017] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 10 05:23:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 05:23:20.546435 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c2d425-652a-4e23-bd19-04f3b466af4e None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:23:20.546730 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c2d425-652a-4e23-bd19-04f3b466af4e None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:23:20.547010 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c2d425-652a-4e23-bd19-04f3b466af4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:23:20.563508 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-43c2d425-652a-4e23-bd19-04f3b466af4e None None] MFA Rules not processed for user `44883b22532e44049d846938dc2cf423`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:23:20.564712 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-43c2d425-652a-4e23-bd19-04f3b466af4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:23:20.635603 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 502/1018] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 10 05:23:20 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 05:23:20.658250 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebaf540-ca93-4d5e-a73f-92bd86945dd9 None None] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:23:20.760310 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebaf540-ca93-4d5e-a73f-92bd86945dd9 None None] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:23:20.794044 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0075bac8-ff84-4813-b5ed-3f03450dd2f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:23:20.795149 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0075bac8-ff84-4813-b5ed-3f03450dd2f7 None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:23:20.795676 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0075bac8-ff84-4813-b5ed-3f03450dd2f7 None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:23:20.796188 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0075bac8-ff84-4813-b5ed-3f03450dd2f7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:23:20.798044 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0075bac8-ff84-4813-b5ed-3f03450dd2f7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:23:20.799505 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0075bac8-ff84-4813-b5ed-3f03450dd2f7 None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:23:20.801561 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 517/1019] 10.222.0.23 () {56 vars in 1108 bytes} [Tue May 10 05:23:20 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:23:20.807214 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c2d425-652a-4e23-bd19-04f3b466af4e None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:23:20.906881 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c2d425-652a-4e23-bd19-04f3b466af4e None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:23:20.940323 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61db357f-7fe6-45f7-a350-4a89e2538f1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:23:20.941017 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61db357f-7fe6-45f7-a350-4a89e2538f1c None admin] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:23:20.941271 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61db357f-7fe6-45f7-a350-4a89e2538f1c None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:23:20.941572 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61db357f-7fe6-45f7-a350-4a89e2538f1c None admin] PATH_INFO: `/v3/projects` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:23:20.942283 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61db357f-7fe6-45f7-a350-4a89e2538f1c None admin] RBAC: Authorizing `identity:create_project()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:23:20.943757 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61db357f-7fe6-45f7-a350-4a89e2538f1c None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:23:20.975600 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 503/1020] 10.222.0.23 () {60 vars in 1141 bytes} [Tue May 10 05:23:20 2022] POST /identity/v3/projects => generated 311 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 05:23:22.103504 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a01926a-c71e-4573-a3f3-9a255569a126 None None] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:23:22.104155 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a01926a-c71e-4573-a3f3-9a255569a126 None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:23:22.104155 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a01926a-c71e-4573-a3f3-9a255569a126 None None] PATH_INFO: `/` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:23:22.105747 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 518/1021] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 10 05:23:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 05:23:22.111642 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166b5279-f54c-439a-9cb9-4cd36c048f1a None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:23:22.112224 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166b5279-f54c-439a-9cb9-4cd36c048f1a None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:23:22.112224 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166b5279-f54c-439a-9cb9-4cd36c048f1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:23:22.129533 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-166b5279-f54c-439a-9cb9-4cd36c048f1a None None] MFA Rules not processed for user `44883b22532e44049d846938dc2cf423`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:23:22.130718 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-166b5279-f54c-439a-9cb9-4cd36c048f1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:23:22.198969 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 504/1022] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 10 05:23:22 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 05:23:22.223175 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a01926a-c71e-4573-a3f3-9a255569a126 None None] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:23:22.324820 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a01926a-c71e-4573-a3f3-9a255569a126 None None] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:23:22.360981 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36571d07-4632-4047-9d53-97782faf0f42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:23:22.361778 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36571d07-4632-4047-9d53-97782faf0f42 None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:23:22.362059 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36571d07-4632-4047-9d53-97782faf0f42 None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:23:22.362329 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36571d07-4632-4047-9d53-97782faf0f42 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:23:22.375394 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36571d07-4632-4047-9d53-97782faf0f42 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 05:23:22.383907 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application [None req-36571d07-4632-4047-9d53-97782faf0f42 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 10 05:23:22.383907 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 05:23:22.383907 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 05:23:22.383907 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 05:23:22.383907 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 05:23:22.383907 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 05:23:22.383907 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 05:23:22.383907 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 05:23:22.383907 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 05:23:22.383907 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 05:23:22.383907 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 05:23:22.383907 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 05:23:22.383907 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 05:23:22.383907 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 05:23:22.383907 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 05:23:22.383907 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 05:23:22.384995 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 05:23:22.384995 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 05:23:22.384995 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 05:23:22.384995 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 05:23:22.384995 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 05:23:22.384995 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 05:23:22.384995 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 05:23:22.384995 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 05:23:22.384995 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 05:23:22.384995 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.get_or_create( May 10 05:23:22.384995 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 05:23:22.384995 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application with Lock( May 10 05:23:22.384995 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 05:23:22.384995 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self._enter() May 10 05:23:22.384995 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 05:23:22.384995 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 05:23:22.394618 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 05:23:22.394618 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.creator() May 10 05:23:22.394618 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 05:23:22.394618 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application created_value = creator( May 10 05:23:22.394618 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 05:23:22.394618 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 05:23:22.394618 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 05:23:22.394618 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 05:23:22.394618 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 05:23:22.394618 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 05:23:22.394618 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 10 05:23:22.394618 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application May 10 05:23:22.394618 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 519/1023] 10.222.0.23 () {56 vars in 1120 bytes} [Tue May 10 05:23:22 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 05:23:22.395532 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166b5279-f54c-439a-9cb9-4cd36c048f1a None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:23:22.497240 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166b5279-f54c-439a-9cb9-4cd36c048f1a None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:23:22.532358 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167a1632-195c-4087-8261-ff458bd17ad4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:23:22.533021 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167a1632-195c-4087-8261-ff458bd17ad4 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:23:22.533294 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167a1632-195c-4087-8261-ff458bd17ad4 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:23:22.533563 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167a1632-195c-4087-8261-ff458bd17ad4 None admin] PATH_INFO: `/v3/roles` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:23:22.534308 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167a1632-195c-4087-8261-ff458bd17ad4 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:23:22.534607 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167a1632-195c-4087-8261-ff458bd17ad4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:23:22.536073 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167a1632-195c-4087-8261-ff458bd17ad4 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:23:22.544317 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 505/1024] 10.222.0.23 () {56 vars in 1115 bytes} [Tue May 10 05:23:22 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:23:22.545607 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd98d422-2225-4ad9-8d61-46c776676ed0 None None] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:23:22.545895 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd98d422-2225-4ad9-8d61-46c776676ed0 None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:23:22.546168 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd98d422-2225-4ad9-8d61-46c776676ed0 None None] PATH_INFO: `/` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:23:22.547619 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 520/1025] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 10 05:23:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 05:23:22.549562 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167a1632-195c-4087-8261-ff458bd17ad4 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:23:22.552457 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d1cda4-41f1-45e9-8dcf-e8dbc855d766 None None] REQUEST_METHOD: `POST` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:23:22.552744 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d1cda4-41f1-45e9-8dcf-e8dbc855d766 None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:23:22.553021 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d1cda4-41f1-45e9-8dcf-e8dbc855d766 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:23:22.570428 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.auth.core [None req-14d1cda4-41f1-45e9-8dcf-e8dbc855d766 None None] MFA Rules not processed for user `44883b22532e44049d846938dc2cf423`. Rule list: `[]` (Enabled: `True`). {{(pid=79879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:23:22.571842 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-14d1cda4-41f1-45e9-8dcf-e8dbc855d766 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:23:22.638135 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 521/1026] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 10 05:23:22 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 10 05:23:22.646112 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167a1632-195c-4087-8261-ff458bd17ad4 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:23:22.660293 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d1cda4-41f1-45e9-8dcf-e8dbc855d766 None None] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:23:22.679314 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049a07c1-8de7-4960-962f-acc81e82cfba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:23:22.680190 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049a07c1-8de7-4960-962f-acc81e82cfba None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:23:22.680554 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049a07c1-8de7-4960-962f-acc81e82cfba None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:23:22.680833 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049a07c1-8de7-4960-962f-acc81e82cfba None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:23:22.691371 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049a07c1-8de7-4960-962f-acc81e82cfba None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:23:22.692846 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049a07c1-8de7-4960-962f-acc81e82cfba None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:23:22.709502 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application [None req-049a07c1-8de7-4960-962f-acc81e82cfba None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 05:23:22.709502 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 05:23:22.709502 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 05:23:22.709502 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 05:23:22.709502 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 05:23:22.709502 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 05:23:22.709502 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 05:23:22.709502 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 05:23:22.709502 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 05:23:22.709502 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 05:23:22.709502 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 05:23:22.709502 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 05:23:22.709502 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 05:23:22.709502 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 05:23:22.709502 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 05:23:22.710468 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 05:23:22.710468 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 05:23:22.710468 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 05:23:22.710468 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 05:23:22.710468 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 05:23:22.710468 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 05:23:22.710468 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.get_or_create( May 10 05:23:22.710468 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 05:23:22.710468 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application with Lock( May 10 05:23:22.710468 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 05:23:22.710468 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._enter() May 10 05:23:22.710468 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 05:23:22.710468 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 05:23:22.710468 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 05:23:22.710468 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.creator() May 10 05:23:22.710468 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 05:23:22.710468 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application created_value = creator( May 10 05:23:22.711380 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 05:23:22.711380 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 05:23:22.711380 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 05:23:22.711380 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application May 10 05:23:22.711380 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 506/1027] 10.222.0.23 () {56 vars in 1108 bytes} [Tue May 10 05:23:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 05:23:22.716306 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049a07c1-8de7-4960-962f-acc81e82cfba None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:23:22.763487 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d1cda4-41f1-45e9-8dcf-e8dbc855d766 None None] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:23:22.797782 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00a84f3-1dbb-4b6c-a36c-731ab3483f15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:23:22.798578 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00a84f3-1dbb-4b6c-a36c-731ab3483f15 None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:23:22.798857 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00a84f3-1dbb-4b6c-a36c-731ab3483f15 None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:23:22.799131 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00a84f3-1dbb-4b6c-a36c-731ab3483f15 None admin] PATH_INFO: `/v3/services/image` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:23:22.799820 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00a84f3-1dbb-4b6c-a36c-731ab3483f15 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:23:22.801227 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00a84f3-1dbb-4b6c-a36c-731ab3483f15 None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:23:22.812632 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application [None req-c00a84f3-1dbb-4b6c-a36c-731ab3483f15 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 10 05:23:22.812632 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 05:23:22.812632 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 10 05:23:22.812632 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 10 05:23:22.812632 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 10 05:23:22.812632 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 10 05:23:22.812632 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 10 05:23:22.812632 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 05:23:22.812632 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 10 05:23:22.812632 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application May 10 05:23:22.812632 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 05:23:22.812632 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application May 10 05:23:22.812632 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 05:23:22.812632 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 05:23:22.812632 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 05:23:22.812632 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 05:23:22.812632 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 05:23:22.813616 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 05:23:22.813616 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 05:23:22.813616 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 05:23:22.813616 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 05:23:22.813616 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 05:23:22.813616 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 05:23:22.813616 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 10 05:23:22.813616 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self._get_service(service_id) May 10 05:23:22.813616 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 10 05:23:22.813616 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 10 05:23:22.813616 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 05:23:22.813616 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 05:23:22.813616 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 05:23:22.813616 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 05:23:22.813616 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 05:23:22.813616 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.get_or_create( May 10 05:23:22.814461 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 05:23:22.814461 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application with Lock( May 10 05:23:22.814461 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 05:23:22.814461 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self._enter() May 10 05:23:22.814461 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 05:23:22.814461 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 05:23:22.814461 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 05:23:22.814461 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.creator() May 10 05:23:22.814461 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 05:23:22.814461 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application created_value = creator( May 10 05:23:22.814461 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 10 05:23:22.814461 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 05:23:22.814461 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 10 05:23:22.814461 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application May 10 05:23:22.814461 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 522/1028] 10.222.0.23 () {56 vars in 1105 bytes} [Tue May 10 05:23:22 2022] GET /identity/v3/services/image => generated 86 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 05:23:22.819946 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00a84f3-1dbb-4b6c-a36c-731ab3483f15 None admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:23:22.821028 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049a07c1-8de7-4960-962f-acc81e82cfba None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:23:22.855356 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f9f27f-9a36-4620-9b26-eed5f66638a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:23:22.856048 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f9f27f-9a36-4620-9b26-eed5f66638a0 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:23:22.856331 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f9f27f-9a36-4620-9b26-eed5f66638a0 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:23:22.856580 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f9f27f-9a36-4620-9b26-eed5f66638a0 None admin] PATH_INFO: `/v3/domains` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:23:22.857344 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f9f27f-9a36-4620-9b26-eed5f66638a0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:23:22.857651 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f9f27f-9a36-4620-9b26-eed5f66638a0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:23:22.859007 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f9f27f-9a36-4620-9b26-eed5f66638a0 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:23:22.872346 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 507/1029] 10.222.0.23 () {56 vars in 1109 bytes} [Tue May 10 05:23:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 05:23:22.877785 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f9f27f-9a36-4620-9b26-eed5f66638a0 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:23:22.918638 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00a84f3-1dbb-4b6c-a36c-731ab3483f15 None admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:23:22.950810 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e654c7f-ffd2-4192-b4ff-f12a93db850e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:23:22.951477 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e654c7f-ffd2-4192-b4ff-f12a93db850e None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:23:22.951802 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e654c7f-ffd2-4192-b4ff-f12a93db850e None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:23:22.952085 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e654c7f-ffd2-4192-b4ff-f12a93db850e None admin] PATH_INFO: `/v3/services` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:23:22.952797 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e654c7f-ffd2-4192-b4ff-f12a93db850e None admin] RBAC: Adding query filter params (name=image) {{(pid=79879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:23:22.953103 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e654c7f-ffd2-4192-b4ff-f12a93db850e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:23:22.954484 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e654c7f-ffd2-4192-b4ff-f12a93db850e None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:23:22.963733 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 523/1030] 10.222.0.23 () {56 vars in 1108 bytes} [Tue May 10 05:23:22 2022] GET /identity/v3/services?name=image => generated 122 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 05:23:22.965149 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e654c7f-ffd2-4192-b4ff-f12a93db850e None admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:23:22.974602 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f9f27f-9a36-4620-9b26-eed5f66638a0 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:23:23.011018 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab279b6-2321-44e2-9714-906b23a661ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:23:23.011895 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab279b6-2321-44e2-9714-906b23a661ba None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:23:23.012236 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab279b6-2321-44e2-9714-906b23a661ba None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:23:23.012480 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab279b6-2321-44e2-9714-906b23a661ba None admin] PATH_INFO: `/v3/users/nova` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:23:23.020799 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab279b6-2321-44e2-9714-906b23a661ba None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:23:23.022293 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab279b6-2321-44e2-9714-906b23a661ba None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:23:23.037704 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application [None req-9ab279b6-2321-44e2-9714-906b23a661ba None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 10 05:23:23.037704 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 05:23:23.037704 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 05:23:23.037704 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 05:23:23.037704 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 05:23:23.037704 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 05:23:23.037704 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 05:23:23.037704 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 05:23:23.037704 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 05:23:23.037704 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 05:23:23.037704 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 05:23:23.037704 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 05:23:23.037704 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 05:23:23.037704 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 05:23:23.037704 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 05:23:23.037704 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 05:23:23.038919 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 05:23:23.038919 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 05:23:23.038919 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 05:23:23.038919 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 05:23:23.038919 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 05:23:23.038919 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 05:23:23.038919 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 05:23:23.038919 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 05:23:23.038919 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 05:23:23.038919 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.get_or_create( May 10 05:23:23.038919 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 05:23:23.038919 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application with Lock( May 10 05:23:23.038919 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 05:23:23.038919 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._enter() May 10 05:23:23.038919 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 05:23:23.038919 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 05:23:23.038919 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 05:23:23.038919 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.creator() May 10 05:23:23.039943 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 05:23:23.039943 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application created_value = creator( May 10 05:23:23.039943 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 05:23:23.039943 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 05:23:23.039943 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 05:23:23.039943 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 05:23:23.039943 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 05:23:23.039943 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 05:23:23.039943 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 10 05:23:23.039943 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application May 10 05:23:23.039943 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 508/1031] 10.222.0.23 () {56 vars in 1093 bytes} [Tue May 10 05:23:22 2022] GET /identity/v3/users/nova => generated 82 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 05:23:23.044803 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab279b6-2321-44e2-9714-906b23a661ba None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:23:23.071726 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e654c7f-ffd2-4192-b4ff-f12a93db850e None admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:23:23.103261 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cbbdf1-a2a8-432a-8ba4-3001455b9c43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:23:23.103971 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cbbdf1-a2a8-432a-8ba4-3001455b9c43 None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:23:23.104553 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cbbdf1-a2a8-432a-8ba4-3001455b9c43 None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:23:23.104553 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cbbdf1-a2a8-432a-8ba4-3001455b9c43 None admin] PATH_INFO: `/v3/services` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:23:23.105200 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52cbbdf1-a2a8-432a-8ba4-3001455b9c43 None admin] RBAC: Adding query filter params (type=image) {{(pid=79879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:23:23.105500 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52cbbdf1-a2a8-432a-8ba4-3001455b9c43 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:23:23.106857 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52cbbdf1-a2a8-432a-8ba4-3001455b9c43 None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:23:23.116979 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 524/1032] 10.222.0.23 () {56 vars in 1108 bytes} [Tue May 10 05:23:22 2022] GET /identity/v3/services?type=image => generated 350 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 05:23:23.117985 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cbbdf1-a2a8-432a-8ba4-3001455b9c43 None admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:23:23.142096 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab279b6-2321-44e2-9714-906b23a661ba None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:23:23.174479 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a63fe6-6060-4370-8831-20561ce24a9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:23:23.175087 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a63fe6-6060-4370-8831-20561ce24a9a None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:23:23.175435 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a63fe6-6060-4370-8831-20561ce24a9a None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:23:23.175736 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a63fe6-6060-4370-8831-20561ce24a9a None admin] PATH_INFO: `/v3/users` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:23:23.176586 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a63fe6-6060-4370-8831-20561ce24a9a None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:23:23.176896 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a63fe6-6060-4370-8831-20561ce24a9a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:23:23.178330 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a63fe6-6060-4370-8831-20561ce24a9a None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:23:23.204333 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 509/1033] 10.222.0.23 () {56 vars in 1133 bytes} [Tue May 10 05:23:23 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 05:23:23.204333 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a6aa09-a07f-43e6-8c1f-982e69fdcbe1 None None] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:23:23.204333 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a6aa09-a07f-43e6-8c1f-982e69fdcbe1 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:23:23.204333 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a6aa09-a07f-43e6-8c1f-982e69fdcbe1 None None] PATH_INFO: `/` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:23:23.204333 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 510/1034] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 10 05:23:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 05:23:23.205225 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a6aa09-a07f-43e6-8c1f-982e69fdcbe1 None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:23:23.214390 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cbbdf1-a2a8-432a-8ba4-3001455b9c43 None admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:23:23.245687 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b9566b-e7b1-408b-9d91-4f8dfc465399 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:23:23.246712 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b9566b-e7b1-408b-9d91-4f8dfc465399 None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:23:23.246991 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b9566b-e7b1-408b-9d91-4f8dfc465399 None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:23:23.247264 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b9566b-e7b1-408b-9d91-4f8dfc465399 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:23:23.248091 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b9566b-e7b1-408b-9d91-4f8dfc465399 None admin] RBAC: Adding query filter params (interface=public, service_id=b21dba764bdf42b2af32c278074e5991, region_id=RegionOne) {{(pid=79879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:23:23.248400 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b9566b-e7b1-408b-9d91-4f8dfc465399 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:23:23.249816 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b9566b-e7b1-408b-9d91-4f8dfc465399 None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:23:23.254833 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 525/1035] 10.222.0.23 () {56 vars in 1251 bytes} [Tue May 10 05:23:23 2022] GET /identity/v3/endpoints?service_id=b21dba764bdf42b2af32c278074e5991&interface=public®ion_id=RegionOne => generated 194 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:23:23.256033 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb2aec9-d50e-4501-8b0b-c7f7243797b8 None None] REQUEST_METHOD: `POST` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:23:23.256319 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb2aec9-d50e-4501-8b0b-c7f7243797b8 None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:23:23.256598 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb2aec9-d50e-4501-8b0b-c7f7243797b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:23:23.273183 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.auth.core [None req-fdb2aec9-d50e-4501-8b0b-c7f7243797b8 None None] MFA Rules not processed for user `44883b22532e44049d846938dc2cf423`. Rule list: `[]` (Enabled: `True`). {{(pid=79879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:23:23.274354 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-fdb2aec9-d50e-4501-8b0b-c7f7243797b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:23:23.299856 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a6aa09-a07f-43e6-8c1f-982e69fdcbe1 None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:23:23.331424 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4379d0c9-23da-49e1-b825-b76232102329 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:23:23.332127 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4379d0c9-23da-49e1-b825-b76232102329 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:23:23.332408 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4379d0c9-23da-49e1-b825-b76232102329 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:23:23.332677 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4379d0c9-23da-49e1-b825-b76232102329 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:23:23.338962 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 526/1036] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 10 05:23:23 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 05:23:23.339635 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb2aec9-d50e-4501-8b0b-c7f7243797b8 None None] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:23:23.397032 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4379d0c9-23da-49e1-b825-b76232102329 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:23:23.398493 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4379d0c9-23da-49e1-b825-b76232102329 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:23:23.436015 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb2aec9-d50e-4501-8b0b-c7f7243797b8 None None] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:23:23.473752 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de80af7-9d5d-4ad9-b746-db401255c9b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:23:23.474423 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de80af7-9d5d-4ad9-b746-db401255c9b5 None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:23:23.474695 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de80af7-9d5d-4ad9-b746-db401255c9b5 None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:23:23.474968 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de80af7-9d5d-4ad9-b746-db401255c9b5 None admin] PATH_INFO: `/v3/services` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:23:23.475694 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de80af7-9d5d-4ad9-b746-db401255c9b5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:23:23.477053 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de80af7-9d5d-4ad9-b746-db401255c9b5 None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:23:23.483660 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 527/1037] 10.222.0.23 () {56 vars in 1087 bytes} [Tue May 10 05:23:23 2022] GET /identity/v3/services => generated 1957 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 05:23:23.484247 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de80af7-9d5d-4ad9-b746-db401255c9b5 None admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:23:23.513560 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 511/1038] 10.222.0.23 () {58 vars in 1282 bytes} [Tue May 10 05:23:23 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 10 05:23:23.519762 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4379d0c9-23da-49e1-b825-b76232102329 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:23:23.597941 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de80af7-9d5d-4ad9-b746-db401255c9b5 None admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:23:23.623665 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4379d0c9-23da-49e1-b825-b76232102329 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:23:23.635057 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15987c2-d9f6-4481-aa72-525785908027 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:23:23.636270 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15987c2-d9f6-4481-aa72-525785908027 None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:23:23.636777 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15987c2-d9f6-4481-aa72-525785908027 None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:23:23.637227 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15987c2-d9f6-4481-aa72-525785908027 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:23:23.638688 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15987c2-d9f6-4481-aa72-525785908027 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:23:23.640381 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15987c2-d9f6-4481-aa72-525785908027 None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:23:23.642288 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 528/1039] 10.222.0.23 () {56 vars in 1108 bytes} [Tue May 10 05:23:23 2022] GET /identity/v3/domains/default => generated 199 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:23:23.648364 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15987c2-d9f6-4481-aa72-525785908027 None admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:23:23.666607 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a98ab42-5a7e-470d-8147-6f88f8d52533 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:23:23.667469 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a98ab42-5a7e-470d-8147-6f88f8d52533 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:23:23.667760 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a98ab42-5a7e-470d-8147-6f88f8d52533 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:23:23.668026 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a98ab42-5a7e-470d-8147-6f88f8d52533 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:23:23.679053 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a98ab42-5a7e-470d-8147-6f88f8d52533 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:23:23.680540 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a98ab42-5a7e-470d-8147-6f88f8d52533 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:23:23.699914 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application [None req-3a98ab42-5a7e-470d-8147-6f88f8d52533 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 05:23:23.699914 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 05:23:23.699914 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 05:23:23.699914 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 05:23:23.699914 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 05:23:23.699914 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 05:23:23.699914 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 05:23:23.699914 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 05:23:23.699914 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 05:23:23.699914 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 05:23:23.699914 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 05:23:23.699914 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 05:23:23.699914 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 05:23:23.699914 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 05:23:23.699914 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 05:23:23.700825 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 05:23:23.700825 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 05:23:23.700825 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 05:23:23.700825 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 05:23:23.700825 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 05:23:23.700825 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 05:23:23.700825 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.get_or_create( May 10 05:23:23.700825 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 05:23:23.700825 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application with Lock( May 10 05:23:23.700825 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 05:23:23.700825 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._enter() May 10 05:23:23.700825 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 05:23:23.700825 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 05:23:23.700825 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 05:23:23.700825 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.creator() May 10 05:23:23.700825 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 05:23:23.700825 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application created_value = creator( May 10 05:23:23.702012 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 05:23:23.702012 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 05:23:23.702012 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 05:23:23.702012 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application May 10 05:23:23.702012 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 512/1040] 10.222.0.23 () {56 vars in 1108 bytes} [Tue May 10 05:23:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 05:23:23.706878 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a98ab42-5a7e-470d-8147-6f88f8d52533 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:23:23.756248 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15987c2-d9f6-4481-aa72-525785908027 None admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:23:23.792100 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331b4e95-65e6-49f2-90f6-e0e861ed6e58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:23:23.792782 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331b4e95-65e6-49f2-90f6-e0e861ed6e58 None admin] REQUEST_METHOD: `POST` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:23:23.793064 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331b4e95-65e6-49f2-90f6-e0e861ed6e58 None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:23:23.793340 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331b4e95-65e6-49f2-90f6-e0e861ed6e58 None admin] PATH_INFO: `/v3/users` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:23:23.794058 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331b4e95-65e6-49f2-90f6-e0e861ed6e58 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:23:23.795499 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331b4e95-65e6-49f2-90f6-e0e861ed6e58 None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:23:23.807489 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a98ab42-5a7e-470d-8147-6f88f8d52533 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:23:23.819022 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 529/1041] 10.222.0.23 () {60 vars in 1132 bytes} [Tue May 10 05:23:23 2022] POST /identity/v3/users => generated 285 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 05:23:23.845607 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6f821e-bc7c-428c-b30a-1cfe9efdc77c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:23:23.846654 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6f821e-bc7c-428c-b30a-1cfe9efdc77c None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:23:23.847091 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6f821e-bc7c-428c-b30a-1cfe9efdc77c None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:23:23.847540 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6f821e-bc7c-428c-b30a-1cfe9efdc77c None admin] PATH_INFO: `/v3/domains` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:23:23.848494 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6f821e-bc7c-428c-b30a-1cfe9efdc77c None admin] RBAC: Adding query filter params (name=Default) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:23:23.849011 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6f821e-bc7c-428c-b30a-1cfe9efdc77c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:23:23.850679 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6f821e-bc7c-428c-b30a-1cfe9efdc77c None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:23:23.864729 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 513/1042] 10.222.0.23 () {56 vars in 1109 bytes} [Tue May 10 05:23:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:23:23.870612 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331b4e95-65e6-49f2-90f6-e0e861ed6e58 None admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:23:23.979963 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331b4e95-65e6-49f2-90f6-e0e861ed6e58 None admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:23:24.019176 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794b5e4a-19d7-4f6e-a9a7-392d034c3ad4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:23:24.020075 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794b5e4a-19d7-4f6e-a9a7-392d034c3ad4 None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:23:24.020388 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794b5e4a-19d7-4f6e-a9a7-392d034c3ad4 None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:23:24.020627 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794b5e4a-19d7-4f6e-a9a7-392d034c3ad4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:23:24.027806 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794b5e4a-19d7-4f6e-a9a7-392d034c3ad4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:23:24.029140 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794b5e4a-19d7-4f6e-a9a7-392d034c3ad4 None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:23:24.043206 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application [None req-794b5e4a-19d7-4f6e-a9a7-392d034c3ad4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 05:23:24.043206 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 05:23:24.043206 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 05:23:24.043206 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 05:23:24.043206 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 05:23:24.043206 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 05:23:24.043206 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 05:23:24.043206 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 05:23:24.043206 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 05:23:24.043206 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 05:23:24.043206 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 05:23:24.043206 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 05:23:24.043206 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 05:23:24.043206 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 05:23:24.043206 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 05:23:24.044180 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 05:23:24.044180 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 05:23:24.044180 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 05:23:24.044180 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 05:23:24.044180 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 05:23:24.044180 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 05:23:24.044180 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.get_or_create( May 10 05:23:24.044180 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 05:23:24.044180 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application with Lock( May 10 05:23:24.044180 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 05:23:24.044180 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self._enter() May 10 05:23:24.044180 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 05:23:24.044180 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 05:23:24.044180 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 05:23:24.044180 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.creator() May 10 05:23:24.044180 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 05:23:24.044180 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application created_value = creator( May 10 05:23:24.045077 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 05:23:24.045077 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 05:23:24.045077 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 05:23:24.045077 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 05:23:24.045077 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 05:23:24.045077 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 05:23:24.045077 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 05:23:24.045077 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application May 10 05:23:24.045077 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 530/1043] 10.222.0.23 () {56 vars in 1111 bytes} [Tue May 10 05:23:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 05:23:24.050532 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6f821e-bc7c-428c-b30a-1cfe9efdc77c None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:23:24.151165 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6f821e-bc7c-428c-b30a-1cfe9efdc77c None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:23:24.184320 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ad0a95-9d83-4849-9de3-5bba22a26733 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:23:24.184993 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ad0a95-9d83-4849-9de3-5bba22a26733 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:23:24.185278 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ad0a95-9d83-4849-9de3-5bba22a26733 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:23:24.185549 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ad0a95-9d83-4849-9de3-5bba22a26733 None admin] PATH_INFO: `/v3/projects` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:23:24.186344 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ad0a95-9d83-4849-9de3-5bba22a26733 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:23:24.186649 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ad0a95-9d83-4849-9de3-5bba22a26733 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:23:24.188116 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ad0a95-9d83-4849-9de3-5bba22a26733 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:23:24.200508 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 514/1044] 10.222.0.23 () {56 vars in 1148 bytes} [Tue May 10 05:23:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:23:24.206358 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794b5e4a-19d7-4f6e-a9a7-392d034c3ad4 None admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:23:24.302864 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794b5e4a-19d7-4f6e-a9a7-392d034c3ad4 None admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:23:24.335470 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a3ec3b-7fa9-47bb-bd3e-f2929b46e5d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:23:24.336176 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a3ec3b-7fa9-47bb-bd3e-f2929b46e5d1 None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:23:24.336449 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a3ec3b-7fa9-47bb-bd3e-f2929b46e5d1 None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:23:24.336723 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a3ec3b-7fa9-47bb-bd3e-f2929b46e5d1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:23:24.337564 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a3ec3b-7fa9-47bb-bd3e-f2929b46e5d1 None admin] RBAC: Adding query filter params (role.id=635210106d69457ba45e9fa6dd0b9754, scope.project.id=5f23435f783540199d6dcfd0417c090e, user.id=7f50f224ca944983aecfde86375473da) {{(pid=79879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:23:24.337873 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a3ec3b-7fa9-47bb-bd3e-f2929b46e5d1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:23:24.339363 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a3ec3b-7fa9-47bb-bd3e-f2929b46e5d1 None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:23:24.345298 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 531/1045] 10.222.0.23 () {56 vars in 1374 bytes} [Tue May 10 05:23:24 2022] GET /identity/v3/role_assignments?user.id=7f50f224ca944983aecfde86375473da&scope.project.id=5f23435f783540199d6dcfd0417c090e&role.id=635210106d69457ba45e9fa6dd0b9754 => generated 259 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:23:25.703462 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e92423e-d6d6-4849-a213-d5ac5b807fb9 None None] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:23:25.704050 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e92423e-d6d6-4849-a213-d5ac5b807fb9 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:23:25.704050 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e92423e-d6d6-4849-a213-d5ac5b807fb9 None None] PATH_INFO: `/` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:23:25.705576 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 515/1046] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 10 05:23:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 05:23:25.710687 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4ce53a-7c4e-4d82-8f21-e7e4ed18db4c None None] REQUEST_METHOD: `POST` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:23:25.711132 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4ce53a-7c4e-4d82-8f21-e7e4ed18db4c None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:23:25.711213 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4ce53a-7c4e-4d82-8f21-e7e4ed18db4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:23:25.728166 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.auth.core [None req-bd4ce53a-7c4e-4d82-8f21-e7e4ed18db4c None None] MFA Rules not processed for user `44883b22532e44049d846938dc2cf423`. Rule list: `[]` (Enabled: `True`). {{(pid=79879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:23:25.729263 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-bd4ce53a-7c4e-4d82-8f21-e7e4ed18db4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:23:25.796055 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 532/1047] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 10 05:23:25 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 10 05:23:25.818112 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e92423e-d6d6-4849-a213-d5ac5b807fb9 None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:23:25.921020 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e92423e-d6d6-4849-a213-d5ac5b807fb9 None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:23:25.957692 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e8f97c-45d0-4a38-a566-b1748e3062b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:23:25.958500 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e8f97c-45d0-4a38-a566-b1748e3062b4 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:23:25.958786 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e8f97c-45d0-4a38-a566-b1748e3062b4 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:23:25.959057 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e8f97c-45d0-4a38-a566-b1748e3062b4 None admin] PATH_INFO: `/v3/services/image` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:23:25.959753 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e8f97c-45d0-4a38-a566-b1748e3062b4 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:23:25.961123 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e8f97c-45d0-4a38-a566-b1748e3062b4 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:23:25.972514 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application [None req-14e8f97c-45d0-4a38-a566-b1748e3062b4 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 10 05:23:25.972514 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 05:23:25.972514 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 10 05:23:25.972514 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 10 05:23:25.972514 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 10 05:23:25.972514 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 10 05:23:25.972514 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 10 05:23:25.972514 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 05:23:25.972514 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 10 05:23:25.972514 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application May 10 05:23:25.972514 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 05:23:25.972514 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application May 10 05:23:25.972514 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 05:23:25.972514 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 05:23:25.972514 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 05:23:25.972514 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 05:23:25.972514 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 05:23:25.979006 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 05:23:25.979006 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 05:23:25.979006 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 05:23:25.979006 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 05:23:25.979006 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 05:23:25.979006 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 05:23:25.979006 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 10 05:23:25.979006 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_service(service_id) May 10 05:23:25.979006 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 10 05:23:25.979006 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 10 05:23:25.979006 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 05:23:25.979006 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 05:23:25.979006 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 05:23:25.979006 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 05:23:25.979006 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 05:23:25.979006 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.get_or_create( May 10 05:23:25.980151 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 05:23:25.980151 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application with Lock( May 10 05:23:25.980151 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 05:23:25.980151 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._enter() May 10 05:23:25.980151 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 05:23:25.980151 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 05:23:25.980151 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 05:23:25.980151 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.creator() May 10 05:23:25.980151 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 05:23:25.980151 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application created_value = creator( May 10 05:23:25.980151 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 10 05:23:25.980151 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 05:23:25.980151 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 10 05:23:25.980151 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application May 10 05:23:25.980151 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 516/1048] 10.222.0.23 () {56 vars in 1105 bytes} [Tue May 10 05:23:25 2022] GET /identity/v3/services/image => generated 86 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 05:23:25.980955 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4ce53a-7c4e-4d82-8f21-e7e4ed18db4c None None] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:23:26.078275 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4ce53a-7c4e-4d82-8f21-e7e4ed18db4c None None] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:23:26.095743 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed01f1db-14ab-413c-a3d8-584b7c7dcd00 None None] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:23:26.096041 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed01f1db-14ab-413c-a3d8-584b7c7dcd00 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:23:26.096293 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed01f1db-14ab-413c-a3d8-584b7c7dcd00 None None] PATH_INFO: `/` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:23:26.097826 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 517/1049] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 10 05:23:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 05:23:26.102749 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6a133a-1717-4c8b-8ec5-c3d0ec461be2 None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:23:26.103033 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6a133a-1717-4c8b-8ec5-c3d0ec461be2 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:23:26.103309 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6a133a-1717-4c8b-8ec5-c3d0ec461be2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:23:26.111161 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d1eb9e-a29a-4dd7-9065-2b53545a4b6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:23:26.111855 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d1eb9e-a29a-4dd7-9065-2b53545a4b6d None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:23:26.112133 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d1eb9e-a29a-4dd7-9065-2b53545a4b6d None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:23:26.112401 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d1eb9e-a29a-4dd7-9065-2b53545a4b6d None admin] PATH_INFO: `/v3/services` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:23:26.113175 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d1eb9e-a29a-4dd7-9065-2b53545a4b6d None admin] RBAC: Adding query filter params (name=image) {{(pid=79879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:23:26.113474 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d1eb9e-a29a-4dd7-9065-2b53545a4b6d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:23:26.114950 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d1eb9e-a29a-4dd7-9065-2b53545a4b6d None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:23:26.120124 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 533/1050] 10.222.0.23 () {56 vars in 1108 bytes} [Tue May 10 05:23:25 2022] GET /identity/v3/services?name=image => generated 122 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:23:26.121046 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-0d6a133a-1717-4c8b-8ec5-c3d0ec461be2 None None] MFA Rules not processed for user `44883b22532e44049d846938dc2cf423`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:23:26.122613 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-0d6a133a-1717-4c8b-8ec5-c3d0ec461be2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:23:26.125782 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d1eb9e-a29a-4dd7-9065-2b53545a4b6d None admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:23:26.189123 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 518/1051] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 10 05:23:26 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 05:23:26.212092 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6a133a-1717-4c8b-8ec5-c3d0ec461be2 None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:23:26.223796 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d1eb9e-a29a-4dd7-9065-2b53545a4b6d None admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:23:26.258087 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9b2c3f-02d7-44a4-b8df-e44e596050df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:23:26.258678 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9b2c3f-02d7-44a4-b8df-e44e596050df None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:23:26.258953 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9b2c3f-02d7-44a4-b8df-e44e596050df None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:23:26.259219 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9b2c3f-02d7-44a4-b8df-e44e596050df None admin] PATH_INFO: `/v3/services` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:23:26.259960 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9b2c3f-02d7-44a4-b8df-e44e596050df None admin] RBAC: Adding query filter params (type=image) {{(pid=79879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:23:26.260262 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9b2c3f-02d7-44a4-b8df-e44e596050df None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:23:26.261631 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9b2c3f-02d7-44a4-b8df-e44e596050df None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:23:26.266644 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 534/1052] 10.222.0.23 () {56 vars in 1108 bytes} [Tue May 10 05:23:26 2022] GET /identity/v3/services?type=image => generated 350 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 05:23:26.271923 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9b2c3f-02d7-44a4-b8df-e44e596050df None admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:23:26.311587 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6a133a-1717-4c8b-8ec5-c3d0ec461be2 None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:23:26.347898 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd79f34-32a6-44e9-b4b0-70122a3f3404 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:23:26.349096 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd79f34-32a6-44e9-b4b0-70122a3f3404 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:23:26.349378 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd79f34-32a6-44e9-b4b0-70122a3f3404 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:23:26.349652 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd79f34-32a6-44e9-b4b0-70122a3f3404 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:23:26.361802 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd79f34-32a6-44e9-b4b0-70122a3f3404 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 05:23:26.369533 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application [None req-7bd79f34-32a6-44e9-b4b0-70122a3f3404 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 10 05:23:26.369533 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 05:23:26.369533 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 05:23:26.369533 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 05:23:26.369533 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 05:23:26.369533 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 05:23:26.369533 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 05:23:26.369533 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 05:23:26.369533 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 05:23:26.369533 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 05:23:26.369533 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 05:23:26.369533 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 05:23:26.369533 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 05:23:26.369533 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 05:23:26.369533 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 05:23:26.369533 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 05:23:26.370471 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 05:23:26.370471 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 05:23:26.370471 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 05:23:26.370471 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 05:23:26.370471 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 05:23:26.370471 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 05:23:26.370471 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 05:23:26.370471 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 05:23:26.370471 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 05:23:26.370471 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.get_or_create( May 10 05:23:26.370471 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 05:23:26.370471 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application with Lock( May 10 05:23:26.370471 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 05:23:26.370471 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._enter() May 10 05:23:26.370471 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 05:23:26.370471 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 05:23:26.372392 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 05:23:26.372392 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.creator() May 10 05:23:26.372392 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 05:23:26.372392 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application created_value = creator( May 10 05:23:26.372392 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 05:23:26.372392 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 05:23:26.372392 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 05:23:26.372392 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 05:23:26.372392 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 05:23:26.372392 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 05:23:26.372392 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 10 05:23:26.372392 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application May 10 05:23:26.373462 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9b2c3f-02d7-44a4-b8df-e44e596050df None admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:23:26.376105 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 519/1053] 10.222.0.23 () {56 vars in 1096 bytes} [Tue May 10 05:23:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 05:23:26.377225 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd79f34-32a6-44e9-b4b0-70122a3f3404 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:23:26.405228 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4f194d-d52e-4b62-8188-d991a329aa43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:23:26.405923 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4f194d-d52e-4b62-8188-d991a329aa43 None admin] REQUEST_METHOD: `POST` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:23:26.406202 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4f194d-d52e-4b62-8188-d991a329aa43 None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:23:26.406469 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4f194d-d52e-4b62-8188-d991a329aa43 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:23:26.407210 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4f194d-d52e-4b62-8188-d991a329aa43 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:23:26.408622 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4f194d-d52e-4b62-8188-d991a329aa43 None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:23:26.430741 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 535/1054] 10.222.0.23 () {60 vars in 1144 bytes} [Tue May 10 05:23:26 2022] POST /identity/v3/endpoints => generated 327 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 05:23:26.495406 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd79f34-32a6-44e9-b4b0-70122a3f3404 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:23:26.523540 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6760254-2c6c-4bcc-8183-214afdb125c2 None None] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:23:26.523831 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6760254-2c6c-4bcc-8183-214afdb125c2 None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:23:26.524003 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6760254-2c6c-4bcc-8183-214afdb125c2 None None] PATH_INFO: `/` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:23:26.525414 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 536/1055] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 10 05:23:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 05:23:26.531905 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3234d169-40bd-477a-adb3-41a36f911416 None None] REQUEST_METHOD: `POST` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:23:26.532353 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3234d169-40bd-477a-adb3-41a36f911416 None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:23:26.532633 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3234d169-40bd-477a-adb3-41a36f911416 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:23:26.544596 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30dcdc7e-ed5e-4b08-9f1a-3cae53d96590 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:23:26.545263 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dcdc7e-ed5e-4b08-9f1a-3cae53d96590 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:23:26.545548 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dcdc7e-ed5e-4b08-9f1a-3cae53d96590 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:23:26.545820 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dcdc7e-ed5e-4b08-9f1a-3cae53d96590 None admin] PATH_INFO: `/v3/roles` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:23:26.546639 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30dcdc7e-ed5e-4b08-9f1a-3cae53d96590 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:23:26.546939 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30dcdc7e-ed5e-4b08-9f1a-3cae53d96590 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:23:26.548385 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30dcdc7e-ed5e-4b08-9f1a-3cae53d96590 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:23:26.551001 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.auth.core [None req-3234d169-40bd-477a-adb3-41a36f911416 None None] MFA Rules not processed for user `44883b22532e44049d846938dc2cf423`. Rule list: `[]` (Enabled: `True`). {{(pid=79879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:23:26.552249 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-3234d169-40bd-477a-adb3-41a36f911416 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:23:26.558752 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 520/1056] 10.222.0.23 () {56 vars in 1099 bytes} [Tue May 10 05:23:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 05:23:26.564927 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30dcdc7e-ed5e-4b08-9f1a-3cae53d96590 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:23:26.627623 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 537/1057] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 10 05:23:26 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 05:23:26.648404 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3234d169-40bd-477a-adb3-41a36f911416 None None] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:23:26.681865 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30dcdc7e-ed5e-4b08-9f1a-3cae53d96590 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:23:26.715277 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c66949-3629-4cd8-b1ed-31b614ba2d23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:23:26.716230 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c66949-3629-4cd8-b1ed-31b614ba2d23 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:23:26.716514 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c66949-3629-4cd8-b1ed-31b614ba2d23 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:23:26.716785 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c66949-3629-4cd8-b1ed-31b614ba2d23 None admin] PATH_INFO: `/v3/users/34906ac74ede48dab53bbcbdb638323e` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:23:26.730184 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c66949-3629-4cd8-b1ed-31b614ba2d23 None admin] RBAC: Authorizing `identity:get_user(user_id=34906ac74ede48dab53bbcbdb638323e)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:23:26.731655 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c66949-3629-4cd8-b1ed-31b614ba2d23 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:23:26.733388 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 521/1058] 10.222.0.23 () {56 vars in 1177 bytes} [Tue May 10 05:23:26 2022] GET /identity/v3/users/34906ac74ede48dab53bbcbdb638323e => generated 285 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 05:23:26.739032 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c66949-3629-4cd8-b1ed-31b614ba2d23 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:23:26.745648 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3234d169-40bd-477a-adb3-41a36f911416 None None] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:23:26.780113 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e952a1-e2d3-43af-8129-b6cf4f2c11dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:23:26.780852 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e952a1-e2d3-43af-8129-b6cf4f2c11dc None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:23:26.781132 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e952a1-e2d3-43af-8129-b6cf4f2c11dc None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:23:26.781404 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e952a1-e2d3-43af-8129-b6cf4f2c11dc None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:23:26.791430 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e952a1-e2d3-43af-8129-b6cf4f2c11dc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 05:23:26.799519 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application [None req-99e952a1-e2d3-43af-8129-b6cf4f2c11dc None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 10 05:23:26.799519 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 05:23:26.799519 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 05:23:26.799519 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 05:23:26.799519 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 05:23:26.799519 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 05:23:26.799519 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 05:23:26.799519 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 05:23:26.799519 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 05:23:26.799519 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 05:23:26.799519 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 05:23:26.799519 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 05:23:26.799519 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 05:23:26.799519 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 05:23:26.799519 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 05:23:26.799519 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 05:23:26.800700 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 05:23:26.800700 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 05:23:26.800700 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 05:23:26.800700 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 05:23:26.800700 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 05:23:26.800700 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 05:23:26.800700 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 05:23:26.800700 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 05:23:26.800700 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 05:23:26.800700 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.get_or_create( May 10 05:23:26.800700 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 05:23:26.800700 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application with Lock( May 10 05:23:26.800700 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 05:23:26.800700 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self._enter() May 10 05:23:26.800700 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 05:23:26.800700 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 05:23:26.801718 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 05:23:26.801718 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.creator() May 10 05:23:26.801718 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 05:23:26.801718 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application created_value = creator( May 10 05:23:26.801718 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 05:23:26.801718 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 05:23:26.801718 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 05:23:26.801718 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 05:23:26.801718 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 05:23:26.801718 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 05:23:26.801718 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 10 05:23:26.801718 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application May 10 05:23:26.805704 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 538/1059] 10.222.0.23 () {56 vars in 1120 bytes} [Tue May 10 05:23:26 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 05:23:26.806584 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e952a1-e2d3-43af-8129-b6cf4f2c11dc None admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:23:26.839634 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c66949-3629-4cd8-b1ed-31b614ba2d23 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:23:26.873358 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd45652b-5b80-4b4e-9b4c-dc2e4089742b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:23:26.874116 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd45652b-5b80-4b4e-9b4c-dc2e4089742b None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:23:26.874401 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd45652b-5b80-4b4e-9b4c-dc2e4089742b None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:23:26.874678 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd45652b-5b80-4b4e-9b4c-dc2e4089742b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:23:26.904455 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e952a1-e2d3-43af-8129-b6cf4f2c11dc None admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:23:26.938138 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0703e7-b9b1-42d7-ab7b-a05ab56f3ba3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:23:26.938812 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0703e7-b9b1-42d7-ab7b-a05ab56f3ba3 None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:23:26.939092 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0703e7-b9b1-42d7-ab7b-a05ab56f3ba3 None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:23:26.939367 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0703e7-b9b1-42d7-ab7b-a05ab56f3ba3 None admin] PATH_INFO: `/v3/roles` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:23:26.939767 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd45652b-5b80-4b4e-9b4c-dc2e4089742b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:23:26.940161 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0703e7-b9b1-42d7-ab7b-a05ab56f3ba3 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:23:26.940464 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0703e7-b9b1-42d7-ab7b-a05ab56f3ba3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:23:26.941314 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd45652b-5b80-4b4e-9b4c-dc2e4089742b None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:23:26.941820 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0703e7-b9b1-42d7-ab7b-a05ab56f3ba3 None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:23:26.954953 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 539/1060] 10.222.0.23 () {56 vars in 1115 bytes} [Tue May 10 05:23:26 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 05:23:26.956197 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0703e7-b9b1-42d7-ab7b-a05ab56f3ba3 None admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:23:27.035552 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 522/1061] 10.222.0.23 () {58 vars in 1282 bytes} [Tue May 10 05:23:26 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 10 05:23:27.041112 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd45652b-5b80-4b4e-9b4c-dc2e4089742b None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:23:27.052827 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0703e7-b9b1-42d7-ab7b-a05ab56f3ba3 None admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:23:27.084999 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb6e961-0c17-4fc5-a441-20849b9e69f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:23:27.085815 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb6e961-0c17-4fc5-a441-20849b9e69f3 None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:23:27.086109 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb6e961-0c17-4fc5-a441-20849b9e69f3 None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:23:27.086383 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb6e961-0c17-4fc5-a441-20849b9e69f3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:23:27.096533 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb6e961-0c17-4fc5-a441-20849b9e69f3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:23:27.098047 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb6e961-0c17-4fc5-a441-20849b9e69f3 None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:23:27.114457 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application [None req-bbb6e961-0c17-4fc5-a441-20849b9e69f3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 05:23:27.114457 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 05:23:27.114457 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 05:23:27.114457 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 05:23:27.114457 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 05:23:27.114457 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 05:23:27.114457 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 05:23:27.114457 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 05:23:27.114457 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 05:23:27.114457 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 05:23:27.114457 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 05:23:27.114457 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 05:23:27.114457 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 05:23:27.114457 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 05:23:27.114457 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 05:23:27.115364 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 05:23:27.115364 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 05:23:27.115364 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 05:23:27.115364 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 05:23:27.115364 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 05:23:27.115364 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 05:23:27.115364 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.get_or_create( May 10 05:23:27.115364 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 05:23:27.115364 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application with Lock( May 10 05:23:27.115364 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 05:23:27.115364 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self._enter() May 10 05:23:27.115364 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 05:23:27.115364 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 05:23:27.115364 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 05:23:27.115364 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.creator() May 10 05:23:27.115364 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 05:23:27.115364 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application created_value = creator( May 10 05:23:27.116897 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 05:23:27.116897 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 05:23:27.116897 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 05:23:27.116897 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application May 10 05:23:27.116897 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 540/1062] 10.222.0.23 () {56 vars in 1108 bytes} [Tue May 10 05:23:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 05:23:27.121621 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb6e961-0c17-4fc5-a441-20849b9e69f3 None admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:23:27.139557 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd45652b-5b80-4b4e-9b4c-dc2e4089742b None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:23:27.174804 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b1cec6-c73e-4936-8110-bd01fabcdfd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:23:27.176478 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b1cec6-c73e-4936-8110-bd01fabcdfd7 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:23:27.177255 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b1cec6-c73e-4936-8110-bd01fabcdfd7 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:23:27.177750 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b1cec6-c73e-4936-8110-bd01fabcdfd7 None admin] PATH_INFO: `/v3/projects/25e42b3173f74f64aa4d552d2d8e558c` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:23:27.179921 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b1cec6-c73e-4936-8110-bd01fabcdfd7 None admin] RBAC: Authorizing `identity:get_project(project_id=25e42b3173f74f64aa4d552d2d8e558c)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:23:27.182172 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b1cec6-c73e-4936-8110-bd01fabcdfd7 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:23:27.185797 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 523/1063] 10.222.0.23 () {56 vars in 1186 bytes} [Tue May 10 05:23:27 2022] GET /identity/v3/projects/25e42b3173f74f64aa4d552d2d8e558c => generated 311 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 05:23:27.190633 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b1cec6-c73e-4936-8110-bd01fabcdfd7 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:23:27.225541 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb6e961-0c17-4fc5-a441-20849b9e69f3 None admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:23:27.260074 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680c85af-50fe-47c6-9170-9704f0f751dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:23:27.260744 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680c85af-50fe-47c6-9170-9704f0f751dc None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:23:27.261022 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680c85af-50fe-47c6-9170-9704f0f751dc None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:23:27.261294 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680c85af-50fe-47c6-9170-9704f0f751dc None admin] PATH_INFO: `/v3/domains` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:23:27.262438 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680c85af-50fe-47c6-9170-9704f0f751dc None admin] RBAC: Adding query filter params (name=Default) {{(pid=79879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:23:27.262799 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680c85af-50fe-47c6-9170-9704f0f751dc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:23:27.264582 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680c85af-50fe-47c6-9170-9704f0f751dc None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:23:27.278100 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 541/1064] 10.222.0.23 () {56 vars in 1109 bytes} [Tue May 10 05:23:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 05:23:27.283848 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680c85af-50fe-47c6-9170-9704f0f751dc None admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:23:27.285719 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b1cec6-c73e-4936-8110-bd01fabcdfd7 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:23:27.317493 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e542cbb-fe97-4572-899b-529951308e43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:23:27.318148 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e542cbb-fe97-4572-899b-529951308e43 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:23:27.318425 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e542cbb-fe97-4572-899b-529951308e43 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:23:27.318704 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e542cbb-fe97-4572-899b-529951308e43 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:23:27.319542 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e542cbb-fe97-4572-899b-529951308e43 None admin] RBAC: Adding query filter params (role.id=199ac1dd842441d7913c6ee89d8fbecc, scope.project.id=25e42b3173f74f64aa4d552d2d8e558c, user.id=34906ac74ede48dab53bbcbdb638323e) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:23:27.319876 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e542cbb-fe97-4572-899b-529951308e43 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:23:27.321300 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e542cbb-fe97-4572-899b-529951308e43 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:23:27.331680 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 524/1065] 10.222.0.23 () {56 vars in 1374 bytes} [Tue May 10 05:23:27 2022] GET /identity/v3/role_assignments?user.id=34906ac74ede48dab53bbcbdb638323e&scope.project.id=25e42b3173f74f64aa4d552d2d8e558c&role.id=199ac1dd842441d7913c6ee89d8fbecc => generated 259 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:23:27.386232 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680c85af-50fe-47c6-9170-9704f0f751dc None admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:23:27.423378 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ca7607-3530-4950-b103-5571c2271fc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:23:27.424237 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ca7607-3530-4950-b103-5571c2271fc5 None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:23:27.424517 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ca7607-3530-4950-b103-5571c2271fc5 None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:23:27.424793 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ca7607-3530-4950-b103-5571c2271fc5 None admin] PATH_INFO: `/v3/users/nova` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:23:27.433490 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ca7607-3530-4950-b103-5571c2271fc5 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:23:27.434982 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ca7607-3530-4950-b103-5571c2271fc5 None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:23:27.450453 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application [None req-b1ca7607-3530-4950-b103-5571c2271fc5 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 10 05:23:27.450453 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 05:23:27.450453 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 05:23:27.450453 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 05:23:27.450453 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 05:23:27.450453 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 05:23:27.450453 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 05:23:27.450453 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 05:23:27.450453 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 05:23:27.450453 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 05:23:27.450453 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 05:23:27.450453 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 05:23:27.450453 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 05:23:27.450453 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 05:23:27.450453 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 05:23:27.450453 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 05:23:27.451654 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 05:23:27.451654 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 05:23:27.451654 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 05:23:27.451654 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 05:23:27.451654 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 05:23:27.451654 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 05:23:27.451654 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 05:23:27.451654 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 05:23:27.451654 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 05:23:27.451654 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.get_or_create( May 10 05:23:27.451654 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 05:23:27.451654 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application with Lock( May 10 05:23:27.451654 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 05:23:27.451654 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self._enter() May 10 05:23:27.451654 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 05:23:27.451654 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 05:23:27.451654 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 05:23:27.451654 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.creator() May 10 05:23:27.452624 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 05:23:27.452624 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application created_value = creator( May 10 05:23:27.452624 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 05:23:27.452624 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 05:23:27.452624 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 05:23:27.452624 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 05:23:27.452624 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 05:23:27.452624 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 05:23:27.452624 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 10 05:23:27.452624 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application May 10 05:23:27.452624 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 542/1066] 10.222.0.23 () {56 vars in 1093 bytes} [Tue May 10 05:23:27 2022] GET /identity/v3/users/nova => generated 82 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 05:23:27.461659 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e542cbb-fe97-4572-899b-529951308e43 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:23:27.575948 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e542cbb-fe97-4572-899b-529951308e43 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:23:27.609600 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c6fb86-ffe1-44f3-a1d0-de0ce679ef98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:23:27.610287 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c6fb86-ffe1-44f3-a1d0-de0ce679ef98 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:23:27.610556 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c6fb86-ffe1-44f3-a1d0-de0ce679ef98 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:23:27.610827 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c6fb86-ffe1-44f3-a1d0-de0ce679ef98 None admin] PATH_INFO: `/v3/users` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:23:27.611706 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c6fb86-ffe1-44f3-a1d0-de0ce679ef98 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:23:27.612014 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c6fb86-ffe1-44f3-a1d0-de0ce679ef98 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:23:27.613519 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c6fb86-ffe1-44f3-a1d0-de0ce679ef98 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:23:27.635560 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 525/1067] 10.222.0.23 () {56 vars in 1133 bytes} [Tue May 10 05:23:27 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:23:27.636834 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ca7607-3530-4950-b103-5571c2271fc5 None admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:23:27.734051 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ca7607-3530-4950-b103-5571c2271fc5 None admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:23:27.768419 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a855b4b7-079e-47ac-aebf-8b795b71510f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:23:27.769245 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a855b4b7-079e-47ac-aebf-8b795b71510f None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:23:27.769521 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a855b4b7-079e-47ac-aebf-8b795b71510f None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:23:27.769792 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a855b4b7-079e-47ac-aebf-8b795b71510f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:23:27.779676 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a855b4b7-079e-47ac-aebf-8b795b71510f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:23:27.781128 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a855b4b7-079e-47ac-aebf-8b795b71510f None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:23:27.799048 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application [None req-a855b4b7-079e-47ac-aebf-8b795b71510f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 05:23:27.799048 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 05:23:27.799048 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 05:23:27.799048 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 05:23:27.799048 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 05:23:27.799048 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 05:23:27.799048 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 05:23:27.799048 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 05:23:27.799048 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 05:23:27.799048 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 05:23:27.799048 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 05:23:27.799048 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 05:23:27.799048 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 05:23:27.799048 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 05:23:27.799048 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 05:23:27.800213 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 05:23:27.800213 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 05:23:27.800213 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 05:23:27.800213 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 05:23:27.800213 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 05:23:27.800213 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 05:23:27.800213 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.get_or_create( May 10 05:23:27.800213 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 05:23:27.800213 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application with Lock( May 10 05:23:27.800213 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 05:23:27.800213 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self._enter() May 10 05:23:27.800213 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 05:23:27.800213 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 05:23:27.800213 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 05:23:27.800213 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.creator() May 10 05:23:27.800213 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 05:23:27.800213 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application created_value = creator( May 10 05:23:27.801604 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 05:23:27.801604 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 05:23:27.801604 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 05:23:27.801604 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application May 10 05:23:27.801604 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 543/1068] 10.222.0.23 () {56 vars in 1108 bytes} [Tue May 10 05:23:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 05:23:27.806046 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c6fb86-ffe1-44f3-a1d0-de0ce679ef98 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:23:27.900362 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c6fb86-ffe1-44f3-a1d0-de0ce679ef98 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:23:27.937359 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26de8902-904f-4a2e-bd16-1b15d3adaa78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:23:27.938313 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26de8902-904f-4a2e-bd16-1b15d3adaa78 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:23:27.938599 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26de8902-904f-4a2e-bd16-1b15d3adaa78 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:23:27.938872 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26de8902-904f-4a2e-bd16-1b15d3adaa78 None admin] PATH_INFO: `/v3/domains` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:23:27.939615 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26de8902-904f-4a2e-bd16-1b15d3adaa78 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:23:27.939951 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26de8902-904f-4a2e-bd16-1b15d3adaa78 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:23:27.941415 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26de8902-904f-4a2e-bd16-1b15d3adaa78 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:23:27.952836 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 526/1069] 10.222.0.23 () {56 vars in 1109 bytes} [Tue May 10 05:23:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:23:27.958373 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a855b4b7-079e-47ac-aebf-8b795b71510f None admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:23:28.057168 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a855b4b7-079e-47ac-aebf-8b795b71510f None admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:23:28.091160 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee8a903-7476-4920-9904-f8d342858c50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:23:28.091984 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee8a903-7476-4920-9904-f8d342858c50 None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:23:28.092263 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee8a903-7476-4920-9904-f8d342858c50 None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:23:28.092534 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee8a903-7476-4920-9904-f8d342858c50 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:23:28.099264 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee8a903-7476-4920-9904-f8d342858c50 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:23:28.100746 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee8a903-7476-4920-9904-f8d342858c50 None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:23:28.114227 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application [None req-eee8a903-7476-4920-9904-f8d342858c50 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 05:23:28.114227 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 05:23:28.114227 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 05:23:28.114227 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 05:23:28.114227 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 05:23:28.114227 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 05:23:28.114227 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 05:23:28.114227 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 05:23:28.114227 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 05:23:28.114227 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 05:23:28.114227 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 05:23:28.114227 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 05:23:28.114227 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 05:23:28.114227 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 05:23:28.114227 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 05:23:28.115130 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 05:23:28.115130 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 05:23:28.115130 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 05:23:28.115130 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 05:23:28.115130 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 05:23:28.115130 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 05:23:28.115130 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.get_or_create( May 10 05:23:28.115130 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 05:23:28.115130 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application with Lock( May 10 05:23:28.115130 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 05:23:28.115130 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self._enter() May 10 05:23:28.115130 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 05:23:28.115130 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 05:23:28.115130 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 05:23:28.115130 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.creator() May 10 05:23:28.115130 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 05:23:28.115130 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application created_value = creator( May 10 05:23:28.116080 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 05:23:28.116080 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 05:23:28.116080 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 05:23:28.116080 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 05:23:28.116080 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 05:23:28.116080 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 05:23:28.116080 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 05:23:28.116080 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application May 10 05:23:28.117124 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 544/1070] 10.222.0.23 () {56 vars in 1111 bytes} [Tue May 10 05:23:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 05:23:28.122038 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26de8902-904f-4a2e-bd16-1b15d3adaa78 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:23:28.219230 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26de8902-904f-4a2e-bd16-1b15d3adaa78 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:23:28.253179 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbbb663-da4b-43d6-864d-872f2d32103c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:23:28.254105 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbbb663-da4b-43d6-864d-872f2d32103c None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:23:28.254541 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbbb663-da4b-43d6-864d-872f2d32103c None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:23:28.254950 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbbb663-da4b-43d6-864d-872f2d32103c None admin] PATH_INFO: `/v3/projects` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:23:28.256138 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcbbb663-da4b-43d6-864d-872f2d32103c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:23:28.256594 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcbbb663-da4b-43d6-864d-872f2d32103c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:23:28.258203 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcbbb663-da4b-43d6-864d-872f2d32103c None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:23:28.270854 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 527/1071] 10.222.0.23 () {56 vars in 1148 bytes} [Tue May 10 05:23:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:23:28.276610 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee8a903-7476-4920-9904-f8d342858c50 None admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:23:28.375318 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee8a903-7476-4920-9904-f8d342858c50 None admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:23:28.410068 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61c85bb-bf71-4112-998d-f37a9c530967 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:23:28.410955 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61c85bb-bf71-4112-998d-f37a9c530967 None admin] REQUEST_METHOD: `PUT` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:23:28.411222 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61c85bb-bf71-4112-998d-f37a9c530967 None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:23:28.411493 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61c85bb-bf71-4112-998d-f37a9c530967 None admin] PATH_INFO: `/v3/projects/5f23435f783540199d6dcfd0417c090e/users/7f50f224ca944983aecfde86375473da/roles/635210106d69457ba45e9fa6dd0b9754` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:23:28.413762 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61c85bb-bf71-4112-998d-f37a9c530967 None admin] RBAC: Authorizing `identity:create_grant(project_id=5f23435f783540199d6dcfd0417c090e, user_id=7f50f224ca944983aecfde86375473da, role_id=635210106d69457ba45e9fa6dd0b9754)` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:23:28.415221 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61c85bb-bf71-4112-998d-f37a9c530967 None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:23:28.430809 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 545/1072] 10.222.0.23 () {58 vars in 1439 bytes} [Tue May 10 05:23:28 2022] PUT /identity/v3/projects/5f23435f783540199d6dcfd0417c090e/users/7f50f224ca944983aecfde86375473da/roles/635210106d69457ba45e9fa6dd0b9754 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 05:23:28.668335 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f43346-0d3d-454c-8bdb-f9c7b91dddde None None] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:23:28.668669 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f43346-0d3d-454c-8bdb-f9c7b91dddde None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:23:28.668902 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f43346-0d3d-454c-8bdb-f9c7b91dddde None None] PATH_INFO: `/` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:23:28.670346 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 528/1073] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 10 05:23:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 05:23:28.675875 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388216f9-a694-421a-b299-84aac08b7d0e None None] REQUEST_METHOD: `POST` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:23:28.676256 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388216f9-a694-421a-b299-84aac08b7d0e None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:23:28.676606 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388216f9-a694-421a-b299-84aac08b7d0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:23:28.693979 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.auth.core [None req-388216f9-a694-421a-b299-84aac08b7d0e None None] MFA Rules not processed for user `44883b22532e44049d846938dc2cf423`. Rule list: `[]` (Enabled: `True`). {{(pid=79879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:23:28.695175 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-388216f9-a694-421a-b299-84aac08b7d0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:23:28.762167 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 546/1074] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 10 05:23:28 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 05:23:28.784192 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f43346-0d3d-454c-8bdb-f9c7b91dddde None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:23:28.886839 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f43346-0d3d-454c-8bdb-f9c7b91dddde None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:23:28.921110 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a474bb0e-b8cf-4b56-9c68-c1849875d478 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:23:28.921774 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a474bb0e-b8cf-4b56-9c68-c1849875d478 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:23:28.922056 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a474bb0e-b8cf-4b56-9c68-c1849875d478 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:23:28.922330 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a474bb0e-b8cf-4b56-9c68-c1849875d478 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:23:28.988129 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a474bb0e-b8cf-4b56-9c68-c1849875d478 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:23:28.989665 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a474bb0e-b8cf-4b56-9c68-c1849875d478 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:23:29.084232 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 529/1075] 10.222.0.23 () {58 vars in 1282 bytes} [Tue May 10 05:23:28 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 10 05:23:29.090213 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388216f9-a694-421a-b299-84aac08b7d0e None None] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:23:29.189464 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388216f9-a694-421a-b299-84aac08b7d0e None None] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:23:29.224096 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf869aa-8845-460f-b378-6f3702ef6b92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:23:29.224902 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf869aa-8845-460f-b378-6f3702ef6b92 None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:23:29.225189 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf869aa-8845-460f-b378-6f3702ef6b92 None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:23:29.225465 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf869aa-8845-460f-b378-6f3702ef6b92 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:23:29.235425 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf869aa-8845-460f-b378-6f3702ef6b92 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:23:29.236914 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf869aa-8845-460f-b378-6f3702ef6b92 None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:23:29.254915 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application [None req-cbf869aa-8845-460f-b378-6f3702ef6b92 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 05:23:29.254915 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 05:23:29.254915 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 05:23:29.254915 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 05:23:29.254915 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 05:23:29.254915 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 05:23:29.254915 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 05:23:29.254915 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 05:23:29.254915 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 05:23:29.254915 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 05:23:29.254915 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 05:23:29.254915 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 05:23:29.254915 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 05:23:29.254915 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 05:23:29.254915 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 05:23:29.255945 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 05:23:29.255945 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 05:23:29.255945 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 05:23:29.255945 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 05:23:29.255945 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 05:23:29.255945 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 05:23:29.255945 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.get_or_create( May 10 05:23:29.255945 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 05:23:29.255945 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application with Lock( May 10 05:23:29.255945 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 05:23:29.255945 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self._enter() May 10 05:23:29.255945 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 05:23:29.255945 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 05:23:29.255945 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 05:23:29.255945 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.creator() May 10 05:23:29.255945 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 05:23:29.255945 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application created_value = creator( May 10 05:23:29.256841 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 05:23:29.256841 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 05:23:29.256841 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 05:23:29.256841 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application May 10 05:23:29.259950 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 547/1076] 10.222.0.23 () {56 vars in 1108 bytes} [Tue May 10 05:23:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 05:23:29.262458 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a474bb0e-b8cf-4b56-9c68-c1849875d478 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:23:29.362609 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a474bb0e-b8cf-4b56-9c68-c1849875d478 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:23:29.399354 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a344eaac-47db-44fd-bb45-d9a8cc9e732c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:23:29.400061 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a344eaac-47db-44fd-bb45-d9a8cc9e732c None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:23:29.400344 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a344eaac-47db-44fd-bb45-d9a8cc9e732c None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:23:29.400619 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a344eaac-47db-44fd-bb45-d9a8cc9e732c None admin] PATH_INFO: `/v3/domains` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:23:29.401353 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a344eaac-47db-44fd-bb45-d9a8cc9e732c None admin] RBAC: Adding query filter params (name=Default) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:23:29.401659 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a344eaac-47db-44fd-bb45-d9a8cc9e732c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:23:29.403042 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a344eaac-47db-44fd-bb45-d9a8cc9e732c None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:23:29.414642 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 530/1077] 10.222.0.23 () {56 vars in 1109 bytes} [Tue May 10 05:23:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:23:29.540809 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d23b7c3-4972-431c-83f3-df2f9ec32005 None None] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:23:29.541106 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d23b7c3-4972-431c-83f3-df2f9ec32005 None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:23:29.541554 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d23b7c3-4972-431c-83f3-df2f9ec32005 None None] PATH_INFO: `/` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:23:29.543337 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 548/1078] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 10 05:23:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 05:23:29.549381 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fc8ab0-1a52-4260-9b68-88142c9b0174 None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:23:29.549676 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fc8ab0-1a52-4260-9b68-88142c9b0174 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:23:29.549935 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fc8ab0-1a52-4260-9b68-88142c9b0174 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:23:29.568417 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-c3fc8ab0-1a52-4260-9b68-88142c9b0174 None None] MFA Rules not processed for user `44883b22532e44049d846938dc2cf423`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:23:29.569627 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-c3fc8ab0-1a52-4260-9b68-88142c9b0174 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:23:29.639127 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 531/1079] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 10 05:23:29 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 05:23:29.661144 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d23b7c3-4972-431c-83f3-df2f9ec32005 None None] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:23:29.758756 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d23b7c3-4972-431c-83f3-df2f9ec32005 None None] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:23:29.790119 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e605d6e2-bda2-462b-8770-4806f2f08fa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:23:29.790913 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e605d6e2-bda2-462b-8770-4806f2f08fa3 None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:23:29.791183 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e605d6e2-bda2-462b-8770-4806f2f08fa3 None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:23:29.791452 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e605d6e2-bda2-462b-8770-4806f2f08fa3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:23:29.801278 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e605d6e2-bda2-462b-8770-4806f2f08fa3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 05:23:29.808803 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application [None req-e605d6e2-bda2-462b-8770-4806f2f08fa3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 10 05:23:29.808803 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 05:23:29.808803 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 05:23:29.808803 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 05:23:29.808803 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 05:23:29.808803 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 05:23:29.808803 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 05:23:29.808803 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 05:23:29.808803 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 05:23:29.808803 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 05:23:29.808803 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 05:23:29.808803 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 05:23:29.808803 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 05:23:29.808803 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 05:23:29.808803 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 05:23:29.808803 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 05:23:29.809807 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 05:23:29.809807 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 05:23:29.809807 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 05:23:29.809807 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 05:23:29.809807 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 05:23:29.809807 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 05:23:29.809807 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 05:23:29.809807 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 05:23:29.809807 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 05:23:29.809807 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.get_or_create( May 10 05:23:29.809807 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 05:23:29.809807 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application with Lock( May 10 05:23:29.809807 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 05:23:29.809807 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self._enter() May 10 05:23:29.809807 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 05:23:29.809807 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 05:23:29.810864 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 05:23:29.810864 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.creator() May 10 05:23:29.810864 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 05:23:29.810864 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application created_value = creator( May 10 05:23:29.810864 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 05:23:29.810864 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 05:23:29.810864 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 05:23:29.810864 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 05:23:29.810864 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 05:23:29.810864 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 05:23:29.810864 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 10 05:23:29.810864 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application May 10 05:23:29.810864 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 549/1080] 10.222.0.23 () {56 vars in 1096 bytes} [Tue May 10 05:23:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 05:23:29.816175 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fc8ab0-1a52-4260-9b68-88142c9b0174 None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:23:29.917551 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fc8ab0-1a52-4260-9b68-88142c9b0174 None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:23:29.954338 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90af3fe0-7268-4858-8cbe-9021fc3de4ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:23:29.955000 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90af3fe0-7268-4858-8cbe-9021fc3de4ee None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:23:29.955277 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90af3fe0-7268-4858-8cbe-9021fc3de4ee None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:23:29.955548 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90af3fe0-7268-4858-8cbe-9021fc3de4ee None admin] PATH_INFO: `/v3/roles` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:23:29.956326 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90af3fe0-7268-4858-8cbe-9021fc3de4ee None admin] RBAC: Adding query filter params (name=admin) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:23:29.956711 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90af3fe0-7268-4858-8cbe-9021fc3de4ee None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:23:29.958071 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90af3fe0-7268-4858-8cbe-9021fc3de4ee None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:23:29.966158 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 532/1081] 10.222.0.23 () {56 vars in 1099 bytes} [Tue May 10 05:23:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:23:29.972026 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e605d6e2-bda2-462b-8770-4806f2f08fa3 None admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:23:30.070913 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e605d6e2-bda2-462b-8770-4806f2f08fa3 None admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:23:30.105241 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cccf7cb-be34-41b6-b715-55da99606bfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:23:30.106125 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cccf7cb-be34-41b6-b715-55da99606bfc None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:23:30.106394 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cccf7cb-be34-41b6-b715-55da99606bfc None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:23:30.106668 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cccf7cb-be34-41b6-b715-55da99606bfc None admin] PATH_INFO: `/v3/users/34906ac74ede48dab53bbcbdb638323e` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:23:30.107984 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cccf7cb-be34-41b6-b715-55da99606bfc None admin] RBAC: Authorizing `identity:get_user(user_id=34906ac74ede48dab53bbcbdb638323e)` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:23:30.109432 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cccf7cb-be34-41b6-b715-55da99606bfc None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:23:30.111077 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 550/1082] 10.222.0.23 () {56 vars in 1177 bytes} [Tue May 10 05:23:29 2022] GET /identity/v3/users/34906ac74ede48dab53bbcbdb638323e => generated 285 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 05:23:30.117111 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90af3fe0-7268-4858-8cbe-9021fc3de4ee None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:23:30.219335 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90af3fe0-7268-4858-8cbe-9021fc3de4ee None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:23:30.251721 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a7d567-e7c5-4420-8c4c-d3f12755956d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:23:30.252589 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a7d567-e7c5-4420-8c4c-d3f12755956d None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:23:30.252866 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a7d567-e7c5-4420-8c4c-d3f12755956d None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:23:30.253137 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a7d567-e7c5-4420-8c4c-d3f12755956d None admin] PATH_INFO: `/v3/projects/25e42b3173f74f64aa4d552d2d8e558c` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:23:30.254475 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a7d567-e7c5-4420-8c4c-d3f12755956d None admin] RBAC: Authorizing `identity:get_project(project_id=25e42b3173f74f64aa4d552d2d8e558c)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:23:30.255931 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a7d567-e7c5-4420-8c4c-d3f12755956d None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:23:30.262864 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 533/1083] 10.222.0.23 () {56 vars in 1186 bytes} [Tue May 10 05:23:30 2022] GET /identity/v3/projects/25e42b3173f74f64aa4d552d2d8e558c => generated 311 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:23:30.263720 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cccf7cb-be34-41b6-b715-55da99606bfc None admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:23:30.365561 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cccf7cb-be34-41b6-b715-55da99606bfc None admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:23:30.398344 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995d387b-038c-4c31-bb9b-37283d97d6e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:23:30.399337 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995d387b-038c-4c31-bb9b-37283d97d6e3 None admin] REQUEST_METHOD: `PUT` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:23:30.401754 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995d387b-038c-4c31-bb9b-37283d97d6e3 None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:23:30.401754 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995d387b-038c-4c31-bb9b-37283d97d6e3 None admin] PATH_INFO: `/v3/projects/25e42b3173f74f64aa4d552d2d8e558c/users/34906ac74ede48dab53bbcbdb638323e/roles/199ac1dd842441d7913c6ee89d8fbecc` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:23:30.403064 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995d387b-038c-4c31-bb9b-37283d97d6e3 None admin] RBAC: Authorizing `identity:create_grant(project_id=25e42b3173f74f64aa4d552d2d8e558c, user_id=34906ac74ede48dab53bbcbdb638323e, role_id=199ac1dd842441d7913c6ee89d8fbecc)` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:23:30.404629 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995d387b-038c-4c31-bb9b-37283d97d6e3 None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:23:30.420899 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 551/1084] 10.222.0.23 () {58 vars in 1439 bytes} [Tue May 10 05:23:30 2022] PUT /identity/v3/projects/25e42b3173f74f64aa4d552d2d8e558c/users/34906ac74ede48dab53bbcbdb638323e/roles/199ac1dd842441d7913c6ee89d8fbecc => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 05:23:30.685646 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff79e442-0303-4cc3-a6cb-50241193ac9a None None] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:23:30.685932 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff79e442-0303-4cc3-a6cb-50241193ac9a None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:23:30.686198 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff79e442-0303-4cc3-a6cb-50241193ac9a None None] PATH_INFO: `/` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:23:30.687605 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 534/1085] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 10 05:23:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 05:23:30.693038 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7d9268-a7ec-4eb2-8fa7-6b0f6e9e0ea3 None None] REQUEST_METHOD: `POST` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:23:30.693409 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7d9268-a7ec-4eb2-8fa7-6b0f6e9e0ea3 None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:23:30.693715 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7d9268-a7ec-4eb2-8fa7-6b0f6e9e0ea3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:23:30.711337 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.auth.core [None req-9f7d9268-a7ec-4eb2-8fa7-6b0f6e9e0ea3 None None] MFA Rules not processed for user `44883b22532e44049d846938dc2cf423`. Rule list: `[]` (Enabled: `True`). {{(pid=79879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:23:30.712579 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-9f7d9268-a7ec-4eb2-8fa7-6b0f6e9e0ea3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:23:30.780857 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 552/1086] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 10 05:23:30 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 05:23:30.804013 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff79e442-0303-4cc3-a6cb-50241193ac9a None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:23:30.910261 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff79e442-0303-4cc3-a6cb-50241193ac9a None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:23:30.945706 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7541ac-e7bf-4ee2-a10d-9eab3143edfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:23:30.946433 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7541ac-e7bf-4ee2-a10d-9eab3143edfb None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:23:30.946727 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7541ac-e7bf-4ee2-a10d-9eab3143edfb None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:23:30.946994 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7541ac-e7bf-4ee2-a10d-9eab3143edfb None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:23:30.957483 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7541ac-e7bf-4ee2-a10d-9eab3143edfb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 05:23:30.965480 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application [None req-8e7541ac-e7bf-4ee2-a10d-9eab3143edfb None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 10 05:23:30.965480 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 05:23:30.965480 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 05:23:30.965480 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 05:23:30.965480 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 05:23:30.965480 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 05:23:30.965480 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 05:23:30.965480 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 05:23:30.965480 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 05:23:30.965480 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 05:23:30.965480 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 05:23:30.965480 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 05:23:30.965480 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 05:23:30.965480 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 05:23:30.965480 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 05:23:30.965480 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 05:23:30.966566 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 05:23:30.966566 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 05:23:30.966566 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 05:23:30.966566 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 05:23:30.966566 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 05:23:30.966566 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 05:23:30.966566 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 05:23:30.966566 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 05:23:30.966566 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 05:23:30.966566 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.get_or_create( May 10 05:23:30.966566 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 05:23:30.966566 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application with Lock( May 10 05:23:30.966566 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 05:23:30.966566 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._enter() May 10 05:23:30.966566 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 05:23:30.966566 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 05:23:30.967439 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 05:23:30.967439 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.creator() May 10 05:23:30.967439 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 05:23:30.967439 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application created_value = creator( May 10 05:23:30.967439 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 05:23:30.967439 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 05:23:30.967439 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 05:23:30.967439 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 05:23:30.967439 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 05:23:30.967439 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 05:23:30.967439 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 10 05:23:30.967439 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application May 10 05:23:30.967439 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 535/1087] 10.222.0.23 () {56 vars in 1120 bytes} [Tue May 10 05:23:30 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 05:23:30.972903 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7d9268-a7ec-4eb2-8fa7-6b0f6e9e0ea3 None None] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:23:31.068512 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7d9268-a7ec-4eb2-8fa7-6b0f6e9e0ea3 None None] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:23:31.102931 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36913494-52b8-4ce4-80dc-51899469a2a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:23:31.103606 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36913494-52b8-4ce4-80dc-51899469a2a4 None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:23:31.103914 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36913494-52b8-4ce4-80dc-51899469a2a4 None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:23:31.104191 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36913494-52b8-4ce4-80dc-51899469a2a4 None admin] PATH_INFO: `/v3/roles` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:23:31.104945 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36913494-52b8-4ce4-80dc-51899469a2a4 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:23:31.105225 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36913494-52b8-4ce4-80dc-51899469a2a4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:23:31.106637 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36913494-52b8-4ce4-80dc-51899469a2a4 None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:23:31.114579 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 553/1088] 10.222.0.23 () {56 vars in 1115 bytes} [Tue May 10 05:23:30 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:23:31.120358 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7541ac-e7bf-4ee2-a10d-9eab3143edfb None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:23:31.219296 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7541ac-e7bf-4ee2-a10d-9eab3143edfb None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:23:31.253324 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d39f0ce-ae01-4d5f-b6ee-c5ae6d4a051f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:23:31.254124 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d39f0ce-ae01-4d5f-b6ee-c5ae6d4a051f None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:23:31.254401 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d39f0ce-ae01-4d5f-b6ee-c5ae6d4a051f None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:23:31.254677 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d39f0ce-ae01-4d5f-b6ee-c5ae6d4a051f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:23:31.264853 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d39f0ce-ae01-4d5f-b6ee-c5ae6d4a051f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:23:31.266305 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d39f0ce-ae01-4d5f-b6ee-c5ae6d4a051f None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:23:31.283450 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application [None req-5d39f0ce-ae01-4d5f-b6ee-c5ae6d4a051f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 05:23:31.283450 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 05:23:31.283450 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 05:23:31.283450 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 05:23:31.283450 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 05:23:31.283450 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 05:23:31.283450 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 05:23:31.283450 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 05:23:31.283450 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 05:23:31.283450 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 05:23:31.283450 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 05:23:31.283450 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 05:23:31.283450 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 05:23:31.283450 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 05:23:31.283450 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 05:23:31.284411 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 05:23:31.284411 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 05:23:31.284411 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 05:23:31.284411 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 05:23:31.284411 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 05:23:31.284411 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 05:23:31.284411 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.get_or_create( May 10 05:23:31.284411 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 05:23:31.284411 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application with Lock( May 10 05:23:31.284411 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 05:23:31.284411 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._enter() May 10 05:23:31.284411 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 05:23:31.284411 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 05:23:31.284411 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 05:23:31.284411 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.creator() May 10 05:23:31.284411 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 05:23:31.284411 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application created_value = creator( May 10 05:23:31.285421 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 05:23:31.285421 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 05:23:31.285421 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 05:23:31.285421 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application May 10 05:23:31.285421 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 536/1089] 10.222.0.23 () {56 vars in 1108 bytes} [Tue May 10 05:23:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 05:23:31.290586 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36913494-52b8-4ce4-80dc-51899469a2a4 None admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:23:31.387704 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36913494-52b8-4ce4-80dc-51899469a2a4 None admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:23:31.420144 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a04f07-3b42-4c58-a715-080724936fc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:23:31.420792 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a04f07-3b42-4c58-a715-080724936fc2 None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:23:31.421067 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a04f07-3b42-4c58-a715-080724936fc2 None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:23:31.421339 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a04f07-3b42-4c58-a715-080724936fc2 None admin] PATH_INFO: `/v3/domains` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:23:31.422059 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a04f07-3b42-4c58-a715-080724936fc2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:23:31.422359 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a04f07-3b42-4c58-a715-080724936fc2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:23:31.423744 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a04f07-3b42-4c58-a715-080724936fc2 None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:23:31.435397 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 554/1090] 10.222.0.23 () {56 vars in 1109 bytes} [Tue May 10 05:23:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:23:31.441012 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d39f0ce-ae01-4d5f-b6ee-c5ae6d4a051f None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:23:31.549004 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d39f0ce-ae01-4d5f-b6ee-c5ae6d4a051f None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:23:31.583684 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ca8289-155b-4e8e-ac2f-55f8cc3efc25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:23:31.584486 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ca8289-155b-4e8e-ac2f-55f8cc3efc25 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:23:31.584771 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ca8289-155b-4e8e-ac2f-55f8cc3efc25 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:23:31.585061 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ca8289-155b-4e8e-ac2f-55f8cc3efc25 None admin] PATH_INFO: `/v3/users/nova` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:23:31.592741 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ca8289-155b-4e8e-ac2f-55f8cc3efc25 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:23:31.594195 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ca8289-155b-4e8e-ac2f-55f8cc3efc25 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:23:31.608314 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application [None req-60ca8289-155b-4e8e-ac2f-55f8cc3efc25 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 10 05:23:31.608314 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 05:23:31.608314 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 05:23:31.608314 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 05:23:31.608314 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 05:23:31.608314 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 05:23:31.608314 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 05:23:31.608314 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 05:23:31.608314 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 05:23:31.608314 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 05:23:31.608314 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 05:23:31.608314 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 05:23:31.608314 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 05:23:31.608314 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 05:23:31.608314 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 05:23:31.608314 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 05:23:31.609335 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 05:23:31.609335 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 05:23:31.609335 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 05:23:31.609335 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 05:23:31.609335 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 05:23:31.609335 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 05:23:31.609335 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 05:23:31.609335 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 05:23:31.609335 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 05:23:31.609335 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.get_or_create( May 10 05:23:31.609335 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 05:23:31.609335 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application with Lock( May 10 05:23:31.609335 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 05:23:31.609335 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._enter() May 10 05:23:31.609335 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 05:23:31.609335 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 05:23:31.609335 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 05:23:31.609335 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.creator() May 10 05:23:31.610295 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 05:23:31.610295 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application created_value = creator( May 10 05:23:31.610295 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 05:23:31.610295 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 05:23:31.610295 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 05:23:31.610295 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 05:23:31.610295 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 05:23:31.610295 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 05:23:31.610295 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 10 05:23:31.610295 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application May 10 05:23:31.610295 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 537/1091] 10.222.0.23 () {56 vars in 1093 bytes} [Tue May 10 05:23:31 2022] GET /identity/v3/users/nova => generated 82 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 05:23:31.615501 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a04f07-3b42-4c58-a715-080724936fc2 None admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:23:31.719059 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a04f07-3b42-4c58-a715-080724936fc2 None admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:23:31.753486 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e694af3c-3194-4554-a465-f40cfe9a540c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:23:31.754161 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e694af3c-3194-4554-a465-f40cfe9a540c None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:23:31.754433 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e694af3c-3194-4554-a465-f40cfe9a540c None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:23:31.754680 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e694af3c-3194-4554-a465-f40cfe9a540c None admin] PATH_INFO: `/v3/users` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:23:31.755528 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e694af3c-3194-4554-a465-f40cfe9a540c None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:23:31.755869 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e694af3c-3194-4554-a465-f40cfe9a540c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:23:31.757291 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e694af3c-3194-4554-a465-f40cfe9a540c None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:23:31.774202 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 555/1092] 10.222.0.23 () {56 vars in 1133 bytes} [Tue May 10 05:23:31 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:23:31.780043 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ca8289-155b-4e8e-ac2f-55f8cc3efc25 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:23:31.880389 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ca8289-155b-4e8e-ac2f-55f8cc3efc25 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:23:31.913396 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e9752a-f266-4672-9b4b-a7f61542e568 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:23:31.914041 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e9752a-f266-4672-9b4b-a7f61542e568 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:23:31.914317 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e9752a-f266-4672-9b4b-a7f61542e568 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:23:31.914587 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e9752a-f266-4672-9b4b-a7f61542e568 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:23:31.980981 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e9752a-f266-4672-9b4b-a7f61542e568 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:23:31.982454 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e9752a-f266-4672-9b4b-a7f61542e568 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:23:32.083917 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 538/1093] 10.222.0.23 () {58 vars in 1282 bytes} [Tue May 10 05:23:31 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 10 05:23:32.089831 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e694af3c-3194-4554-a465-f40cfe9a540c None admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:23:32.186514 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e694af3c-3194-4554-a465-f40cfe9a540c None admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:23:32.219875 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0865cbaa-b01f-4eca-a399-a9cbb25c1516 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:23:32.220674 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0865cbaa-b01f-4eca-a399-a9cbb25c1516 None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:23:32.220949 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0865cbaa-b01f-4eca-a399-a9cbb25c1516 None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:23:32.221215 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0865cbaa-b01f-4eca-a399-a9cbb25c1516 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:23:32.231063 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0865cbaa-b01f-4eca-a399-a9cbb25c1516 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:23:32.232544 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0865cbaa-b01f-4eca-a399-a9cbb25c1516 None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:23:32.250228 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application [None req-0865cbaa-b01f-4eca-a399-a9cbb25c1516 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 05:23:32.250228 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 05:23:32.250228 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 05:23:32.250228 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 05:23:32.250228 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 05:23:32.250228 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 05:23:32.250228 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 05:23:32.250228 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 05:23:32.250228 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 05:23:32.250228 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 05:23:32.250228 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 05:23:32.250228 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 05:23:32.250228 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 05:23:32.250228 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 05:23:32.250228 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 05:23:32.251215 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 05:23:32.251215 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 05:23:32.251215 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 05:23:32.251215 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 05:23:32.251215 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 05:23:32.251215 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 05:23:32.251215 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.get_or_create( May 10 05:23:32.251215 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 05:23:32.251215 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application with Lock( May 10 05:23:32.251215 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 05:23:32.251215 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self._enter() May 10 05:23:32.251215 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 05:23:32.251215 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 05:23:32.251215 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 05:23:32.251215 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.creator() May 10 05:23:32.251215 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 05:23:32.251215 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application created_value = creator( May 10 05:23:32.252169 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 05:23:32.252169 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 05:23:32.252169 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 05:23:32.252169 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application May 10 05:23:32.252169 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 556/1094] 10.222.0.23 () {56 vars in 1108 bytes} [Tue May 10 05:23:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 05:23:32.257328 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e9752a-f266-4672-9b4b-a7f61542e568 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:23:32.359722 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e9752a-f266-4672-9b4b-a7f61542e568 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:23:32.394029 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a107902-0cd8-4125-a68d-11796b93e511 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:23:32.394704 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a107902-0cd8-4125-a68d-11796b93e511 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:23:32.394981 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a107902-0cd8-4125-a68d-11796b93e511 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:23:32.395251 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a107902-0cd8-4125-a68d-11796b93e511 None admin] PATH_INFO: `/v3/domains` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:23:32.396014 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a107902-0cd8-4125-a68d-11796b93e511 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:23:32.396313 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a107902-0cd8-4125-a68d-11796b93e511 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:23:32.397702 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a107902-0cd8-4125-a68d-11796b93e511 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:23:32.410592 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 539/1095] 10.222.0.23 () {56 vars in 1109 bytes} [Tue May 10 05:23:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:23:32.417537 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0865cbaa-b01f-4eca-a399-a9cbb25c1516 None admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:23:32.524193 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0865cbaa-b01f-4eca-a399-a9cbb25c1516 None admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:23:32.559659 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d31fbf-8e03-4bd2-a834-00db414c1d22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:23:32.560477 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d31fbf-8e03-4bd2-a834-00db414c1d22 None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:23:32.560750 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d31fbf-8e03-4bd2-a834-00db414c1d22 None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:23:32.561015 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d31fbf-8e03-4bd2-a834-00db414c1d22 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:23:32.568026 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d31fbf-8e03-4bd2-a834-00db414c1d22 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:23:32.569590 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d31fbf-8e03-4bd2-a834-00db414c1d22 None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:23:32.583101 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application [None req-52d31fbf-8e03-4bd2-a834-00db414c1d22 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 05:23:32.583101 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 05:23:32.583101 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 05:23:32.583101 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 05:23:32.583101 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 05:23:32.583101 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 05:23:32.583101 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 05:23:32.583101 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 05:23:32.583101 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 05:23:32.583101 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 05:23:32.583101 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 05:23:32.583101 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 05:23:32.583101 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 05:23:32.583101 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 05:23:32.583101 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 05:23:32.584156 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 05:23:32.584156 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 05:23:32.584156 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 05:23:32.584156 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 05:23:32.584156 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 05:23:32.584156 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 05:23:32.584156 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.get_or_create( May 10 05:23:32.584156 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 05:23:32.584156 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application with Lock( May 10 05:23:32.584156 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 05:23:32.584156 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self._enter() May 10 05:23:32.584156 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 05:23:32.584156 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 05:23:32.584156 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 05:23:32.584156 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.creator() May 10 05:23:32.584156 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 05:23:32.584156 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application created_value = creator( May 10 05:23:32.585529 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 05:23:32.585529 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 05:23:32.585529 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 05:23:32.585529 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 05:23:32.585529 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 05:23:32.585529 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 05:23:32.585529 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 05:23:32.585529 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application May 10 05:23:32.587936 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 557/1096] 10.222.0.23 () {56 vars in 1111 bytes} [Tue May 10 05:23:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 05:23:32.590057 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a107902-0cd8-4125-a68d-11796b93e511 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:23:32.593246 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025b68c1-522f-4eaf-867e-f15019ef5c6a None None] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:23:32.593535 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025b68c1-522f-4eaf-867e-f15019ef5c6a None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:23:32.593818 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025b68c1-522f-4eaf-867e-f15019ef5c6a None None] PATH_INFO: `/` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:23:32.595162 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 558/1097] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 10 05:23:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 05:23:32.600304 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4072868-48f6-49ad-9e57-8a39478f2b1e None None] REQUEST_METHOD: `POST` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:23:32.600592 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4072868-48f6-49ad-9e57-8a39478f2b1e None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:23:32.600871 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4072868-48f6-49ad-9e57-8a39478f2b1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:23:32.617828 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.auth.core [None req-b4072868-48f6-49ad-9e57-8a39478f2b1e None None] MFA Rules not processed for user `44883b22532e44049d846938dc2cf423`. Rule list: `[]` (Enabled: `True`). {{(pid=79879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:23:32.618986 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-b4072868-48f6-49ad-9e57-8a39478f2b1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:23:32.684494 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 559/1098] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 10 05:23:32 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 10 05:23:32.689627 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a107902-0cd8-4125-a68d-11796b93e511 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:23:32.707968 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4072868-48f6-49ad-9e57-8a39478f2b1e None None] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:23:32.723153 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e80fc8-5b2d-41f6-958b-abef931a56fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:23:32.723785 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e80fc8-5b2d-41f6-958b-abef931a56fb None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:23:32.724062 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e80fc8-5b2d-41f6-958b-abef931a56fb None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:23:32.724333 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e80fc8-5b2d-41f6-958b-abef931a56fb None admin] PATH_INFO: `/v3/projects` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:23:32.725133 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e80fc8-5b2d-41f6-958b-abef931a56fb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:23:32.725438 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e80fc8-5b2d-41f6-958b-abef931a56fb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:23:32.726868 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e80fc8-5b2d-41f6-958b-abef931a56fb None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:23:32.738738 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 540/1099] 10.222.0.23 () {56 vars in 1148 bytes} [Tue May 10 05:23:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:23:32.744706 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e80fc8-5b2d-41f6-958b-abef931a56fb None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:23:32.802668 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4072868-48f6-49ad-9e57-8a39478f2b1e None None] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:23:32.836514 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b792ed51-91e5-4a08-bed4-6cc9d84ec47e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:23:32.837315 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b792ed51-91e5-4a08-bed4-6cc9d84ec47e None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:23:32.837599 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b792ed51-91e5-4a08-bed4-6cc9d84ec47e None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:23:32.837871 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b792ed51-91e5-4a08-bed4-6cc9d84ec47e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:23:32.840429 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e80fc8-5b2d-41f6-958b-abef931a56fb None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:23:32.847851 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b792ed51-91e5-4a08-bed4-6cc9d84ec47e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 05:23:32.855331 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application [None req-b792ed51-91e5-4a08-bed4-6cc9d84ec47e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 10 05:23:32.855331 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 05:23:32.855331 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 05:23:32.855331 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 05:23:32.855331 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 05:23:32.855331 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 05:23:32.855331 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 05:23:32.855331 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 05:23:32.855331 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 05:23:32.855331 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 05:23:32.855331 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 05:23:32.855331 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 05:23:32.855331 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 05:23:32.855331 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 05:23:32.855331 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 05:23:32.855331 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 05:23:32.856327 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 05:23:32.856327 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 05:23:32.856327 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 05:23:32.856327 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 05:23:32.856327 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 05:23:32.856327 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 05:23:32.856327 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 05:23:32.856327 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 05:23:32.856327 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 05:23:32.856327 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.get_or_create( May 10 05:23:32.856327 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 05:23:32.856327 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application with Lock( May 10 05:23:32.856327 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 05:23:32.856327 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self._enter() May 10 05:23:32.856327 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 05:23:32.856327 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 05:23:32.857176 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 05:23:32.857176 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.creator() May 10 05:23:32.857176 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 05:23:32.857176 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application created_value = creator( May 10 05:23:32.857176 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 05:23:32.857176 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 05:23:32.857176 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 05:23:32.857176 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 05:23:32.857176 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 05:23:32.857176 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 05:23:32.857176 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 10 05:23:32.857176 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application May 10 05:23:32.857176 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 560/1100] 10.222.0.23 () {56 vars in 1096 bytes} [Tue May 10 05:23:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 05:23:32.862592 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b792ed51-91e5-4a08-bed4-6cc9d84ec47e None admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:23:32.873887 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85536f56-3e4f-469e-a812-e871a8f008f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:23:32.874541 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85536f56-3e4f-469e-a812-e871a8f008f4 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:23:32.874819 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85536f56-3e4f-469e-a812-e871a8f008f4 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:23:32.875077 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85536f56-3e4f-469e-a812-e871a8f008f4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:23:32.875946 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85536f56-3e4f-469e-a812-e871a8f008f4 None admin] RBAC: Adding query filter params (role.id=635210106d69457ba45e9fa6dd0b9754, scope.project.id=5f23435f783540199d6dcfd0417c090e, user.id=7f50f224ca944983aecfde86375473da) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:23:32.876253 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85536f56-3e4f-469e-a812-e871a8f008f4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:23:32.877685 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85536f56-3e4f-469e-a812-e871a8f008f4 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:23:32.883446 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 541/1101] 10.222.0.23 () {56 vars in 1374 bytes} [Tue May 10 05:23:32 2022] GET /identity/v3/role_assignments?user.id=7f50f224ca944983aecfde86375473da&scope.project.id=5f23435f783540199d6dcfd0417c090e&role.id=635210106d69457ba45e9fa6dd0b9754 => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:23:32.968036 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b792ed51-91e5-4a08-bed4-6cc9d84ec47e None admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:23:33.004510 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ace1c72-67db-47fd-b737-cf165df1115d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:23:33.005086 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ace1c72-67db-47fd-b737-cf165df1115d None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:23:33.005362 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ace1c72-67db-47fd-b737-cf165df1115d None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:23:33.005627 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ace1c72-67db-47fd-b737-cf165df1115d None admin] PATH_INFO: `/v3/roles` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:23:33.006388 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ace1c72-67db-47fd-b737-cf165df1115d None admin] RBAC: Adding query filter params (name=admin) {{(pid=79879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:23:33.006691 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ace1c72-67db-47fd-b737-cf165df1115d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:23:33.008120 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ace1c72-67db-47fd-b737-cf165df1115d None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:23:33.017365 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 561/1102] 10.222.0.23 () {56 vars in 1099 bytes} [Tue May 10 05:23:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 05:23:33.023523 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85536f56-3e4f-469e-a812-e871a8f008f4 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:23:33.130308 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85536f56-3e4f-469e-a812-e871a8f008f4 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:23:33.166204 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8eda4ba-1d93-4d06-bf47-2c32df567e7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:23:33.167084 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8eda4ba-1d93-4d06-bf47-2c32df567e7d None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:23:33.167363 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8eda4ba-1d93-4d06-bf47-2c32df567e7d None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:23:33.167654 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8eda4ba-1d93-4d06-bf47-2c32df567e7d None admin] PATH_INFO: `/v3/users/34906ac74ede48dab53bbcbdb638323e` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:23:33.168855 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8eda4ba-1d93-4d06-bf47-2c32df567e7d None admin] RBAC: Authorizing `identity:get_user(user_id=34906ac74ede48dab53bbcbdb638323e)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:23:33.170273 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8eda4ba-1d93-4d06-bf47-2c32df567e7d None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:23:33.171993 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 542/1103] 10.222.0.23 () {56 vars in 1177 bytes} [Tue May 10 05:23:33 2022] GET /identity/v3/users/34906ac74ede48dab53bbcbdb638323e => generated 285 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:23:33.178167 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ace1c72-67db-47fd-b737-cf165df1115d None admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:23:33.276094 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ace1c72-67db-47fd-b737-cf165df1115d None admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:23:33.308109 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28984547-4ca5-4906-9ebb-4ae86a63ce60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:23:33.308817 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28984547-4ca5-4906-9ebb-4ae86a63ce60 None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:23:33.309084 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28984547-4ca5-4906-9ebb-4ae86a63ce60 None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:23:33.309338 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28984547-4ca5-4906-9ebb-4ae86a63ce60 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:23:33.380753 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28984547-4ca5-4906-9ebb-4ae86a63ce60 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:23:33.382234 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28984547-4ca5-4906-9ebb-4ae86a63ce60 None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:23:33.488903 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 562/1104] 10.222.0.23 () {58 vars in 1282 bytes} [Tue May 10 05:23:33 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 10 05:23:33.495165 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8eda4ba-1d93-4d06-bf47-2c32df567e7d None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:23:33.598022 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8eda4ba-1d93-4d06-bf47-2c32df567e7d None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:23:33.630409 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d61b3d7-621a-49ae-877d-086bbac34e79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:23:33.631283 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d61b3d7-621a-49ae-877d-086bbac34e79 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:23:33.631560 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d61b3d7-621a-49ae-877d-086bbac34e79 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:23:33.631861 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d61b3d7-621a-49ae-877d-086bbac34e79 None admin] PATH_INFO: `/v3/projects/25e42b3173f74f64aa4d552d2d8e558c` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:23:33.633083 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d61b3d7-621a-49ae-877d-086bbac34e79 None admin] RBAC: Authorizing `identity:get_project(project_id=25e42b3173f74f64aa4d552d2d8e558c)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:23:33.634526 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d61b3d7-621a-49ae-877d-086bbac34e79 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:23:33.636429 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 543/1105] 10.222.0.23 () {56 vars in 1186 bytes} [Tue May 10 05:23:33 2022] GET /identity/v3/projects/25e42b3173f74f64aa4d552d2d8e558c => generated 311 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:23:33.642374 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28984547-4ca5-4906-9ebb-4ae86a63ce60 None admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:23:33.740563 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28984547-4ca5-4906-9ebb-4ae86a63ce60 None admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:23:33.782554 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1c8ba2-13ba-4b81-a4fa-d091c55aa837 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:23:33.783218 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1c8ba2-13ba-4b81-a4fa-d091c55aa837 None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:23:33.783501 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1c8ba2-13ba-4b81-a4fa-d091c55aa837 None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:23:33.783844 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1c8ba2-13ba-4b81-a4fa-d091c55aa837 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:23:33.784741 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1c8ba2-13ba-4b81-a4fa-d091c55aa837 None admin] RBAC: Adding query filter params (role.id=199ac1dd842441d7913c6ee89d8fbecc, scope.project.id=25e42b3173f74f64aa4d552d2d8e558c, user.id=34906ac74ede48dab53bbcbdb638323e) {{(pid=79879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:23:33.785076 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1c8ba2-13ba-4b81-a4fa-d091c55aa837 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:23:33.786511 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1c8ba2-13ba-4b81-a4fa-d091c55aa837 None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:23:33.792932 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 563/1106] 10.222.0.23 () {56 vars in 1374 bytes} [Tue May 10 05:23:33 2022] GET /identity/v3/role_assignments?user.id=34906ac74ede48dab53bbcbdb638323e&scope.project.id=25e42b3173f74f64aa4d552d2d8e558c&role.id=199ac1dd842441d7913c6ee89d8fbecc => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 05:23:35.993998 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d1757d-cc4b-4868-ac80-213e66742395 None None] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:23:35.994937 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d1757d-cc4b-4868-ac80-213e66742395 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:23:35.994937 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d1757d-cc4b-4868-ac80-213e66742395 None None] PATH_INFO: `/` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:23:35.997572 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 544/1107] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 10 05:23:35 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 05:23:36.003932 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d12299-4f73-4224-a41f-785054c3e44e None None] REQUEST_METHOD: `POST` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:23:36.004381 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d12299-4f73-4224-a41f-785054c3e44e None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:23:36.004490 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d12299-4f73-4224-a41f-785054c3e44e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:23:36.023476 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.auth.core [None req-54d12299-4f73-4224-a41f-785054c3e44e None None] MFA Rules not processed for user `44883b22532e44049d846938dc2cf423`. Rule list: `[]` (Enabled: `True`). {{(pid=79879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:23:36.024702 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-54d12299-4f73-4224-a41f-785054c3e44e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:23:36.096098 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 564/1108] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 10 05:23:36 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 05:23:36.120971 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d1757d-cc4b-4868-ac80-213e66742395 None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:23:36.226010 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d1757d-cc4b-4868-ac80-213e66742395 None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:23:36.260591 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31444c0-aa06-4fd1-aefb-44707bd81a88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:23:36.261309 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31444c0-aa06-4fd1-aefb-44707bd81a88 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:23:36.261621 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31444c0-aa06-4fd1-aefb-44707bd81a88 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:23:36.261897 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31444c0-aa06-4fd1-aefb-44707bd81a88 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:23:36.263199 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31444c0-aa06-4fd1-aefb-44707bd81a88 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:23:36.264657 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31444c0-aa06-4fd1-aefb-44707bd81a88 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:23:36.266430 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 545/1109] 10.222.0.23 () {56 vars in 1108 bytes} [Tue May 10 05:23:36 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:23:36.275511 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d12299-4f73-4224-a41f-785054c3e44e None None] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:23:36.379175 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d12299-4f73-4224-a41f-785054c3e44e None None] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:23:36.413282 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ef2c5c-1830-4969-b1ed-46b838ddabce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:23:36.413928 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ef2c5c-1830-4969-b1ed-46b838ddabce None admin] REQUEST_METHOD: `POST` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:23:36.414206 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ef2c5c-1830-4969-b1ed-46b838ddabce None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:23:36.414478 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ef2c5c-1830-4969-b1ed-46b838ddabce None admin] PATH_INFO: `/v3/users` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:23:36.415186 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ef2c5c-1830-4969-b1ed-46b838ddabce None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:23:36.416665 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ef2c5c-1830-4969-b1ed-46b838ddabce None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:23:36.437663 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 565/1110] 10.222.0.23 () {60 vars in 1132 bytes} [Tue May 10 05:23:36 2022] POST /identity/v3/users => generated 286 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 05:23:38.713124 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23216a21-991a-4db3-9c7d-7b7307173197 None None] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:23:38.713715 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23216a21-991a-4db3-9c7d-7b7307173197 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:23:38.713715 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23216a21-991a-4db3-9c7d-7b7307173197 None None] PATH_INFO: `/` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:23:38.715032 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 546/1111] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 10 05:23:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 05:23:38.722081 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8be86f-ab4b-4fd1-afa0-736b57d98e07 None None] REQUEST_METHOD: `POST` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:23:38.722566 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8be86f-ab4b-4fd1-afa0-736b57d98e07 None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:23:38.722566 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8be86f-ab4b-4fd1-afa0-736b57d98e07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:23:38.746839 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.auth.core [None req-1f8be86f-ab4b-4fd1-afa0-736b57d98e07 None None] MFA Rules not processed for user `44883b22532e44049d846938dc2cf423`. Rule list: `[]` (Enabled: `True`). {{(pid=79879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:23:38.748164 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-1f8be86f-ab4b-4fd1-afa0-736b57d98e07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:23:38.814875 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 566/1112] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 10 05:23:38 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 05:23:38.845637 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23216a21-991a-4db3-9c7d-7b7307173197 None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:23:38.955259 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23216a21-991a-4db3-9c7d-7b7307173197 None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:23:38.992095 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838b3ffd-30d4-4825-a1af-23041f271470 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:23:38.993098 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838b3ffd-30d4-4825-a1af-23041f271470 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:23:38.993604 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838b3ffd-30d4-4825-a1af-23041f271470 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:23:38.994038 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838b3ffd-30d4-4825-a1af-23041f271470 None admin] PATH_INFO: `/v3/roles/b0cb991ebc2d42d5a5de343c57086616` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:23:38.995703 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838b3ffd-30d4-4825-a1af-23041f271470 None admin] RBAC: Authorizing `identity:get_role(role_id=b0cb991ebc2d42d5a5de343c57086616)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:23:38.997885 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838b3ffd-30d4-4825-a1af-23041f271470 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:23:38.999284 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 547/1113] 10.222.0.23 () {56 vars in 1177 bytes} [Tue May 10 05:23:38 2022] GET /identity/v3/roles/b0cb991ebc2d42d5a5de343c57086616 => generated 223 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:23:39.006315 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8be86f-ab4b-4fd1-afa0-736b57d98e07 None None] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:23:39.115422 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8be86f-ab4b-4fd1-afa0-736b57d98e07 None None] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:23:39.150497 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3623ad66-c359-477e-8e5a-0cf75b4ddd71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:23:39.151352 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3623ad66-c359-477e-8e5a-0cf75b4ddd71 None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:23:39.151624 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3623ad66-c359-477e-8e5a-0cf75b4ddd71 None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:23:39.151924 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3623ad66-c359-477e-8e5a-0cf75b4ddd71 None admin] PATH_INFO: `/v3/users/793f76f6a8f54e088fd19d8f428af988` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:23:39.164974 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3623ad66-c359-477e-8e5a-0cf75b4ddd71 None admin] RBAC: Authorizing `identity:get_user(user_id=793f76f6a8f54e088fd19d8f428af988)` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:23:39.166697 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3623ad66-c359-477e-8e5a-0cf75b4ddd71 None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:23:39.168871 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 567/1114] 10.222.0.23 () {56 vars in 1177 bytes} [Tue May 10 05:23:39 2022] GET /identity/v3/users/793f76f6a8f54e088fd19d8f428af988 => generated 286 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:23:39.177584 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838b3ffd-30d4-4825-a1af-23041f271470 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:23:39.281821 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838b3ffd-30d4-4825-a1af-23041f271470 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:23:39.314435 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b1ab34-c9bc-44d9-84f1-59b5ee75f35c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:23:39.315067 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b1ab34-c9bc-44d9-84f1-59b5ee75f35c None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:23:39.315330 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b1ab34-c9bc-44d9-84f1-59b5ee75f35c None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:23:39.315611 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b1ab34-c9bc-44d9-84f1-59b5ee75f35c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:23:39.380541 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b1ab34-c9bc-44d9-84f1-59b5ee75f35c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:23:39.381984 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b1ab34-c9bc-44d9-84f1-59b5ee75f35c None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:23:39.475065 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 548/1115] 10.222.0.23 () {58 vars in 1282 bytes} [Tue May 10 05:23:39 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 10 05:23:39.486587 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3623ad66-c359-477e-8e5a-0cf75b4ddd71 None admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:23:39.594880 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3623ad66-c359-477e-8e5a-0cf75b4ddd71 None admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:23:39.630912 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651d5b8d-2ff7-4147-9d7b-7733a59648b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:23:39.631798 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651d5b8d-2ff7-4147-9d7b-7733a59648b4 None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:23:39.632072 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651d5b8d-2ff7-4147-9d7b-7733a59648b4 None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:23:39.632327 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651d5b8d-2ff7-4147-9d7b-7733a59648b4 None admin] PATH_INFO: `/v3/projects/25e42b3173f74f64aa4d552d2d8e558c` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:23:39.633546 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651d5b8d-2ff7-4147-9d7b-7733a59648b4 None admin] RBAC: Authorizing `identity:get_project(project_id=25e42b3173f74f64aa4d552d2d8e558c)` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:23:39.634994 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651d5b8d-2ff7-4147-9d7b-7733a59648b4 None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:23:39.636742 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 568/1116] 10.222.0.23 () {56 vars in 1186 bytes} [Tue May 10 05:23:39 2022] GET /identity/v3/projects/25e42b3173f74f64aa4d552d2d8e558c => generated 311 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:23:39.643093 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b1ab34-c9bc-44d9-84f1-59b5ee75f35c None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:23:39.749259 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b1ab34-c9bc-44d9-84f1-59b5ee75f35c None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:23:39.784354 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584ea032-8442-40c0-8ad6-b4a0513ac26c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:23:39.785035 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584ea032-8442-40c0-8ad6-b4a0513ac26c None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:23:39.785312 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584ea032-8442-40c0-8ad6-b4a0513ac26c None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:23:39.785582 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584ea032-8442-40c0-8ad6-b4a0513ac26c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:23:39.786414 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584ea032-8442-40c0-8ad6-b4a0513ac26c None admin] RBAC: Adding query filter params (role.id=b0cb991ebc2d42d5a5de343c57086616, scope.project.id=25e42b3173f74f64aa4d552d2d8e558c, user.id=793f76f6a8f54e088fd19d8f428af988) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:23:39.786726 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584ea032-8442-40c0-8ad6-b4a0513ac26c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:23:39.788190 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584ea032-8442-40c0-8ad6-b4a0513ac26c None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:23:39.793637 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 549/1117] 10.222.0.23 () {56 vars in 1374 bytes} [Tue May 10 05:23:39 2022] GET /identity/v3/role_assignments?user.id=793f76f6a8f54e088fd19d8f428af988&scope.project.id=25e42b3173f74f64aa4d552d2d8e558c&role.id=b0cb991ebc2d42d5a5de343c57086616 => generated 259 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:23:41.975331 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8799c7-294f-4ff9-a49f-73d499a27ffc None None] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:23:41.976292 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8799c7-294f-4ff9-a49f-73d499a27ffc None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:23:41.976292 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8799c7-294f-4ff9-a49f-73d499a27ffc None None] PATH_INFO: `/` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:23:41.978481 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 569/1118] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 10 05:23:41 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 05:23:41.984942 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57bce89-2314-4581-b3a4-1d389cf8f1a6 None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:23:41.985671 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57bce89-2314-4581-b3a4-1d389cf8f1a6 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:23:41.985869 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57bce89-2314-4581-b3a4-1d389cf8f1a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:23:42.004671 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-e57bce89-2314-4581-b3a4-1d389cf8f1a6 None None] MFA Rules not processed for user `44883b22532e44049d846938dc2cf423`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:23:42.005847 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-e57bce89-2314-4581-b3a4-1d389cf8f1a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:23:42.071333 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 550/1119] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 10 05:23:41 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 05:23:42.107815 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8799c7-294f-4ff9-a49f-73d499a27ffc None None] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:23:42.221671 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8799c7-294f-4ff9-a49f-73d499a27ffc None None] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:23:42.255983 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0f01e3-1fdc-4372-ba4b-4624f54d32aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:23:42.256765 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0f01e3-1fdc-4372-ba4b-4624f54d32aa None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:23:42.257042 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0f01e3-1fdc-4372-ba4b-4624f54d32aa None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:23:42.257312 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0f01e3-1fdc-4372-ba4b-4624f54d32aa None admin] PATH_INFO: `/v3/roles/b0cb991ebc2d42d5a5de343c57086616` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:23:42.258808 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0f01e3-1fdc-4372-ba4b-4624f54d32aa None admin] RBAC: Authorizing `identity:get_role(role_id=b0cb991ebc2d42d5a5de343c57086616)` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:23:42.260218 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0f01e3-1fdc-4372-ba4b-4624f54d32aa None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:23:42.261583 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 570/1120] 10.222.0.23 () {56 vars in 1177 bytes} [Tue May 10 05:23:42 2022] GET /identity/v3/roles/b0cb991ebc2d42d5a5de343c57086616 => generated 223 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:23:42.267701 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57bce89-2314-4581-b3a4-1d389cf8f1a6 None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:23:42.369677 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57bce89-2314-4581-b3a4-1d389cf8f1a6 None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:23:42.403355 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35d0da5-64ba-407b-838f-16527729f752 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:23:42.404241 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35d0da5-64ba-407b-838f-16527729f752 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:23:42.404516 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35d0da5-64ba-407b-838f-16527729f752 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:23:42.404787 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35d0da5-64ba-407b-838f-16527729f752 None admin] PATH_INFO: `/v3/users/793f76f6a8f54e088fd19d8f428af988` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:23:42.406088 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35d0da5-64ba-407b-838f-16527729f752 None admin] RBAC: Authorizing `identity:get_user(user_id=793f76f6a8f54e088fd19d8f428af988)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:23:42.407506 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35d0da5-64ba-407b-838f-16527729f752 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:23:42.409129 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 551/1121] 10.222.0.23 () {56 vars in 1177 bytes} [Tue May 10 05:23:42 2022] GET /identity/v3/users/793f76f6a8f54e088fd19d8f428af988 => generated 286 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:23:42.415020 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0f01e3-1fdc-4372-ba4b-4624f54d32aa None admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:23:42.520264 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0f01e3-1fdc-4372-ba4b-4624f54d32aa None admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:23:42.554576 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bf52a9-7ea6-40db-b1b4-85ec8e8fe5a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:23:42.555431 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bf52a9-7ea6-40db-b1b4-85ec8e8fe5a4 None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:23:42.555747 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bf52a9-7ea6-40db-b1b4-85ec8e8fe5a4 None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:23:42.556016 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bf52a9-7ea6-40db-b1b4-85ec8e8fe5a4 None admin] PATH_INFO: `/v3/projects/25e42b3173f74f64aa4d552d2d8e558c` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:23:42.557252 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63bf52a9-7ea6-40db-b1b4-85ec8e8fe5a4 None admin] RBAC: Authorizing `identity:get_project(project_id=25e42b3173f74f64aa4d552d2d8e558c)` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:23:42.558695 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63bf52a9-7ea6-40db-b1b4-85ec8e8fe5a4 None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:23:42.560433 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 571/1122] 10.222.0.23 () {56 vars in 1186 bytes} [Tue May 10 05:23:42 2022] GET /identity/v3/projects/25e42b3173f74f64aa4d552d2d8e558c => generated 311 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:23:42.570208 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35d0da5-64ba-407b-838f-16527729f752 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:23:42.676325 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35d0da5-64ba-407b-838f-16527729f752 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:23:42.709861 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82240c8f-fe7a-49ab-8607-3c35105e81f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:23:42.710739 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82240c8f-fe7a-49ab-8607-3c35105e81f0 None admin] REQUEST_METHOD: `PUT` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:23:42.711014 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82240c8f-fe7a-49ab-8607-3c35105e81f0 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:23:42.711277 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82240c8f-fe7a-49ab-8607-3c35105e81f0 None admin] PATH_INFO: `/v3/projects/25e42b3173f74f64aa4d552d2d8e558c/users/793f76f6a8f54e088fd19d8f428af988/roles/b0cb991ebc2d42d5a5de343c57086616` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:23:42.713867 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82240c8f-fe7a-49ab-8607-3c35105e81f0 None admin] RBAC: Authorizing `identity:create_grant(project_id=25e42b3173f74f64aa4d552d2d8e558c, user_id=793f76f6a8f54e088fd19d8f428af988, role_id=b0cb991ebc2d42d5a5de343c57086616)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:23:42.715295 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82240c8f-fe7a-49ab-8607-3c35105e81f0 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:23:42.735320 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 552/1123] 10.222.0.23 () {58 vars in 1439 bytes} [Tue May 10 05:23:42 2022] PUT /identity/v3/projects/25e42b3173f74f64aa4d552d2d8e558c/users/793f76f6a8f54e088fd19d8f428af988/roles/b0cb991ebc2d42d5a5de343c57086616 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 05:23:44.869712 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee68a89-80d7-43d2-96d2-32b72afc91be None None] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:23:44.870274 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee68a89-80d7-43d2-96d2-32b72afc91be None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:23:44.870274 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee68a89-80d7-43d2-96d2-32b72afc91be None None] PATH_INFO: `/` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:23:44.872048 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 572/1124] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 10 05:23:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 05:23:44.878405 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9100376-af40-43a2-80ff-7e736b143922 None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:23:44.879189 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9100376-af40-43a2-80ff-7e736b143922 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:23:44.879285 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9100376-af40-43a2-80ff-7e736b143922 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:23:44.901632 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-f9100376-af40-43a2-80ff-7e736b143922 None None] MFA Rules not processed for user `44883b22532e44049d846938dc2cf423`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:23:44.902825 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-f9100376-af40-43a2-80ff-7e736b143922 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:23:44.969887 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 553/1125] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 10 05:23:44 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 05:23:44.992570 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee68a89-80d7-43d2-96d2-32b72afc91be None None] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:23:45.095024 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee68a89-80d7-43d2-96d2-32b72afc91be None None] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:23:45.133818 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae817ca-3819-4e50-94b5-26d3dbf754a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:23:45.134581 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae817ca-3819-4e50-94b5-26d3dbf754a0 None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:23:45.134858 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae817ca-3819-4e50-94b5-26d3dbf754a0 None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:23:45.135125 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae817ca-3819-4e50-94b5-26d3dbf754a0 None admin] PATH_INFO: `/v3/roles/b0cb991ebc2d42d5a5de343c57086616` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:23:45.136678 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae817ca-3819-4e50-94b5-26d3dbf754a0 None admin] RBAC: Authorizing `identity:get_role(role_id=b0cb991ebc2d42d5a5de343c57086616)` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:23:45.138038 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae817ca-3819-4e50-94b5-26d3dbf754a0 None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:23:45.139396 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 573/1126] 10.222.0.23 () {56 vars in 1177 bytes} [Tue May 10 05:23:44 2022] GET /identity/v3/roles/b0cb991ebc2d42d5a5de343c57086616 => generated 223 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:23:45.145837 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9100376-af40-43a2-80ff-7e736b143922 None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:23:45.246339 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9100376-af40-43a2-80ff-7e736b143922 None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:23:45.293534 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c0bdd7-d317-46a7-b544-39ecdd7b144e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:23:45.294405 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c0bdd7-d317-46a7-b544-39ecdd7b144e None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:23:45.294689 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c0bdd7-d317-46a7-b544-39ecdd7b144e None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:23:45.294961 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c0bdd7-d317-46a7-b544-39ecdd7b144e None admin] PATH_INFO: `/v3/users/793f76f6a8f54e088fd19d8f428af988` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:23:45.296244 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c0bdd7-d317-46a7-b544-39ecdd7b144e None admin] RBAC: Authorizing `identity:get_user(user_id=793f76f6a8f54e088fd19d8f428af988)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:23:45.297691 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c0bdd7-d317-46a7-b544-39ecdd7b144e None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:23:45.299303 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 554/1127] 10.222.0.23 () {56 vars in 1177 bytes} [Tue May 10 05:23:45 2022] GET /identity/v3/users/793f76f6a8f54e088fd19d8f428af988 => generated 286 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:23:45.305691 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae817ca-3819-4e50-94b5-26d3dbf754a0 None admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:23:45.414170 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae817ca-3819-4e50-94b5-26d3dbf754a0 None admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:23:45.447698 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7697d20f-702c-4f7a-9d34-0c33cae08626 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:23:45.448367 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7697d20f-702c-4f7a-9d34-0c33cae08626 None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:23:45.448652 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7697d20f-702c-4f7a-9d34-0c33cae08626 None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:23:45.448923 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7697d20f-702c-4f7a-9d34-0c33cae08626 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:23:45.528372 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7697d20f-702c-4f7a-9d34-0c33cae08626 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:23:45.529839 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7697d20f-702c-4f7a-9d34-0c33cae08626 None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:23:45.649967 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 574/1128] 10.222.0.23 () {58 vars in 1282 bytes} [Tue May 10 05:23:45 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 10 05:23:45.656388 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c0bdd7-d317-46a7-b544-39ecdd7b144e None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:23:45.757782 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c0bdd7-d317-46a7-b544-39ecdd7b144e None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:23:45.792162 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3b764c-183d-4f55-853a-c94b2a102e2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:23:45.793019 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3b764c-183d-4f55-853a-c94b2a102e2d None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:23:45.793302 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3b764c-183d-4f55-853a-c94b2a102e2d None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:23:45.793572 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3b764c-183d-4f55-853a-c94b2a102e2d None admin] PATH_INFO: `/v3/projects/25e42b3173f74f64aa4d552d2d8e558c` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:23:45.794810 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3b764c-183d-4f55-853a-c94b2a102e2d None admin] RBAC: Authorizing `identity:get_project(project_id=25e42b3173f74f64aa4d552d2d8e558c)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:23:45.796278 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3b764c-183d-4f55-853a-c94b2a102e2d None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:23:45.797979 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 555/1129] 10.222.0.23 () {56 vars in 1186 bytes} [Tue May 10 05:23:45 2022] GET /identity/v3/projects/25e42b3173f74f64aa4d552d2d8e558c => generated 311 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:23:45.804479 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7697d20f-702c-4f7a-9d34-0c33cae08626 None admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:23:45.905971 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7697d20f-702c-4f7a-9d34-0c33cae08626 None admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:23:45.948683 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b98577-feb5-4a0d-ab40-c2e41788bb82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:23:45.949345 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b98577-feb5-4a0d-ab40-c2e41788bb82 None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:23:45.949623 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b98577-feb5-4a0d-ab40-c2e41788bb82 None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:23:45.949892 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b98577-feb5-4a0d-ab40-c2e41788bb82 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:23:45.950733 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b98577-feb5-4a0d-ab40-c2e41788bb82 None admin] RBAC: Adding query filter params (role.id=b0cb991ebc2d42d5a5de343c57086616, scope.project.id=25e42b3173f74f64aa4d552d2d8e558c, user.id=793f76f6a8f54e088fd19d8f428af988) {{(pid=79879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:23:45.951129 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b98577-feb5-4a0d-ab40-c2e41788bb82 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:23:45.952706 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b98577-feb5-4a0d-ab40-c2e41788bb82 None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:23:45.959343 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 575/1130] 10.222.0.23 () {56 vars in 1374 bytes} [Tue May 10 05:23:45 2022] GET /identity/v3/role_assignments?user.id=793f76f6a8f54e088fd19d8f428af988&scope.project.id=25e42b3173f74f64aa4d552d2d8e558c&role.id=b0cb991ebc2d42d5a5de343c57086616 => generated 608 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:23:48.179114 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e037312-a028-4817-9422-ffee379f575e None None] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:23:48.180115 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e037312-a028-4817-9422-ffee379f575e None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:23:48.180115 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e037312-a028-4817-9422-ffee379f575e None None] PATH_INFO: `/` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:23:48.182320 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 556/1131] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 10 05:23:48 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 05:23:48.187969 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b22b90a-804b-4ece-88d9-9c233894cb9f None None] REQUEST_METHOD: `POST` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:23:48.188403 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b22b90a-804b-4ece-88d9-9c233894cb9f None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:23:48.188509 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b22b90a-804b-4ece-88d9-9c233894cb9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:23:48.206903 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.auth.core [None req-9b22b90a-804b-4ece-88d9-9c233894cb9f None None] MFA Rules not processed for user `44883b22532e44049d846938dc2cf423`. Rule list: `[]` (Enabled: `True`). {{(pid=79879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:23:48.208107 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-9b22b90a-804b-4ece-88d9-9c233894cb9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:23:48.274841 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 576/1132] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 10 05:23:48 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 05:23:48.298729 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e037312-a028-4817-9422-ffee379f575e None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:23:48.413203 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e037312-a028-4817-9422-ffee379f575e None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:23:48.449351 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c00903a-33d1-43bf-9067-4044ecc4bc7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:23:48.450070 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c00903a-33d1-43bf-9067-4044ecc4bc7a None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:23:48.450703 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c00903a-33d1-43bf-9067-4044ecc4bc7a None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:23:48.450978 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c00903a-33d1-43bf-9067-4044ecc4bc7a None admin] PATH_INFO: `/v3/domains/default` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:23:48.452230 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c00903a-33d1-43bf-9067-4044ecc4bc7a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:23:48.453677 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c00903a-33d1-43bf-9067-4044ecc4bc7a None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:23:48.455299 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 557/1133] 10.222.0.23 () {56 vars in 1108 bytes} [Tue May 10 05:23:48 2022] GET /identity/v3/domains/default => generated 199 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:23:48.461854 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b22b90a-804b-4ece-88d9-9c233894cb9f None None] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:23:48.569868 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b22b90a-804b-4ece-88d9-9c233894cb9f None None] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:23:48.604769 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22bc996-231e-4ac9-8295-41b4d2755492 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:23:48.605417 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22bc996-231e-4ac9-8295-41b4d2755492 None admin] REQUEST_METHOD: `POST` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:23:48.605700 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22bc996-231e-4ac9-8295-41b4d2755492 None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:23:48.605967 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22bc996-231e-4ac9-8295-41b4d2755492 None admin] PATH_INFO: `/v3/projects` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:23:48.606675 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22bc996-231e-4ac9-8295-41b4d2755492 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:23:48.608181 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22bc996-231e-4ac9-8295-41b4d2755492 None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:23:48.636775 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 577/1134] 10.222.0.23 () {60 vars in 1141 bytes} [Tue May 10 05:23:48 2022] POST /identity/v3/projects => generated 311 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 05:23:50.875911 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a266cd3-012b-4c92-812e-fa43233dcb0c None None] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:23:50.876777 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a266cd3-012b-4c92-812e-fa43233dcb0c None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:23:50.876777 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a266cd3-012b-4c92-812e-fa43233dcb0c None None] PATH_INFO: `/` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:23:50.878932 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 558/1135] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 10 05:23:50 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 05:23:50.887047 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61afd722-117e-41fc-859a-b75e30bb34b1 None None] REQUEST_METHOD: `POST` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:23:50.887487 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61afd722-117e-41fc-859a-b75e30bb34b1 None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:23:50.887726 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61afd722-117e-41fc-859a-b75e30bb34b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:23:50.906763 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.auth.core [None req-61afd722-117e-41fc-859a-b75e30bb34b1 None None] MFA Rules not processed for user `44883b22532e44049d846938dc2cf423`. Rule list: `[]` (Enabled: `True`). {{(pid=79879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:23:50.907977 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-61afd722-117e-41fc-859a-b75e30bb34b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:23:50.974734 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 578/1136] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 10 05:23:50 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 05:23:51.004847 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a266cd3-012b-4c92-812e-fa43233dcb0c None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:23:51.114615 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a266cd3-012b-4c92-812e-fa43233dcb0c None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:23:51.149118 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1205c56-c59f-490c-86c0-9da0dd787cff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:23:51.149846 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1205c56-c59f-490c-86c0-9da0dd787cff None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:23:51.150130 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1205c56-c59f-490c-86c0-9da0dd787cff None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:23:51.150399 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1205c56-c59f-490c-86c0-9da0dd787cff None admin] PATH_INFO: `/v3/domains/default` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:23:51.151733 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1205c56-c59f-490c-86c0-9da0dd787cff None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:23:51.153185 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1205c56-c59f-490c-86c0-9da0dd787cff None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:23:51.154855 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 559/1137] 10.222.0.23 () {56 vars in 1108 bytes} [Tue May 10 05:23:51 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:23:51.161494 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61afd722-117e-41fc-859a-b75e30bb34b1 None None] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:23:51.274046 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61afd722-117e-41fc-859a-b75e30bb34b1 None None] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:23:51.308348 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c31fcf-2997-4350-ae9c-3dc13293bb33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:23:51.309001 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c31fcf-2997-4350-ae9c-3dc13293bb33 None admin] REQUEST_METHOD: `POST` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:23:51.309283 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c31fcf-2997-4350-ae9c-3dc13293bb33 None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:23:51.309561 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c31fcf-2997-4350-ae9c-3dc13293bb33 None admin] PATH_INFO: `/v3/users` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:23:51.310269 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c31fcf-2997-4350-ae9c-3dc13293bb33 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:23:51.311743 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c31fcf-2997-4350-ae9c-3dc13293bb33 None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:23:51.337713 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 579/1138] 10.222.0.23 () {60 vars in 1132 bytes} [Tue May 10 05:23:51 2022] POST /identity/v3/users => generated 286 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 05:23:53.558026 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd1e041-b666-42c2-8b24-8c1460fe5d52 None None] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:23:53.558866 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd1e041-b666-42c2-8b24-8c1460fe5d52 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:23:53.558866 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd1e041-b666-42c2-8b24-8c1460fe5d52 None None] PATH_INFO: `/` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:23:53.561199 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 560/1139] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 10 05:23:53 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 05:23:53.568703 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3665650c-e961-4e65-bbbe-08ffdbc41736 None None] REQUEST_METHOD: `POST` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:23:53.569138 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3665650c-e961-4e65-bbbe-08ffdbc41736 None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:23:53.569253 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3665650c-e961-4e65-bbbe-08ffdbc41736 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:23:53.587106 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.auth.core [None req-3665650c-e961-4e65-bbbe-08ffdbc41736 None None] MFA Rules not processed for user `44883b22532e44049d846938dc2cf423`. Rule list: `[]` (Enabled: `True`). {{(pid=79879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:23:53.588329 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-3665650c-e961-4e65-bbbe-08ffdbc41736 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:23:53.659179 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 580/1140] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 10 05:23:53 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 05:23:53.682365 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd1e041-b666-42c2-8b24-8c1460fe5d52 None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:23:53.785073 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd1e041-b666-42c2-8b24-8c1460fe5d52 None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:23:53.818603 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72939dbf-6065-467a-85b7-b65488529f9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:23:53.819400 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72939dbf-6065-467a-85b7-b65488529f9a None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:23:53.819704 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72939dbf-6065-467a-85b7-b65488529f9a None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:23:53.819978 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72939dbf-6065-467a-85b7-b65488529f9a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:23:53.830585 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72939dbf-6065-467a-85b7-b65488529f9a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 05:23:53.838411 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application [None req-72939dbf-6065-467a-85b7-b65488529f9a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 10 05:23:53.838411 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 05:23:53.838411 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 05:23:53.838411 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 05:23:53.838411 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 05:23:53.838411 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 05:23:53.838411 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 05:23:53.838411 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 05:23:53.838411 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 05:23:53.838411 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 05:23:53.838411 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 05:23:53.838411 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 05:23:53.838411 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 05:23:53.838411 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 05:23:53.838411 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 05:23:53.838411 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 05:23:53.839565 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 05:23:53.839565 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 05:23:53.839565 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 05:23:53.839565 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 05:23:53.839565 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 05:23:53.839565 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 05:23:53.839565 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 05:23:53.839565 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 05:23:53.839565 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 05:23:53.839565 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.get_or_create( May 10 05:23:53.839565 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 05:23:53.839565 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application with Lock( May 10 05:23:53.839565 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 05:23:53.839565 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._enter() May 10 05:23:53.839565 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 05:23:53.839565 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 05:23:53.840543 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 05:23:53.840543 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.creator() May 10 05:23:53.840543 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 05:23:53.840543 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application created_value = creator( May 10 05:23:53.840543 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 05:23:53.840543 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 05:23:53.840543 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 05:23:53.840543 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 05:23:53.840543 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 05:23:53.840543 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 05:23:53.840543 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 10 05:23:53.840543 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application May 10 05:23:53.840543 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 561/1141] 10.222.0.23 () {56 vars in 1096 bytes} [Tue May 10 05:23:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 05:23:53.845968 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3665650c-e961-4e65-bbbe-08ffdbc41736 None None] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:23:53.944594 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3665650c-e961-4e65-bbbe-08ffdbc41736 None None] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:23:53.978795 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b0dc57-8a02-4ddf-86c7-2e8bac665a6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:23:53.979453 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b0dc57-8a02-4ddf-86c7-2e8bac665a6c None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:23:53.979773 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b0dc57-8a02-4ddf-86c7-2e8bac665a6c None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:23:53.980049 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b0dc57-8a02-4ddf-86c7-2e8bac665a6c None admin] PATH_INFO: `/v3/roles` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:23:53.980807 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b0dc57-8a02-4ddf-86c7-2e8bac665a6c None admin] RBAC: Adding query filter params (name=admin) {{(pid=79879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:23:53.981120 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b0dc57-8a02-4ddf-86c7-2e8bac665a6c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:23:53.982494 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b0dc57-8a02-4ddf-86c7-2e8bac665a6c None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:23:53.990610 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 581/1142] 10.222.0.23 () {56 vars in 1099 bytes} [Tue May 10 05:23:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:23:53.997446 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72939dbf-6065-467a-85b7-b65488529f9a None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:23:54.115836 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72939dbf-6065-467a-85b7-b65488529f9a None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:23:54.157519 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8441666b-937e-46ef-802f-39822719b5b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:23:54.158777 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8441666b-937e-46ef-802f-39822719b5b2 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:23:54.159152 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8441666b-937e-46ef-802f-39822719b5b2 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:23:54.159611 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8441666b-937e-46ef-802f-39822719b5b2 None admin] PATH_INFO: `/v3/users/c97c700718504489a6ed21cecbe7cb64` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:23:54.173778 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8441666b-937e-46ef-802f-39822719b5b2 None admin] RBAC: Authorizing `identity:get_user(user_id=c97c700718504489a6ed21cecbe7cb64)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:23:54.175280 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8441666b-937e-46ef-802f-39822719b5b2 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:23:54.177064 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 562/1143] 10.222.0.23 () {56 vars in 1177 bytes} [Tue May 10 05:23:53 2022] GET /identity/v3/users/c97c700718504489a6ed21cecbe7cb64 => generated 286 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:23:54.183271 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b0dc57-8a02-4ddf-86c7-2e8bac665a6c None admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:23:54.307540 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b0dc57-8a02-4ddf-86c7-2e8bac665a6c None admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:23:54.341096 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998f9c07-b14f-4e67-9b66-c69e76d9513c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:23:54.341729 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998f9c07-b14f-4e67-9b66-c69e76d9513c None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:23:54.342001 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998f9c07-b14f-4e67-9b66-c69e76d9513c None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:23:54.342260 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998f9c07-b14f-4e67-9b66-c69e76d9513c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:23:54.412412 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998f9c07-b14f-4e67-9b66-c69e76d9513c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:23:54.413815 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998f9c07-b14f-4e67-9b66-c69e76d9513c None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:23:54.511548 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 582/1144] 10.222.0.23 () {58 vars in 1282 bytes} [Tue May 10 05:23:54 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 10 05:23:54.517638 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8441666b-937e-46ef-802f-39822719b5b2 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:23:54.631598 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8441666b-937e-46ef-802f-39822719b5b2 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:23:54.667457 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f164ff-dbcc-4d8b-80f4-ca79cc9a30b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:23:54.668503 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f164ff-dbcc-4d8b-80f4-ca79cc9a30b0 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:23:54.668975 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f164ff-dbcc-4d8b-80f4-ca79cc9a30b0 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:23:54.669453 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f164ff-dbcc-4d8b-80f4-ca79cc9a30b0 None admin] PATH_INFO: `/v3/projects/19de249744204147af482b6216343691` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:23:54.670753 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f164ff-dbcc-4d8b-80f4-ca79cc9a30b0 None admin] RBAC: Authorizing `identity:get_project(project_id=19de249744204147af482b6216343691)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:23:54.672226 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f164ff-dbcc-4d8b-80f4-ca79cc9a30b0 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:23:54.673917 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 563/1145] 10.222.0.23 () {56 vars in 1186 bytes} [Tue May 10 05:23:54 2022] GET /identity/v3/projects/19de249744204147af482b6216343691 => generated 311 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:23:54.680818 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998f9c07-b14f-4e67-9b66-c69e76d9513c None admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:23:54.788870 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998f9c07-b14f-4e67-9b66-c69e76d9513c None admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:23:54.822318 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a062e9a-f667-46eb-8e78-4fdc99f7725c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:23:54.822965 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a062e9a-f667-46eb-8e78-4fdc99f7725c None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:23:54.823246 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a062e9a-f667-46eb-8e78-4fdc99f7725c None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:23:54.823519 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a062e9a-f667-46eb-8e78-4fdc99f7725c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:23:54.824390 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a062e9a-f667-46eb-8e78-4fdc99f7725c None admin] RBAC: Adding query filter params (role.id=199ac1dd842441d7913c6ee89d8fbecc, scope.project.id=19de249744204147af482b6216343691, user.id=c97c700718504489a6ed21cecbe7cb64) {{(pid=79879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:23:54.824704 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a062e9a-f667-46eb-8e78-4fdc99f7725c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:23:54.826132 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a062e9a-f667-46eb-8e78-4fdc99f7725c None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:23:54.831666 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 583/1146] 10.222.0.23 () {56 vars in 1374 bytes} [Tue May 10 05:23:54 2022] GET /identity/v3/role_assignments?user.id=c97c700718504489a6ed21cecbe7cb64&scope.project.id=19de249744204147af482b6216343691&role.id=199ac1dd842441d7913c6ee89d8fbecc => generated 259 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:23:56.981460 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bf9973-c99a-4da2-9bc1-bb9a68a9f7ea None None] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:23:56.982327 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bf9973-c99a-4da2-9bc1-bb9a68a9f7ea None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:23:56.982327 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bf9973-c99a-4da2-9bc1-bb9a68a9f7ea None None] PATH_INFO: `/` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:23:56.984588 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 564/1147] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 10 05:23:56 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 05:23:56.990078 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f1c071-3e62-4896-bfb8-730cd7cb64a0 None None] REQUEST_METHOD: `POST` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:23:56.990531 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f1c071-3e62-4896-bfb8-730cd7cb64a0 None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:23:56.990623 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f1c071-3e62-4896-bfb8-730cd7cb64a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:23:57.007826 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.auth.core [None req-94f1c071-3e62-4896-bfb8-730cd7cb64a0 None None] MFA Rules not processed for user `44883b22532e44049d846938dc2cf423`. Rule list: `[]` (Enabled: `True`). {{(pid=79879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:23:57.008971 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-94f1c071-3e62-4896-bfb8-730cd7cb64a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:23:57.073820 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 584/1148] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 10 05:23:56 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 05:23:57.096095 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bf9973-c99a-4da2-9bc1-bb9a68a9f7ea None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:23:57.208814 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bf9973-c99a-4da2-9bc1-bb9a68a9f7ea None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:23:57.241686 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce765c4-595d-40d2-bc42-e6e7f6430f3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:23:57.242419 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce765c4-595d-40d2-bc42-e6e7f6430f3e None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:23:57.242689 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce765c4-595d-40d2-bc42-e6e7f6430f3e None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:23:57.242989 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce765c4-595d-40d2-bc42-e6e7f6430f3e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:23:57.253208 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce765c4-595d-40d2-bc42-e6e7f6430f3e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 05:23:57.260788 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application [None req-bce765c4-595d-40d2-bc42-e6e7f6430f3e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 10 05:23:57.260788 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 05:23:57.260788 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 05:23:57.260788 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 05:23:57.260788 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 05:23:57.260788 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 05:23:57.260788 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 05:23:57.260788 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 05:23:57.260788 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 05:23:57.260788 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 05:23:57.260788 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 05:23:57.260788 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 05:23:57.260788 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 05:23:57.260788 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 05:23:57.260788 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 05:23:57.260788 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 05:23:57.261868 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 05:23:57.261868 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 05:23:57.261868 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 05:23:57.261868 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 05:23:57.261868 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 05:23:57.261868 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 05:23:57.261868 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 05:23:57.261868 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 05:23:57.261868 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 05:23:57.261868 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.get_or_create( May 10 05:23:57.261868 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 05:23:57.261868 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application with Lock( May 10 05:23:57.261868 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 05:23:57.261868 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._enter() May 10 05:23:57.261868 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 05:23:57.261868 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 05:23:57.262737 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 05:23:57.262737 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.creator() May 10 05:23:57.262737 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 05:23:57.262737 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application created_value = creator( May 10 05:23:57.262737 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 05:23:57.262737 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 05:23:57.262737 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 05:23:57.262737 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 05:23:57.262737 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 05:23:57.262737 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 05:23:57.262737 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 10 05:23:57.262737 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application May 10 05:23:57.262737 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 565/1149] 10.222.0.23 () {56 vars in 1096 bytes} [Tue May 10 05:23:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 05:23:57.268155 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f1c071-3e62-4896-bfb8-730cd7cb64a0 None None] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:23:57.367119 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f1c071-3e62-4896-bfb8-730cd7cb64a0 None None] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:23:57.404093 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b065b49-c366-4558-8e30-4edb5d25caf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:23:57.404756 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b065b49-c366-4558-8e30-4edb5d25caf9 None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:23:57.405029 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b065b49-c366-4558-8e30-4edb5d25caf9 None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:23:57.405265 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b065b49-c366-4558-8e30-4edb5d25caf9 None admin] PATH_INFO: `/v3/roles` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:23:57.406038 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b065b49-c366-4558-8e30-4edb5d25caf9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:23:57.406338 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b065b49-c366-4558-8e30-4edb5d25caf9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:23:57.407728 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b065b49-c366-4558-8e30-4edb5d25caf9 None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:23:57.417275 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 585/1150] 10.222.0.23 () {56 vars in 1099 bytes} [Tue May 10 05:23:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:23:57.425555 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce765c4-595d-40d2-bc42-e6e7f6430f3e None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:23:57.540093 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce765c4-595d-40d2-bc42-e6e7f6430f3e None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:23:57.574259 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fc4a44-1c0b-4c49-981f-e738b417438f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:23:57.575135 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fc4a44-1c0b-4c49-981f-e738b417438f None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:23:57.575413 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fc4a44-1c0b-4c49-981f-e738b417438f None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:23:57.575720 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fc4a44-1c0b-4c49-981f-e738b417438f None admin] PATH_INFO: `/v3/users/c97c700718504489a6ed21cecbe7cb64` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:23:57.576960 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5fc4a44-1c0b-4c49-981f-e738b417438f None admin] RBAC: Authorizing `identity:get_user(user_id=c97c700718504489a6ed21cecbe7cb64)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:23:57.578492 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5fc4a44-1c0b-4c49-981f-e738b417438f None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:23:57.580202 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 566/1151] 10.222.0.23 () {56 vars in 1177 bytes} [Tue May 10 05:23:57 2022] GET /identity/v3/users/c97c700718504489a6ed21cecbe7cb64 => generated 286 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:23:57.586404 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b065b49-c366-4558-8e30-4edb5d25caf9 None admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:23:57.690610 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b065b49-c366-4558-8e30-4edb5d25caf9 None admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:23:57.732897 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d74ecc-cf87-4864-8a95-ba2cf740f94a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:23:57.733758 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d74ecc-cf87-4864-8a95-ba2cf740f94a None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:23:57.734036 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d74ecc-cf87-4864-8a95-ba2cf740f94a None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:23:57.734306 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d74ecc-cf87-4864-8a95-ba2cf740f94a None admin] PATH_INFO: `/v3/projects/19de249744204147af482b6216343691` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:23:57.735622 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d74ecc-cf87-4864-8a95-ba2cf740f94a None admin] RBAC: Authorizing `identity:get_project(project_id=19de249744204147af482b6216343691)` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:23:57.737083 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d74ecc-cf87-4864-8a95-ba2cf740f94a None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:23:57.738880 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 586/1152] 10.222.0.23 () {56 vars in 1186 bytes} [Tue May 10 05:23:57 2022] GET /identity/v3/projects/19de249744204147af482b6216343691 => generated 311 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:23:57.745209 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fc4a44-1c0b-4c49-981f-e738b417438f None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:23:57.848523 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fc4a44-1c0b-4c49-981f-e738b417438f None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:23:57.881542 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63522766-5bdf-4404-a888-385cd579ca2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:23:57.882418 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63522766-5bdf-4404-a888-385cd579ca2f None admin] REQUEST_METHOD: `PUT` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:23:57.882694 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63522766-5bdf-4404-a888-385cd579ca2f None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:23:57.882958 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63522766-5bdf-4404-a888-385cd579ca2f None admin] PATH_INFO: `/v3/projects/19de249744204147af482b6216343691/users/c97c700718504489a6ed21cecbe7cb64/roles/199ac1dd842441d7913c6ee89d8fbecc` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:23:57.885021 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63522766-5bdf-4404-a888-385cd579ca2f None admin] RBAC: Authorizing `identity:create_grant(project_id=19de249744204147af482b6216343691, user_id=c97c700718504489a6ed21cecbe7cb64, role_id=199ac1dd842441d7913c6ee89d8fbecc)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:23:57.886447 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63522766-5bdf-4404-a888-385cd579ca2f None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:23:57.907846 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 567/1153] 10.222.0.23 () {58 vars in 1439 bytes} [Tue May 10 05:23:57 2022] PUT /identity/v3/projects/19de249744204147af482b6216343691/users/c97c700718504489a6ed21cecbe7cb64/roles/199ac1dd842441d7913c6ee89d8fbecc => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 05:24:00.081019 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c757c8-3d2e-4325-b2d0-ac52b259c3d4 None None] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:24:00.081602 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c757c8-3d2e-4325-b2d0-ac52b259c3d4 None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:24:00.081602 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c757c8-3d2e-4325-b2d0-ac52b259c3d4 None None] PATH_INFO: `/` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:24:00.083026 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 587/1154] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 10 05:24:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 05:24:00.088568 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20a8747-f45c-424f-8ed8-274cf086157e None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:24:00.089022 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20a8747-f45c-424f-8ed8-274cf086157e None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:24:00.089116 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20a8747-f45c-424f-8ed8-274cf086157e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:24:00.106833 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-e20a8747-f45c-424f-8ed8-274cf086157e None None] MFA Rules not processed for user `44883b22532e44049d846938dc2cf423`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:24:00.108035 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-e20a8747-f45c-424f-8ed8-274cf086157e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:24:00.173729 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 568/1155] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 10 05:24:00 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 05:24:00.201035 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c757c8-3d2e-4325-b2d0-ac52b259c3d4 None None] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:24:00.305273 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c757c8-3d2e-4325-b2d0-ac52b259c3d4 None None] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:24:00.338510 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a831e798-d0c3-4653-b055-57f9120f79c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:24:00.339218 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a831e798-d0c3-4653-b055-57f9120f79c6 None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:24:00.339502 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a831e798-d0c3-4653-b055-57f9120f79c6 None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:24:00.339801 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a831e798-d0c3-4653-b055-57f9120f79c6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:24:00.350717 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a831e798-d0c3-4653-b055-57f9120f79c6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 05:24:00.358208 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application [None req-a831e798-d0c3-4653-b055-57f9120f79c6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 10 05:24:00.358208 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 05:24:00.358208 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 05:24:00.358208 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 05:24:00.358208 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 05:24:00.358208 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 05:24:00.358208 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 05:24:00.358208 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 05:24:00.358208 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 05:24:00.358208 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 05:24:00.358208 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 05:24:00.358208 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 05:24:00.358208 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 05:24:00.358208 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 05:24:00.358208 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 05:24:00.358208 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 05:24:00.359301 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 05:24:00.359301 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 05:24:00.359301 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 05:24:00.359301 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 05:24:00.359301 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 05:24:00.359301 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 05:24:00.359301 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 05:24:00.359301 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 05:24:00.359301 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 05:24:00.359301 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.get_or_create( May 10 05:24:00.359301 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 05:24:00.359301 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application with Lock( May 10 05:24:00.359301 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 05:24:00.359301 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self._enter() May 10 05:24:00.359301 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 05:24:00.359301 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 05:24:00.360366 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 05:24:00.360366 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.creator() May 10 05:24:00.360366 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 05:24:00.360366 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application created_value = creator( May 10 05:24:00.360366 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 05:24:00.360366 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 05:24:00.360366 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 05:24:00.360366 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 05:24:00.360366 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 05:24:00.360366 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 05:24:00.360366 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 10 05:24:00.360366 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application May 10 05:24:00.360366 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 588/1156] 10.222.0.23 () {56 vars in 1096 bytes} [Tue May 10 05:24:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 05:24:00.366134 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20a8747-f45c-424f-8ed8-274cf086157e None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:24:00.472691 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20a8747-f45c-424f-8ed8-274cf086157e None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:24:00.513881 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab2e9cf-209a-4c21-9ab9-3a91a17c9146 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:24:00.514539 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab2e9cf-209a-4c21-9ab9-3a91a17c9146 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:24:00.514812 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab2e9cf-209a-4c21-9ab9-3a91a17c9146 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:24:00.515080 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab2e9cf-209a-4c21-9ab9-3a91a17c9146 None admin] PATH_INFO: `/v3/roles` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:24:00.515859 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab2e9cf-209a-4c21-9ab9-3a91a17c9146 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:24:00.516160 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab2e9cf-209a-4c21-9ab9-3a91a17c9146 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:24:00.517514 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab2e9cf-209a-4c21-9ab9-3a91a17c9146 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:24:00.525374 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 569/1157] 10.222.0.23 () {56 vars in 1099 bytes} [Tue May 10 05:24:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:24:00.531434 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a831e798-d0c3-4653-b055-57f9120f79c6 None admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:24:00.632308 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a831e798-d0c3-4653-b055-57f9120f79c6 None admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:24:00.666376 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833680e7-6251-4493-88dd-36204b2aafe5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:24:00.667220 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833680e7-6251-4493-88dd-36204b2aafe5 None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:24:00.667496 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833680e7-6251-4493-88dd-36204b2aafe5 None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:24:00.667798 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833680e7-6251-4493-88dd-36204b2aafe5 None admin] PATH_INFO: `/v3/users/c97c700718504489a6ed21cecbe7cb64` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:24:00.669015 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833680e7-6251-4493-88dd-36204b2aafe5 None admin] RBAC: Authorizing `identity:get_user(user_id=c97c700718504489a6ed21cecbe7cb64)` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:24:00.670443 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833680e7-6251-4493-88dd-36204b2aafe5 None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:24:00.672070 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 589/1158] 10.222.0.23 () {56 vars in 1177 bytes} [Tue May 10 05:24:00 2022] GET /identity/v3/users/c97c700718504489a6ed21cecbe7cb64 => generated 286 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:24:00.678385 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab2e9cf-209a-4c21-9ab9-3a91a17c9146 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:24:00.792299 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab2e9cf-209a-4c21-9ab9-3a91a17c9146 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:24:00.828492 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cac0299-03d5-48fb-b117-b9c53c6ce06c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:24:00.829128 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cac0299-03d5-48fb-b117-b9c53c6ce06c None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:24:00.829408 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cac0299-03d5-48fb-b117-b9c53c6ce06c None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:24:00.829682 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cac0299-03d5-48fb-b117-b9c53c6ce06c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:24:00.897949 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cac0299-03d5-48fb-b117-b9c53c6ce06c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:24:00.899326 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cac0299-03d5-48fb-b117-b9c53c6ce06c None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:24:00.997330 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 570/1159] 10.222.0.23 () {58 vars in 1282 bytes} [Tue May 10 05:24:00 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 10 05:24:01.003836 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833680e7-6251-4493-88dd-36204b2aafe5 None admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:24:01.103442 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833680e7-6251-4493-88dd-36204b2aafe5 None admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:24:01.137701 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9996b930-3731-4a96-8269-dfde155eafdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:24:01.138545 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9996b930-3731-4a96-8269-dfde155eafdd None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:24:01.138823 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9996b930-3731-4a96-8269-dfde155eafdd None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:24:01.139093 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9996b930-3731-4a96-8269-dfde155eafdd None admin] PATH_INFO: `/v3/projects/19de249744204147af482b6216343691` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:24:01.140402 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9996b930-3731-4a96-8269-dfde155eafdd None admin] RBAC: Authorizing `identity:get_project(project_id=19de249744204147af482b6216343691)` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:24:01.141830 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9996b930-3731-4a96-8269-dfde155eafdd None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:24:01.143503 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 590/1160] 10.222.0.23 () {56 vars in 1186 bytes} [Tue May 10 05:24:01 2022] GET /identity/v3/projects/19de249744204147af482b6216343691 => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:24:01.149780 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cac0299-03d5-48fb-b117-b9c53c6ce06c None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:24:01.263387 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cac0299-03d5-48fb-b117-b9c53c6ce06c None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:24:01.297660 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0082ffc5-c4c9-4c16-ae44-ad45a3ff7778 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:24:01.298301 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0082ffc5-c4c9-4c16-ae44-ad45a3ff7778 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:24:01.298573 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0082ffc5-c4c9-4c16-ae44-ad45a3ff7778 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:24:01.298845 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0082ffc5-c4c9-4c16-ae44-ad45a3ff7778 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:24:01.299708 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0082ffc5-c4c9-4c16-ae44-ad45a3ff7778 None admin] RBAC: Adding query filter params (role.id=199ac1dd842441d7913c6ee89d8fbecc, scope.project.id=19de249744204147af482b6216343691, user.id=c97c700718504489a6ed21cecbe7cb64) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:24:01.300016 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0082ffc5-c4c9-4c16-ae44-ad45a3ff7778 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:24:01.301500 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0082ffc5-c4c9-4c16-ae44-ad45a3ff7778 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:24:01.307274 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 571/1161] 10.222.0.23 () {56 vars in 1374 bytes} [Tue May 10 05:24:01 2022] GET /identity/v3/role_assignments?user.id=c97c700718504489a6ed21cecbe7cb64&scope.project.id=19de249744204147af482b6216343691&role.id=199ac1dd842441d7913c6ee89d8fbecc => generated 608 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:24:03.511854 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ee4915-5384-4e55-9c81-eb809eba9919 None None] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:24:03.512405 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ee4915-5384-4e55-9c81-eb809eba9919 None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:24:03.512405 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ee4915-5384-4e55-9c81-eb809eba9919 None None] PATH_INFO: `/` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:24:03.513785 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 591/1162] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 10 05:24:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 05:24:03.519308 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f945eb54-1335-4aa5-8651-4a6e8a33845b None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:24:03.519763 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f945eb54-1335-4aa5-8651-4a6e8a33845b None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:24:03.519854 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f945eb54-1335-4aa5-8651-4a6e8a33845b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:24:03.537764 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-f945eb54-1335-4aa5-8651-4a6e8a33845b None None] MFA Rules not processed for user `44883b22532e44049d846938dc2cf423`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:24:03.538928 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-f945eb54-1335-4aa5-8651-4a6e8a33845b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:24:03.609296 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 572/1163] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 10 05:24:03 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 05:24:03.637128 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ee4915-5384-4e55-9c81-eb809eba9919 None None] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:24:03.745429 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ee4915-5384-4e55-9c81-eb809eba9919 None None] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:24:03.778741 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6428f5b6-a77a-427c-8672-03965aadb181 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:24:03.779365 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6428f5b6-a77a-427c-8672-03965aadb181 None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:24:03.779678 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6428f5b6-a77a-427c-8672-03965aadb181 None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:24:03.779940 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6428f5b6-a77a-427c-8672-03965aadb181 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:24:03.844442 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6428f5b6-a77a-427c-8672-03965aadb181 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:24:03.845884 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6428f5b6-a77a-427c-8672-03965aadb181 None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:24:03.943087 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 592/1164] 10.222.0.23 () {58 vars in 1282 bytes} [Tue May 10 05:24:03 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 10 05:24:03.949924 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f945eb54-1335-4aa5-8651-4a6e8a33845b None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:24:04.069424 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f945eb54-1335-4aa5-8651-4a6e8a33845b None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:24:04.103932 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f378b6b9-b121-4a62-adce-96c39efa8fca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:24:04.104732 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f378b6b9-b121-4a62-adce-96c39efa8fca None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:24:04.105012 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f378b6b9-b121-4a62-adce-96c39efa8fca None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:24:04.105278 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f378b6b9-b121-4a62-adce-96c39efa8fca None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:24:04.111817 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f378b6b9-b121-4a62-adce-96c39efa8fca None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:24:04.113284 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f378b6b9-b121-4a62-adce-96c39efa8fca None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:24:04.127501 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application [None req-f378b6b9-b121-4a62-adce-96c39efa8fca None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. May 10 05:24:04.127501 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 05:24:04.127501 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain May 10 05:24:04.127501 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) May 10 05:24:04.127501 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 05:24:04.127501 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 05:24:04.127501 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 05:24:04.127501 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 05:24:04.127501 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. May 10 05:24:04.127501 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application May 10 05:24:04.127501 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 05:24:04.127501 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application May 10 05:24:04.127501 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 05:24:04.127501 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 05:24:04.127501 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 05:24:04.127501 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 05:24:04.127501 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 05:24:04.128912 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 05:24:04.128912 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 05:24:04.128912 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 05:24:04.128912 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 05:24:04.128912 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 05:24:04.128912 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 05:24:04.128912 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 05:24:04.128912 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 05:24:04.128912 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 05:24:04.128912 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 05:24:04.128912 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 05:24:04.128912 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 05:24:04.128912 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 05:24:04.128912 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 05:24:04.128912 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 05:24:04.128912 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.get_or_create( May 10 05:24:04.129878 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 05:24:04.129878 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application with Lock( May 10 05:24:04.129878 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 05:24:04.129878 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._enter() May 10 05:24:04.129878 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 05:24:04.129878 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 05:24:04.129878 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 05:24:04.129878 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.creator() May 10 05:24:04.129878 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 05:24:04.129878 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application created_value = creator( May 10 05:24:04.129878 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain May 10 05:24:04.129878 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 05:24:04.129878 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. May 10 05:24:04.129878 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application May 10 05:24:04.129878 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 573/1165] 10.222.0.23 () {56 vars in 1117 bytes} [Tue May 10 05:24:03 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 05:24:04.135173 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6428f5b6-a77a-427c-8672-03965aadb181 None admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:24:04.233358 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6428f5b6-a77a-427c-8672-03965aadb181 None admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:24:04.267234 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba224f0e-bb59-4130-8332-ea8dbe0ebe87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:24:04.267908 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba224f0e-bb59-4130-8332-ea8dbe0ebe87 None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:24:04.268193 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba224f0e-bb59-4130-8332-ea8dbe0ebe87 None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:24:04.268457 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba224f0e-bb59-4130-8332-ea8dbe0ebe87 None admin] PATH_INFO: `/v3/domains` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:24:04.269261 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba224f0e-bb59-4130-8332-ea8dbe0ebe87 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=79879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:24:04.269565 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba224f0e-bb59-4130-8332-ea8dbe0ebe87 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:24:04.270937 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba224f0e-bb59-4130-8332-ea8dbe0ebe87 None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:24:04.277967 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 593/1166] 10.222.0.23 () {56 vars in 1115 bytes} [Tue May 10 05:24:04 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:24:06.465723 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfd3a42-509e-45fd-836a-9f56b1871de3 None None] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:24:06.466819 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfd3a42-509e-45fd-836a-9f56b1871de3 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:24:06.467478 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfd3a42-509e-45fd-836a-9f56b1871de3 None None] PATH_INFO: `/` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:24:06.468584 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 574/1167] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 10 05:24:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 05:24:06.475098 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11beb542-415c-4f6c-973c-782fffd5b803 None None] REQUEST_METHOD: `POST` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:24:06.475554 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11beb542-415c-4f6c-973c-782fffd5b803 None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:24:06.475693 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11beb542-415c-4f6c-973c-782fffd5b803 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:24:06.497849 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.auth.core [None req-11beb542-415c-4f6c-973c-782fffd5b803 None None] MFA Rules not processed for user `44883b22532e44049d846938dc2cf423`. Rule list: `[]` (Enabled: `True`). {{(pid=79879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:24:06.499024 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-11beb542-415c-4f6c-973c-782fffd5b803 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:24:06.576845 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 594/1168] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 10 05:24:06 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 05:24:06.599928 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfd3a42-509e-45fd-836a-9f56b1871de3 None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:24:06.707824 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfd3a42-509e-45fd-836a-9f56b1871de3 None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:24:06.744644 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba7788e-2d4b-466c-94f8-1bd2fcf4713e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:24:06.745234 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba7788e-2d4b-466c-94f8-1bd2fcf4713e None admin] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:24:06.745511 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba7788e-2d4b-466c-94f8-1bd2fcf4713e None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:24:06.745782 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba7788e-2d4b-466c-94f8-1bd2fcf4713e None admin] PATH_INFO: `/v3/domains` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:24:06.746527 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba7788e-2d4b-466c-94f8-1bd2fcf4713e None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:24:06.748283 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba7788e-2d4b-466c-94f8-1bd2fcf4713e None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:24:06.765516 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 575/1169] 10.222.0.23 () {60 vars in 1138 bytes} [Tue May 10 05:24:06 2022] POST /identity/v3/domains => generated 267 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 05:24:08.998643 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521e1a6e-7d43-46b0-ae4f-f19f7ff39ccb None None] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:24:08.999548 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521e1a6e-7d43-46b0-ae4f-f19f7ff39ccb None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:24:08.999548 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521e1a6e-7d43-46b0-ae4f-f19f7ff39ccb None None] PATH_INFO: `/` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:24:09.001670 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 595/1170] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 10 05:24:08 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 05:24:09.008328 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ac13b3-f3d3-40ce-b4e5-55be5507a7bb None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:24:09.009039 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ac13b3-f3d3-40ce-b4e5-55be5507a7bb None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:24:09.009196 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ac13b3-f3d3-40ce-b4e5-55be5507a7bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:24:09.036642 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-10ac13b3-f3d3-40ce-b4e5-55be5507a7bb None None] MFA Rules not processed for user `44883b22532e44049d846938dc2cf423`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:24:09.037837 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-10ac13b3-f3d3-40ce-b4e5-55be5507a7bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:24:09.116549 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 576/1171] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 10 05:24:09 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 05:24:09.144324 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521e1a6e-7d43-46b0-ae4f-f19f7ff39ccb None None] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:24:09.243153 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521e1a6e-7d43-46b0-ae4f-f19f7ff39ccb None None] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:24:09.276552 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663c601b-f136-4639-8475-95862a98f36a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:24:09.277332 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663c601b-f136-4639-8475-95862a98f36a None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:24:09.277605 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663c601b-f136-4639-8475-95862a98f36a None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:24:09.277873 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663c601b-f136-4639-8475-95862a98f36a None admin] PATH_INFO: `/v3/domains/94568c9f0e7f4d74b64051ea017c5183` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:24:09.288146 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663c601b-f136-4639-8475-95862a98f36a None admin] RBAC: Authorizing `identity:get_domain(domain_id=94568c9f0e7f4d74b64051ea017c5183)` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:24:09.289587 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663c601b-f136-4639-8475-95862a98f36a None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:24:09.291217 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 596/1172] 10.222.0.23 () {56 vars in 1183 bytes} [Tue May 10 05:24:09 2022] GET /identity/v3/domains/94568c9f0e7f4d74b64051ea017c5183 => generated 267 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:24:09.297261 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ac13b3-f3d3-40ce-b4e5-55be5507a7bb None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:24:09.403056 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ac13b3-f3d3-40ce-b4e5-55be5507a7bb None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:24:09.440160 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f18c456-45a7-48be-97e8-d495d572933d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:24:09.440856 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f18c456-45a7-48be-97e8-d495d572933d None admin] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:24:09.441140 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f18c456-45a7-48be-97e8-d495d572933d None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:24:09.441417 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f18c456-45a7-48be-97e8-d495d572933d None admin] PATH_INFO: `/v3/projects` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:24:09.442138 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f18c456-45a7-48be-97e8-d495d572933d None admin] RBAC: Authorizing `identity:create_project()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:24:09.443608 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f18c456-45a7-48be-97e8-d495d572933d None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:24:09.474894 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 577/1173] 10.222.0.23 () {60 vars in 1141 bytes} [Tue May 10 05:24:09 2022] POST /identity/v3/projects => generated 361 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 05:24:11.720955 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c54a600-65e6-4801-a8e2-3e59512070da None None] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:24:11.721840 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c54a600-65e6-4801-a8e2-3e59512070da None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:24:11.721840 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c54a600-65e6-4801-a8e2-3e59512070da None None] PATH_INFO: `/` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:24:11.723984 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 597/1174] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 10 05:24:11 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 05:24:11.730326 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3a15ce-c943-4ce4-9d89-4257f303f2ca None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:24:11.731057 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3a15ce-c943-4ce4-9d89-4257f303f2ca None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:24:11.731248 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3a15ce-c943-4ce4-9d89-4257f303f2ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:24:11.751215 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-5b3a15ce-c943-4ce4-9d89-4257f303f2ca None None] MFA Rules not processed for user `44883b22532e44049d846938dc2cf423`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:24:11.752437 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-5b3a15ce-c943-4ce4-9d89-4257f303f2ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:24:11.817717 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 578/1175] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 10 05:24:11 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 05:24:11.842366 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c54a600-65e6-4801-a8e2-3e59512070da None None] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:24:11.944054 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c54a600-65e6-4801-a8e2-3e59512070da None None] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:24:11.976725 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07988aed-d5a3-44c4-b1b9-b00a6976280f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:24:11.977484 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07988aed-d5a3-44c4-b1b9-b00a6976280f None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:24:11.977763 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07988aed-d5a3-44c4-b1b9-b00a6976280f None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:24:11.978032 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07988aed-d5a3-44c4-b1b9-b00a6976280f None admin] PATH_INFO: `/v3/domains/94568c9f0e7f4d74b64051ea017c5183` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:24:11.979207 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07988aed-d5a3-44c4-b1b9-b00a6976280f None admin] RBAC: Authorizing `identity:get_domain(domain_id=94568c9f0e7f4d74b64051ea017c5183)` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:24:11.980667 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07988aed-d5a3-44c4-b1b9-b00a6976280f None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:24:11.982273 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 598/1176] 10.222.0.23 () {56 vars in 1183 bytes} [Tue May 10 05:24:11 2022] GET /identity/v3/domains/94568c9f0e7f4d74b64051ea017c5183 => generated 267 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:24:11.990108 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3a15ce-c943-4ce4-9d89-4257f303f2ca None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:24:12.087124 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3a15ce-c943-4ce4-9d89-4257f303f2ca None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:24:12.121239 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bc054d-dd9c-4db5-a6ff-c421a4d28754 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:24:12.122260 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bc054d-dd9c-4db5-a6ff-c421a4d28754 None admin] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:24:12.122535 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bc054d-dd9c-4db5-a6ff-c421a4d28754 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:24:12.122802 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bc054d-dd9c-4db5-a6ff-c421a4d28754 None admin] PATH_INFO: `/v3/users` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:24:12.123498 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72bc054d-dd9c-4db5-a6ff-c421a4d28754 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:24:12.124956 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72bc054d-dd9c-4db5-a6ff-c421a4d28754 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:24:12.148179 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 579/1177] 10.222.0.23 () {60 vars in 1132 bytes} [Tue May 10 05:24:11 2022] POST /identity/v3/users => generated 311 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 05:24:14.397946 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaee9eff-5cbd-4c9b-9e04-7cbf8a68b844 None None] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:24:14.398862 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaee9eff-5cbd-4c9b-9e04-7cbf8a68b844 None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:24:14.398862 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaee9eff-5cbd-4c9b-9e04-7cbf8a68b844 None None] PATH_INFO: `/` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:24:14.401298 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 599/1178] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 10 05:24:14 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 05:24:14.409740 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b516f723-7663-4f9b-9662-a9e72faf11b2 None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:24:14.410212 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b516f723-7663-4f9b-9662-a9e72faf11b2 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:24:14.410312 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b516f723-7663-4f9b-9662-a9e72faf11b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:24:14.428606 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-b516f723-7663-4f9b-9662-a9e72faf11b2 None None] MFA Rules not processed for user `44883b22532e44049d846938dc2cf423`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:24:14.429787 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-b516f723-7663-4f9b-9662-a9e72faf11b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:24:14.501912 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 580/1179] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 10 05:24:14 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 10 05:24:14.538028 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaee9eff-5cbd-4c9b-9e04-7cbf8a68b844 None None] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:24:14.642191 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaee9eff-5cbd-4c9b-9e04-7cbf8a68b844 None None] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:24:14.675923 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb8f26f-8fda-4b43-ade6-e8c31a23ffa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:24:14.676639 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb8f26f-8fda-4b43-ade6-e8c31a23ffa2 None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:24:14.676921 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb8f26f-8fda-4b43-ade6-e8c31a23ffa2 None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:24:14.677191 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb8f26f-8fda-4b43-ade6-e8c31a23ffa2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:24:14.688160 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb8f26f-8fda-4b43-ade6-e8c31a23ffa2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 05:24:14.695716 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application [None req-feb8f26f-8fda-4b43-ade6-e8c31a23ffa2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 10 05:24:14.695716 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 05:24:14.695716 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 05:24:14.695716 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 05:24:14.695716 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 05:24:14.695716 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 05:24:14.695716 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 05:24:14.695716 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 05:24:14.695716 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 05:24:14.695716 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 05:24:14.695716 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 05:24:14.695716 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 05:24:14.695716 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 05:24:14.695716 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 05:24:14.695716 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 05:24:14.695716 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 05:24:14.696875 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 05:24:14.696875 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 05:24:14.696875 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 05:24:14.696875 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 05:24:14.696875 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 05:24:14.696875 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 05:24:14.696875 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 05:24:14.696875 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 05:24:14.696875 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 05:24:14.696875 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.get_or_create( May 10 05:24:14.696875 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 05:24:14.696875 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application with Lock( May 10 05:24:14.696875 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 05:24:14.696875 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self._enter() May 10 05:24:14.696875 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 05:24:14.696875 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 05:24:14.698103 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 05:24:14.698103 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.creator() May 10 05:24:14.698103 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 05:24:14.698103 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application created_value = creator( May 10 05:24:14.698103 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 05:24:14.698103 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 05:24:14.698103 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 05:24:14.698103 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 05:24:14.698103 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 05:24:14.698103 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 05:24:14.698103 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 10 05:24:14.698103 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application May 10 05:24:14.698103 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 600/1180] 10.222.0.23 () {56 vars in 1096 bytes} [Tue May 10 05:24:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 05:24:14.703034 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b516f723-7663-4f9b-9662-a9e72faf11b2 None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:24:14.815264 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b516f723-7663-4f9b-9662-a9e72faf11b2 None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:24:14.849221 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba83df4-40c4-4e39-b36e-3939b0d8ed5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:24:14.849888 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba83df4-40c4-4e39-b36e-3939b0d8ed5b None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:24:14.850181 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba83df4-40c4-4e39-b36e-3939b0d8ed5b None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:24:14.850454 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba83df4-40c4-4e39-b36e-3939b0d8ed5b None admin] PATH_INFO: `/v3/roles` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:24:14.851211 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba83df4-40c4-4e39-b36e-3939b0d8ed5b None admin] RBAC: Adding query filter params (name=admin) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:24:14.851518 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba83df4-40c4-4e39-b36e-3939b0d8ed5b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:24:14.852953 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba83df4-40c4-4e39-b36e-3939b0d8ed5b None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:24:14.861033 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 581/1181] 10.222.0.23 () {56 vars in 1099 bytes} [Tue May 10 05:24:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 05:24:14.870639 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb8f26f-8fda-4b43-ade6-e8c31a23ffa2 None admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:24:14.984961 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb8f26f-8fda-4b43-ade6-e8c31a23ffa2 None admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:24:15.019337 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ed4efe-eb08-4b7f-bd4e-2f3b6d397bf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:24:15.020231 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ed4efe-eb08-4b7f-bd4e-2f3b6d397bf0 None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:24:15.020512 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ed4efe-eb08-4b7f-bd4e-2f3b6d397bf0 None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:24:15.020787 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ed4efe-eb08-4b7f-bd4e-2f3b6d397bf0 None admin] PATH_INFO: `/v3/users/a5939192ecad4e508787374ab7ed8658` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:24:15.033930 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ed4efe-eb08-4b7f-bd4e-2f3b6d397bf0 None admin] RBAC: Authorizing `identity:get_user(user_id=a5939192ecad4e508787374ab7ed8658)` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:24:15.035496 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ed4efe-eb08-4b7f-bd4e-2f3b6d397bf0 None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:24:15.037290 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 601/1182] 10.222.0.23 () {56 vars in 1177 bytes} [Tue May 10 05:24:14 2022] GET /identity/v3/users/a5939192ecad4e508787374ab7ed8658 => generated 311 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:24:15.043391 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba83df4-40c4-4e39-b36e-3939b0d8ed5b None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:24:15.142895 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba83df4-40c4-4e39-b36e-3939b0d8ed5b None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:24:15.176641 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7662f957-161f-4e15-8708-2cbd1394891b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:24:15.177284 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7662f957-161f-4e15-8708-2cbd1394891b None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:24:15.177562 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7662f957-161f-4e15-8708-2cbd1394891b None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:24:15.177838 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7662f957-161f-4e15-8708-2cbd1394891b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:24:15.243619 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7662f957-161f-4e15-8708-2cbd1394891b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:24:15.245005 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7662f957-161f-4e15-8708-2cbd1394891b None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:24:15.340887 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 582/1183] 10.222.0.23 () {58 vars in 1282 bytes} [Tue May 10 05:24:15 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 10 05:24:15.347301 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ed4efe-eb08-4b7f-bd4e-2f3b6d397bf0 None admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:24:15.445380 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ed4efe-eb08-4b7f-bd4e-2f3b6d397bf0 None admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:24:15.488663 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93aab122-dfd8-4692-a614-c272e197d746 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:24:15.489542 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93aab122-dfd8-4692-a614-c272e197d746 None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:24:15.489826 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93aab122-dfd8-4692-a614-c272e197d746 None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:24:15.490099 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93aab122-dfd8-4692-a614-c272e197d746 None admin] PATH_INFO: `/v3/projects/28266b88667441a092efa71a2adb124b` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:24:15.491398 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93aab122-dfd8-4692-a614-c272e197d746 None admin] RBAC: Authorizing `identity:get_project(project_id=28266b88667441a092efa71a2adb124b)` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:24:15.492884 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93aab122-dfd8-4692-a614-c272e197d746 None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:24:15.494667 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 602/1184] 10.222.0.23 () {56 vars in 1186 bytes} [Tue May 10 05:24:15 2022] GET /identity/v3/projects/28266b88667441a092efa71a2adb124b => generated 361 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:24:15.501366 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7662f957-161f-4e15-8708-2cbd1394891b None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:24:15.599127 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7662f957-161f-4e15-8708-2cbd1394891b None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:24:15.633265 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825ddbdc-36c4-4bb5-92fa-e571edc3ac4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:24:15.633909 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825ddbdc-36c4-4bb5-92fa-e571edc3ac4a None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:24:15.634191 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825ddbdc-36c4-4bb5-92fa-e571edc3ac4a None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:24:15.634461 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825ddbdc-36c4-4bb5-92fa-e571edc3ac4a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:24:15.635295 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825ddbdc-36c4-4bb5-92fa-e571edc3ac4a None admin] RBAC: Adding query filter params (role.id=199ac1dd842441d7913c6ee89d8fbecc, scope.project.id=28266b88667441a092efa71a2adb124b, user.id=a5939192ecad4e508787374ab7ed8658) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:24:15.635624 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825ddbdc-36c4-4bb5-92fa-e571edc3ac4a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:24:15.637072 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825ddbdc-36c4-4bb5-92fa-e571edc3ac4a None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:24:15.642526 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 583/1185] 10.222.0.23 () {56 vars in 1374 bytes} [Tue May 10 05:24:15 2022] GET /identity/v3/role_assignments?user.id=a5939192ecad4e508787374ab7ed8658&scope.project.id=28266b88667441a092efa71a2adb124b&role.id=199ac1dd842441d7913c6ee89d8fbecc => generated 259 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:24:17.841168 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a004f1-545a-4f08-9964-90577f0ace43 None None] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:24:17.842057 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a004f1-545a-4f08-9964-90577f0ace43 None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:24:17.842661 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a004f1-545a-4f08-9964-90577f0ace43 None None] PATH_INFO: `/` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:24:17.846809 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 603/1186] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 10 05:24:17 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 05:24:17.854329 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4ac9d4-8bb6-40ad-9b6b-a5548242af46 None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:24:17.855092 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4ac9d4-8bb6-40ad-9b6b-a5548242af46 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:24:17.855244 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4ac9d4-8bb6-40ad-9b6b-a5548242af46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:24:17.876180 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-dd4ac9d4-8bb6-40ad-9b6b-a5548242af46 None None] MFA Rules not processed for user `44883b22532e44049d846938dc2cf423`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:24:17.877372 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-dd4ac9d4-8bb6-40ad-9b6b-a5548242af46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:24:17.942988 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 584/1187] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 10 05:24:17 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 05:24:17.965766 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a004f1-545a-4f08-9964-90577f0ace43 None None] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:24:18.075850 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a004f1-545a-4f08-9964-90577f0ace43 None None] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:24:18.111508 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888a1fcc-a986-42b6-8bd6-3404b2b5c9ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:24:18.112254 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888a1fcc-a986-42b6-8bd6-3404b2b5c9ad None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:24:18.112565 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888a1fcc-a986-42b6-8bd6-3404b2b5c9ad None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:24:18.112837 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888a1fcc-a986-42b6-8bd6-3404b2b5c9ad None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:24:18.123633 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888a1fcc-a986-42b6-8bd6-3404b2b5c9ad None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 05:24:18.131166 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application [None req-888a1fcc-a986-42b6-8bd6-3404b2b5c9ad None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 10 05:24:18.131166 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 05:24:18.131166 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 05:24:18.131166 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 05:24:18.131166 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 05:24:18.131166 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 05:24:18.131166 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 05:24:18.131166 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 05:24:18.131166 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 05:24:18.131166 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 05:24:18.131166 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 05:24:18.131166 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 05:24:18.131166 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 05:24:18.131166 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 05:24:18.131166 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 05:24:18.131166 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 05:24:18.132278 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 05:24:18.132278 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 05:24:18.132278 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 05:24:18.132278 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 05:24:18.132278 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 05:24:18.132278 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 05:24:18.132278 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 05:24:18.132278 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 05:24:18.132278 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 05:24:18.132278 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.get_or_create( May 10 05:24:18.132278 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 05:24:18.132278 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application with Lock( May 10 05:24:18.132278 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 05:24:18.132278 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self._enter() May 10 05:24:18.132278 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 05:24:18.132278 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 05:24:18.133151 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 05:24:18.133151 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.creator() May 10 05:24:18.133151 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 05:24:18.133151 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application created_value = creator( May 10 05:24:18.133151 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 05:24:18.133151 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 05:24:18.133151 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 05:24:18.133151 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 05:24:18.133151 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 05:24:18.133151 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 05:24:18.133151 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 10 05:24:18.133151 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application May 10 05:24:18.133151 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 604/1188] 10.222.0.23 () {56 vars in 1096 bytes} [Tue May 10 05:24:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 05:24:18.138385 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4ac9d4-8bb6-40ad-9b6b-a5548242af46 None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:24:18.241379 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4ac9d4-8bb6-40ad-9b6b-a5548242af46 None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:24:18.275339 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb0bc72-6978-46ed-b239-caf77d9c82ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:24:18.276039 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb0bc72-6978-46ed-b239-caf77d9c82ab None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:24:18.276312 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb0bc72-6978-46ed-b239-caf77d9c82ab None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:24:18.276578 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb0bc72-6978-46ed-b239-caf77d9c82ab None admin] PATH_INFO: `/v3/roles` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:24:18.277326 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb0bc72-6978-46ed-b239-caf77d9c82ab None admin] RBAC: Adding query filter params (name=admin) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:24:18.277630 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb0bc72-6978-46ed-b239-caf77d9c82ab None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:24:18.278981 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb0bc72-6978-46ed-b239-caf77d9c82ab None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:24:18.287026 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 585/1189] 10.222.0.23 () {56 vars in 1099 bytes} [Tue May 10 05:24:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:24:18.293405 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888a1fcc-a986-42b6-8bd6-3404b2b5c9ad None admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:24:18.392874 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888a1fcc-a986-42b6-8bd6-3404b2b5c9ad None admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:24:18.425995 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68263d6f-d1a9-4cdb-b233-30bbc4e459a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:24:18.426841 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68263d6f-d1a9-4cdb-b233-30bbc4e459a1 None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:24:18.427121 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68263d6f-d1a9-4cdb-b233-30bbc4e459a1 None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:24:18.427390 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68263d6f-d1a9-4cdb-b233-30bbc4e459a1 None admin] PATH_INFO: `/v3/users/a5939192ecad4e508787374ab7ed8658` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:24:18.428717 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68263d6f-d1a9-4cdb-b233-30bbc4e459a1 None admin] RBAC: Authorizing `identity:get_user(user_id=a5939192ecad4e508787374ab7ed8658)` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:24:18.430147 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68263d6f-d1a9-4cdb-b233-30bbc4e459a1 None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:24:18.431760 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 605/1190] 10.222.0.23 () {56 vars in 1177 bytes} [Tue May 10 05:24:18 2022] GET /identity/v3/users/a5939192ecad4e508787374ab7ed8658 => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 05:24:18.438118 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb0bc72-6978-46ed-b239-caf77d9c82ab None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:24:18.547610 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb0bc72-6978-46ed-b239-caf77d9c82ab None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:24:18.591260 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2019842-339f-4e5a-923a-b605ea248e6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:24:18.592153 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2019842-339f-4e5a-923a-b605ea248e6a None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:24:18.592434 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2019842-339f-4e5a-923a-b605ea248e6a None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:24:18.592713 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2019842-339f-4e5a-923a-b605ea248e6a None admin] PATH_INFO: `/v3/projects/28266b88667441a092efa71a2adb124b` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:24:18.594047 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2019842-339f-4e5a-923a-b605ea248e6a None admin] RBAC: Authorizing `identity:get_project(project_id=28266b88667441a092efa71a2adb124b)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:24:18.595488 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2019842-339f-4e5a-923a-b605ea248e6a None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:24:18.597242 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 586/1191] 10.222.0.23 () {56 vars in 1186 bytes} [Tue May 10 05:24:18 2022] GET /identity/v3/projects/28266b88667441a092efa71a2adb124b => generated 361 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:24:18.603300 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68263d6f-d1a9-4cdb-b233-30bbc4e459a1 None admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:24:18.704517 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68263d6f-d1a9-4cdb-b233-30bbc4e459a1 None admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:24:18.737252 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecb60b0-dadc-409a-a078-35b43d3b32ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:24:18.738173 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecb60b0-dadc-409a-a078-35b43d3b32ec None admin] REQUEST_METHOD: `PUT` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:24:18.738449 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecb60b0-dadc-409a-a078-35b43d3b32ec None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:24:18.738718 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecb60b0-dadc-409a-a078-35b43d3b32ec None admin] PATH_INFO: `/v3/projects/28266b88667441a092efa71a2adb124b/users/a5939192ecad4e508787374ab7ed8658/roles/199ac1dd842441d7913c6ee89d8fbecc` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:24:18.740683 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ecb60b0-dadc-409a-a078-35b43d3b32ec None admin] RBAC: Authorizing `identity:create_grant(project_id=28266b88667441a092efa71a2adb124b, user_id=a5939192ecad4e508787374ab7ed8658, role_id=199ac1dd842441d7913c6ee89d8fbecc)` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:24:18.742111 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ecb60b0-dadc-409a-a078-35b43d3b32ec None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:24:18.758370 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 606/1192] 10.222.0.23 () {58 vars in 1439 bytes} [Tue May 10 05:24:18 2022] PUT /identity/v3/projects/28266b88667441a092efa71a2adb124b/users/a5939192ecad4e508787374ab7ed8658/roles/199ac1dd842441d7913c6ee89d8fbecc => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 05:24:20.927848 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc35539-b522-420a-8ea9-023c45cf9413 None None] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:24:20.928727 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc35539-b522-420a-8ea9-023c45cf9413 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:24:20.928727 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc35539-b522-420a-8ea9-023c45cf9413 None None] PATH_INFO: `/` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:24:20.930811 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 587/1193] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 10 05:24:20 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 05:24:20.937208 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11149f32-9df2-4065-80b5-64180aa0f087 None None] REQUEST_METHOD: `POST` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:24:20.937876 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11149f32-9df2-4065-80b5-64180aa0f087 None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:24:20.937966 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11149f32-9df2-4065-80b5-64180aa0f087 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:24:20.962333 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.auth.core [None req-11149f32-9df2-4065-80b5-64180aa0f087 None None] MFA Rules not processed for user `44883b22532e44049d846938dc2cf423`. Rule list: `[]` (Enabled: `True`). {{(pid=79879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:24:20.963526 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-11149f32-9df2-4065-80b5-64180aa0f087 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:24:21.033558 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 607/1194] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 10 05:24:20 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 05:24:21.070631 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc35539-b522-420a-8ea9-023c45cf9413 None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:24:21.180013 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc35539-b522-420a-8ea9-023c45cf9413 None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:24:21.218842 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a95696-5a87-4648-9f67-a80342fe4426 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:24:21.220047 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a95696-5a87-4648-9f67-a80342fe4426 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:24:21.220360 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a95696-5a87-4648-9f67-a80342fe4426 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:24:21.220702 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a95696-5a87-4648-9f67-a80342fe4426 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:24:21.232690 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a95696-5a87-4648-9f67-a80342fe4426 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 05:24:21.240562 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application [None req-b9a95696-5a87-4648-9f67-a80342fe4426 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 10 05:24:21.240562 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 05:24:21.240562 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 05:24:21.240562 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 05:24:21.240562 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 05:24:21.240562 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 05:24:21.240562 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 05:24:21.240562 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 05:24:21.240562 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 05:24:21.240562 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 05:24:21.240562 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 05:24:21.240562 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 05:24:21.240562 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 05:24:21.240562 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 05:24:21.240562 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 05:24:21.240562 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 05:24:21.241633 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 05:24:21.241633 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 05:24:21.241633 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 05:24:21.241633 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 05:24:21.241633 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 05:24:21.241633 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 05:24:21.241633 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 05:24:21.241633 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 05:24:21.241633 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 05:24:21.241633 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.get_or_create( May 10 05:24:21.241633 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 05:24:21.241633 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application with Lock( May 10 05:24:21.241633 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 05:24:21.241633 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._enter() May 10 05:24:21.241633 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 05:24:21.241633 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 05:24:21.242764 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 05:24:21.242764 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.creator() May 10 05:24:21.242764 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 05:24:21.242764 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application created_value = creator( May 10 05:24:21.242764 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 05:24:21.242764 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 05:24:21.242764 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 05:24:21.242764 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 05:24:21.242764 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 05:24:21.242764 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 05:24:21.242764 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 10 05:24:21.242764 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application May 10 05:24:21.242764 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 588/1195] 10.222.0.23 () {56 vars in 1096 bytes} [Tue May 10 05:24:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 05:24:21.249047 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11149f32-9df2-4065-80b5-64180aa0f087 None None] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:24:21.357799 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11149f32-9df2-4065-80b5-64180aa0f087 None None] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:24:21.392001 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8640c9bc-9eaf-413e-ad9d-b28c2358abbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:24:21.392660 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8640c9bc-9eaf-413e-ad9d-b28c2358abbd None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:24:21.392942 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8640c9bc-9eaf-413e-ad9d-b28c2358abbd None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:24:21.393217 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8640c9bc-9eaf-413e-ad9d-b28c2358abbd None admin] PATH_INFO: `/v3/roles` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:24:21.394066 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8640c9bc-9eaf-413e-ad9d-b28c2358abbd None admin] RBAC: Adding query filter params (name=admin) {{(pid=79879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:24:21.394372 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8640c9bc-9eaf-413e-ad9d-b28c2358abbd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:24:21.395783 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8640c9bc-9eaf-413e-ad9d-b28c2358abbd None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:24:21.403858 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 608/1196] 10.222.0.23 () {56 vars in 1099 bytes} [Tue May 10 05:24:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:24:21.410428 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a95696-5a87-4648-9f67-a80342fe4426 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:24:21.520203 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a95696-5a87-4648-9f67-a80342fe4426 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:24:21.555013 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca86993c-a5bc-44ad-9e74-5293bd6a442c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:24:21.555925 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca86993c-a5bc-44ad-9e74-5293bd6a442c None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:24:21.556205 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca86993c-a5bc-44ad-9e74-5293bd6a442c None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:24:21.556479 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca86993c-a5bc-44ad-9e74-5293bd6a442c None admin] PATH_INFO: `/v3/users/a5939192ecad4e508787374ab7ed8658` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:24:21.557803 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca86993c-a5bc-44ad-9e74-5293bd6a442c None admin] RBAC: Authorizing `identity:get_user(user_id=a5939192ecad4e508787374ab7ed8658)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:24:21.559263 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca86993c-a5bc-44ad-9e74-5293bd6a442c None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:24:21.560954 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 589/1197] 10.222.0.23 () {56 vars in 1177 bytes} [Tue May 10 05:24:21 2022] GET /identity/v3/users/a5939192ecad4e508787374ab7ed8658 => generated 311 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:24:21.570162 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8640c9bc-9eaf-413e-ad9d-b28c2358abbd None admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:24:21.679007 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8640c9bc-9eaf-413e-ad9d-b28c2358abbd None admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:24:21.711824 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84520dbe-ac12-438e-ab8a-829e7dc4711b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:24:21.712462 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84520dbe-ac12-438e-ab8a-829e7dc4711b None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:24:21.712740 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84520dbe-ac12-438e-ab8a-829e7dc4711b None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:24:21.713011 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84520dbe-ac12-438e-ab8a-829e7dc4711b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:24:21.778204 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84520dbe-ac12-438e-ab8a-829e7dc4711b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:24:21.779614 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84520dbe-ac12-438e-ab8a-829e7dc4711b None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:24:21.893597 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 609/1198] 10.222.0.23 () {58 vars in 1282 bytes} [Tue May 10 05:24:21 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 10 05:24:21.902737 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca86993c-a5bc-44ad-9e74-5293bd6a442c None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:24:22.015936 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca86993c-a5bc-44ad-9e74-5293bd6a442c None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:24:22.055123 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c18ea56-cfba-4952-826b-c3183f4b9899 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:24:22.056013 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c18ea56-cfba-4952-826b-c3183f4b9899 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:24:22.056296 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c18ea56-cfba-4952-826b-c3183f4b9899 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:24:22.056576 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c18ea56-cfba-4952-826b-c3183f4b9899 None admin] PATH_INFO: `/v3/projects/28266b88667441a092efa71a2adb124b` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:24:22.057830 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c18ea56-cfba-4952-826b-c3183f4b9899 None admin] RBAC: Authorizing `identity:get_project(project_id=28266b88667441a092efa71a2adb124b)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:24:22.059416 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c18ea56-cfba-4952-826b-c3183f4b9899 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:24:22.061299 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 590/1199] 10.222.0.23 () {56 vars in 1186 bytes} [Tue May 10 05:24:21 2022] GET /identity/v3/projects/28266b88667441a092efa71a2adb124b => generated 361 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:24:22.067993 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84520dbe-ac12-438e-ab8a-829e7dc4711b None admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:24:22.162670 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84520dbe-ac12-438e-ab8a-829e7dc4711b None admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:24:22.211187 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49510381-40b9-47d1-bf73-03644b26c4f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:24:22.211859 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49510381-40b9-47d1-bf73-03644b26c4f6 None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:24:22.212142 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49510381-40b9-47d1-bf73-03644b26c4f6 None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:24:22.212418 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49510381-40b9-47d1-bf73-03644b26c4f6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:24:22.213256 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49510381-40b9-47d1-bf73-03644b26c4f6 None admin] RBAC: Adding query filter params (role.id=199ac1dd842441d7913c6ee89d8fbecc, scope.project.id=28266b88667441a092efa71a2adb124b, user.id=a5939192ecad4e508787374ab7ed8658) {{(pid=79879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:24:22.213567 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49510381-40b9-47d1-bf73-03644b26c4f6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:24:22.215007 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49510381-40b9-47d1-bf73-03644b26c4f6 None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:24:22.221181 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 610/1200] 10.222.0.23 () {56 vars in 1374 bytes} [Tue May 10 05:24:22 2022] GET /identity/v3/role_assignments?user.id=a5939192ecad4e508787374ab7ed8658&scope.project.id=28266b88667441a092efa71a2adb124b&role.id=199ac1dd842441d7913c6ee89d8fbecc => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:25:22.800372 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fd77a7-6e2e-4d55-86b8-113eb1267475 None None] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:25:22.801005 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fd77a7-6e2e-4d55-86b8-113eb1267475 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:25:22.801005 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fd77a7-6e2e-4d55-86b8-113eb1267475 None None] PATH_INFO: `/` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:25:22.802637 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 591/1201] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 10 05:25:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 05:25:22.808562 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd623ed-4518-4802-abdc-058fab139385 None None] REQUEST_METHOD: `POST` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:25:22.809055 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd623ed-4518-4802-abdc-058fab139385 None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:25:22.809169 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd623ed-4518-4802-abdc-058fab139385 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:25:22.826657 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.auth.core [None req-8dd623ed-4518-4802-abdc-058fab139385 None None] MFA Rules not processed for user `44883b22532e44049d846938dc2cf423`. Rule list: `[]` (Enabled: `True`). {{(pid=79879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:25:22.827873 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-8dd623ed-4518-4802-abdc-058fab139385 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:25:22.907432 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 611/1202] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 10 05:25:22 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 05:25:22.936793 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fd77a7-6e2e-4d55-86b8-113eb1267475 None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:25:23.056382 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fd77a7-6e2e-4d55-86b8-113eb1267475 None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:25:23.102570 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20395f4c-05f9-4902-ab89-ca194580e33e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:25:23.103797 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20395f4c-05f9-4902-ab89-ca194580e33e None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:25:23.104127 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20395f4c-05f9-4902-ab89-ca194580e33e None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:25:23.104518 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20395f4c-05f9-4902-ab89-ca194580e33e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:25:23.117012 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20395f4c-05f9-4902-ab89-ca194580e33e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:25:23.118477 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20395f4c-05f9-4902-ab89-ca194580e33e None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:25:23.137411 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application [None req-20395f4c-05f9-4902-ab89-ca194580e33e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 05:25:23.137411 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 05:25:23.137411 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 05:25:23.137411 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 05:25:23.137411 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 05:25:23.137411 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 05:25:23.137411 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 05:25:23.137411 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 05:25:23.137411 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 05:25:23.137411 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 05:25:23.137411 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 05:25:23.137411 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 05:25:23.137411 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 05:25:23.137411 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 05:25:23.137411 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 05:25:23.138648 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 05:25:23.138648 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 05:25:23.138648 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 05:25:23.138648 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 05:25:23.138648 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 05:25:23.138648 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 05:25:23.138648 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.get_or_create( May 10 05:25:23.138648 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 05:25:23.138648 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application with Lock( May 10 05:25:23.138648 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 05:25:23.138648 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._enter() May 10 05:25:23.138648 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 05:25:23.138648 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 05:25:23.138648 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 05:25:23.138648 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.creator() May 10 05:25:23.138648 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 05:25:23.138648 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application created_value = creator( May 10 05:25:23.139686 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 05:25:23.139686 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 05:25:23.139686 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 05:25:23.139686 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application May 10 05:25:23.139686 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 592/1203] 10.222.0.23 () {56 vars in 1108 bytes} [Tue May 10 05:25:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 05:25:23.147349 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd623ed-4518-4802-abdc-058fab139385 None None] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:25:23.261140 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd623ed-4518-4802-abdc-058fab139385 None None] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:25:23.304875 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10aeef6-5301-4d13-99bd-ab2c88dbe78a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:25:23.305632 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10aeef6-5301-4d13-99bd-ab2c88dbe78a None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:25:23.305919 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10aeef6-5301-4d13-99bd-ab2c88dbe78a None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:25:23.306240 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10aeef6-5301-4d13-99bd-ab2c88dbe78a None admin] PATH_INFO: `/v3/domains` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:25:23.307109 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10aeef6-5301-4d13-99bd-ab2c88dbe78a None admin] RBAC: Adding query filter params (name=Default) {{(pid=79879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:25:23.307369 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10aeef6-5301-4d13-99bd-ab2c88dbe78a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:25:23.309105 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10aeef6-5301-4d13-99bd-ab2c88dbe78a None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:25:23.322127 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 612/1204] 10.222.0.23 () {56 vars in 1109 bytes} [Tue May 10 05:25:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:25:23.327681 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20395f4c-05f9-4902-ab89-ca194580e33e None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:25:23.434902 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20395f4c-05f9-4902-ab89-ca194580e33e None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:25:23.482478 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c017a859-1f95-4e25-aa49-89fd0b7fce69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:25:23.483664 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c017a859-1f95-4e25-aa49-89fd0b7fce69 None admin] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:25:23.484125 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c017a859-1f95-4e25-aa49-89fd0b7fce69 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:25:23.484558 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c017a859-1f95-4e25-aa49-89fd0b7fce69 None admin] PATH_INFO: `/v3/users` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:25:23.485457 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c017a859-1f95-4e25-aa49-89fd0b7fce69 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:25:23.487488 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c017a859-1f95-4e25-aa49-89fd0b7fce69 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:25:23.517323 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 593/1205] 10.222.0.23 () {60 vars in 1132 bytes} [Tue May 10 05:25:23 2022] POST /identity/v3/users => generated 251 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 05:25:25.939665 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f569154-115a-489a-806f-637dca51ec6b None None] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:25:25.940257 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f569154-115a-489a-806f-637dca51ec6b None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:25:25.940257 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f569154-115a-489a-806f-637dca51ec6b None None] PATH_INFO: `/` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:25:25.941632 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 613/1206] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 10 05:25:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 05:25:25.947458 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930163d2-4b7c-4198-b550-3982bdebce30 None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:25:25.947980 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930163d2-4b7c-4198-b550-3982bdebce30 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:25:25.948103 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930163d2-4b7c-4198-b550-3982bdebce30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:25:25.966382 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-930163d2-4b7c-4198-b550-3982bdebce30 None None] MFA Rules not processed for user `44883b22532e44049d846938dc2cf423`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:25:25.967749 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-930163d2-4b7c-4198-b550-3982bdebce30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:25:26.039098 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 594/1207] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 10 05:25:25 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 05:25:26.064850 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f569154-115a-489a-806f-637dca51ec6b None None] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:25:26.173610 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f569154-115a-489a-806f-637dca51ec6b None None] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:25:26.212891 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce290089-8aee-44a9-9c2c-3d1b54539992 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:25:26.213738 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce290089-8aee-44a9-9c2c-3d1b54539992 None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:25:26.213988 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce290089-8aee-44a9-9c2c-3d1b54539992 None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:25:26.214261 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce290089-8aee-44a9-9c2c-3d1b54539992 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:25:26.226104 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce290089-8aee-44a9-9c2c-3d1b54539992 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 05:25:26.234617 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application [None req-ce290089-8aee-44a9-9c2c-3d1b54539992 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 10 05:25:26.234617 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 05:25:26.234617 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 05:25:26.234617 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 05:25:26.234617 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 05:25:26.234617 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 05:25:26.234617 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 05:25:26.234617 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 05:25:26.234617 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 05:25:26.234617 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 05:25:26.234617 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 05:25:26.234617 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 05:25:26.234617 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 05:25:26.234617 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 05:25:26.234617 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 05:25:26.234617 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 05:25:26.235927 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 05:25:26.235927 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 05:25:26.235927 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 05:25:26.235927 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 05:25:26.235927 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 05:25:26.235927 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 05:25:26.235927 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 05:25:26.235927 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 05:25:26.235927 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 05:25:26.235927 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.get_or_create( May 10 05:25:26.235927 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 05:25:26.235927 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application with Lock( May 10 05:25:26.235927 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 05:25:26.235927 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self._enter() May 10 05:25:26.235927 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 05:25:26.235927 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 05:25:26.237029 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 05:25:26.237029 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.creator() May 10 05:25:26.237029 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 05:25:26.237029 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application created_value = creator( May 10 05:25:26.237029 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 05:25:26.237029 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 05:25:26.237029 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 05:25:26.237029 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 05:25:26.237029 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 05:25:26.237029 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 05:25:26.237029 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 10 05:25:26.237029 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application May 10 05:25:26.241099 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 614/1208] 10.222.0.23 () {56 vars in 1102 bytes} [Tue May 10 05:25:26 2022] GET /identity/v3/roles/service => generated 85 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 05:25:26.242391 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930163d2-4b7c-4198-b550-3982bdebce30 None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:25:26.358458 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930163d2-4b7c-4198-b550-3982bdebce30 None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:25:26.396080 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644c256d-2be7-45c7-b72d-01e8b88a59bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:25:26.397055 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644c256d-2be7-45c7-b72d-01e8b88a59bd None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:25:26.397492 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644c256d-2be7-45c7-b72d-01e8b88a59bd None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:25:26.397793 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644c256d-2be7-45c7-b72d-01e8b88a59bd None admin] PATH_INFO: `/v3/roles` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:25:26.398564 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644c256d-2be7-45c7-b72d-01e8b88a59bd None admin] RBAC: Adding query filter params (name=service) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:25:26.398870 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644c256d-2be7-45c7-b72d-01e8b88a59bd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:25:26.400269 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644c256d-2be7-45c7-b72d-01e8b88a59bd None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:25:26.414183 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 595/1209] 10.222.0.23 () {56 vars in 1103 bytes} [Tue May 10 05:25:26 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 05:25:26.415514 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce290089-8aee-44a9-9c2c-3d1b54539992 None admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:25:26.540533 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce290089-8aee-44a9-9c2c-3d1b54539992 None admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:25:26.586779 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c595c6-bd7d-4b9b-8170-5c3390962dcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:25:26.587626 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c595c6-bd7d-4b9b-8170-5c3390962dcf None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:25:26.587954 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c595c6-bd7d-4b9b-8170-5c3390962dcf None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:25:26.588183 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c595c6-bd7d-4b9b-8170-5c3390962dcf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:25:26.599801 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c595c6-bd7d-4b9b-8170-5c3390962dcf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:25:26.601684 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c595c6-bd7d-4b9b-8170-5c3390962dcf None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:25:26.621865 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application [None req-36c595c6-bd7d-4b9b-8170-5c3390962dcf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 05:25:26.621865 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 05:25:26.621865 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 05:25:26.621865 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 05:25:26.621865 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 05:25:26.621865 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 05:25:26.621865 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 05:25:26.621865 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 05:25:26.621865 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 05:25:26.621865 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 05:25:26.621865 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 05:25:26.621865 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 05:25:26.621865 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 05:25:26.621865 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 05:25:26.621865 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 05:25:26.623393 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 05:25:26.623393 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 05:25:26.623393 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 05:25:26.623393 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 05:25:26.623393 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 05:25:26.623393 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 05:25:26.623393 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.get_or_create( May 10 05:25:26.623393 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 05:25:26.623393 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application with Lock( May 10 05:25:26.623393 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 05:25:26.623393 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self._enter() May 10 05:25:26.623393 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 05:25:26.623393 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 05:25:26.623393 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 05:25:26.623393 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.creator() May 10 05:25:26.623393 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 05:25:26.623393 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application created_value = creator( May 10 05:25:26.629015 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 05:25:26.629015 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 05:25:26.629015 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 05:25:26.629015 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application May 10 05:25:26.629015 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 615/1210] 10.222.0.23 () {56 vars in 1108 bytes} [Tue May 10 05:25:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 05:25:26.630990 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644c256d-2be7-45c7-b72d-01e8b88a59bd None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:25:26.755147 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644c256d-2be7-45c7-b72d-01e8b88a59bd None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:25:26.801883 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700df13e-6bab-46d0-8ab9-67fbd395e224 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:25:26.802609 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700df13e-6bab-46d0-8ab9-67fbd395e224 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:25:26.802904 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700df13e-6bab-46d0-8ab9-67fbd395e224 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:25:26.803161 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700df13e-6bab-46d0-8ab9-67fbd395e224 None admin] PATH_INFO: `/v3/domains` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:25:26.804025 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700df13e-6bab-46d0-8ab9-67fbd395e224 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:25:26.804338 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700df13e-6bab-46d0-8ab9-67fbd395e224 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:25:26.805837 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700df13e-6bab-46d0-8ab9-67fbd395e224 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:25:26.824588 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 596/1211] 10.222.0.23 () {56 vars in 1109 bytes} [Tue May 10 05:25:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:25:26.826248 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c595c6-bd7d-4b9b-8170-5c3390962dcf None admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:25:26.933276 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c595c6-bd7d-4b9b-8170-5c3390962dcf None admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:25:26.969900 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64d001d-04c8-475d-bb76-3f7f334a209a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:25:26.970888 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64d001d-04c8-475d-bb76-3f7f334a209a None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:25:26.971257 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64d001d-04c8-475d-bb76-3f7f334a209a None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:25:26.971651 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64d001d-04c8-475d-bb76-3f7f334a209a None admin] PATH_INFO: `/v3/users/placement` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:25:26.980999 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64d001d-04c8-475d-bb76-3f7f334a209a None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:25:26.982568 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64d001d-04c8-475d-bb76-3f7f334a209a None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:25:26.999914 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application [None req-f64d001d-04c8-475d-bb76-3f7f334a209a None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 10 05:25:26.999914 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 05:25:26.999914 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 05:25:26.999914 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 05:25:26.999914 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 05:25:26.999914 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 05:25:26.999914 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 05:25:26.999914 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 05:25:26.999914 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 05:25:26.999914 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 05:25:26.999914 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 05:25:26.999914 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 05:25:26.999914 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 05:25:26.999914 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 05:25:26.999914 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 05:25:26.999914 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 05:25:27.001080 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 05:25:27.001080 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 05:25:27.001080 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 05:25:27.001080 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 05:25:27.001080 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 05:25:27.001080 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 05:25:27.001080 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 05:25:27.001080 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 05:25:27.001080 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 05:25:27.001080 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.get_or_create( May 10 05:25:27.001080 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 05:25:27.001080 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application with Lock( May 10 05:25:27.001080 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 05:25:27.001080 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self._enter() May 10 05:25:27.001080 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 05:25:27.001080 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 05:25:27.001080 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 05:25:27.001080 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.creator() May 10 05:25:27.007046 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 05:25:27.007046 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application created_value = creator( May 10 05:25:27.007046 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 05:25:27.007046 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 05:25:27.007046 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 05:25:27.007046 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 05:25:27.007046 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 05:25:27.007046 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 05:25:27.007046 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 10 05:25:27.007046 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application May 10 05:25:27.007046 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 616/1212] 10.222.0.23 () {56 vars in 1108 bytes} [Tue May 10 05:25:26 2022] GET /identity/v3/users/placement => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 05:25:27.007962 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700df13e-6bab-46d0-8ab9-67fbd395e224 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:25:27.121205 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700df13e-6bab-46d0-8ab9-67fbd395e224 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:25:27.156076 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fb4301-699f-4f59-9dca-e5586598beca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:25:27.156766 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fb4301-699f-4f59-9dca-e5586598beca None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:25:27.157047 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fb4301-699f-4f59-9dca-e5586598beca None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:25:27.157404 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fb4301-699f-4f59-9dca-e5586598beca None admin] PATH_INFO: `/v3/users` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:25:27.158263 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1fb4301-699f-4f59-9dca-e5586598beca None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:25:27.158573 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1fb4301-699f-4f59-9dca-e5586598beca None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:25:27.160095 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1fb4301-699f-4f59-9dca-e5586598beca None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:25:27.184575 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 597/1213] 10.222.0.23 () {56 vars in 1143 bytes} [Tue May 10 05:25:27 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:25:27.186370 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64d001d-04c8-475d-bb76-3f7f334a209a None admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:25:27.292974 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64d001d-04c8-475d-bb76-3f7f334a209a None admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:25:27.328351 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffede1b-7d07-45e5-888c-38c0d69caf2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:25:27.330235 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffede1b-7d07-45e5-888c-38c0d69caf2c None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:25:27.330235 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffede1b-7d07-45e5-888c-38c0d69caf2c None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:25:27.330235 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffede1b-7d07-45e5-888c-38c0d69caf2c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:25:27.402722 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffede1b-7d07-45e5-888c-38c0d69caf2c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:25:27.404378 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffede1b-7d07-45e5-888c-38c0d69caf2c None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:25:27.512189 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 617/1214] 10.222.0.23 () {58 vars in 1282 bytes} [Tue May 10 05:25:27 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 10 05:25:27.518037 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fb4301-699f-4f59-9dca-e5586598beca None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:25:27.630229 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fb4301-699f-4f59-9dca-e5586598beca None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:25:27.663218 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d5bdce-7117-4015-99f4-0f4f7150cb3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:25:27.664066 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d5bdce-7117-4015-99f4-0f4f7150cb3f None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:25:27.664349 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d5bdce-7117-4015-99f4-0f4f7150cb3f None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:25:27.664644 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d5bdce-7117-4015-99f4-0f4f7150cb3f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:25:27.676227 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d5bdce-7117-4015-99f4-0f4f7150cb3f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:25:27.677674 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d5bdce-7117-4015-99f4-0f4f7150cb3f None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:25:27.695978 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application [None req-81d5bdce-7117-4015-99f4-0f4f7150cb3f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 05:25:27.695978 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 05:25:27.695978 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 05:25:27.695978 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 05:25:27.695978 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 05:25:27.695978 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 05:25:27.695978 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 05:25:27.695978 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 05:25:27.695978 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 05:25:27.695978 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 05:25:27.695978 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 05:25:27.695978 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 05:25:27.695978 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 05:25:27.695978 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 05:25:27.695978 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 05:25:27.696952 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 05:25:27.696952 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 05:25:27.696952 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 05:25:27.696952 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 05:25:27.696952 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 05:25:27.696952 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 05:25:27.696952 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.get_or_create( May 10 05:25:27.696952 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 05:25:27.696952 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application with Lock( May 10 05:25:27.696952 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 05:25:27.696952 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._enter() May 10 05:25:27.696952 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 05:25:27.696952 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 05:25:27.696952 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 05:25:27.696952 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.creator() May 10 05:25:27.696952 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 05:25:27.696952 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application created_value = creator( May 10 05:25:27.697947 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 05:25:27.697947 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 05:25:27.697947 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 05:25:27.697947 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application May 10 05:25:27.697947 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 598/1215] 10.222.0.23 () {56 vars in 1108 bytes} [Tue May 10 05:25:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 05:25:27.705295 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffede1b-7d07-45e5-888c-38c0d69caf2c None admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:25:27.811607 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffede1b-7d07-45e5-888c-38c0d69caf2c None admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:25:27.851591 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e8acb8-3c3e-40bc-b6dd-e6b987599115 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:25:27.852460 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e8acb8-3c3e-40bc-b6dd-e6b987599115 None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:25:27.852829 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e8acb8-3c3e-40bc-b6dd-e6b987599115 None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:25:27.853185 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e8acb8-3c3e-40bc-b6dd-e6b987599115 None admin] PATH_INFO: `/v3/domains` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:25:27.853971 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e8acb8-3c3e-40bc-b6dd-e6b987599115 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:25:27.854398 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e8acb8-3c3e-40bc-b6dd-e6b987599115 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:25:27.856345 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e8acb8-3c3e-40bc-b6dd-e6b987599115 None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:25:27.870399 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 618/1216] 10.222.0.23 () {56 vars in 1109 bytes} [Tue May 10 05:25:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:25:27.876935 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d5bdce-7117-4015-99f4-0f4f7150cb3f None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:25:27.982633 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d5bdce-7117-4015-99f4-0f4f7150cb3f None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:25:28.017093 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef619169-a9a7-4ce2-bb10-78ee5d1c1686 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:25:28.018642 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef619169-a9a7-4ce2-bb10-78ee5d1c1686 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:25:28.019073 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef619169-a9a7-4ce2-bb10-78ee5d1c1686 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:25:28.019484 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef619169-a9a7-4ce2-bb10-78ee5d1c1686 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:25:28.026423 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef619169-a9a7-4ce2-bb10-78ee5d1c1686 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:25:28.028141 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef619169-a9a7-4ce2-bb10-78ee5d1c1686 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:25:28.045816 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application [None req-ef619169-a9a7-4ce2-bb10-78ee5d1c1686 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 05:25:28.045816 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 05:25:28.045816 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 05:25:28.045816 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 05:25:28.045816 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 05:25:28.045816 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 05:25:28.045816 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 05:25:28.045816 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 05:25:28.045816 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 05:25:28.045816 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 05:25:28.045816 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 05:25:28.045816 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 05:25:28.045816 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 05:25:28.045816 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 05:25:28.045816 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 05:25:28.046869 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 05:25:28.046869 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 05:25:28.046869 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 05:25:28.046869 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 05:25:28.046869 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 05:25:28.046869 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 05:25:28.046869 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.get_or_create( May 10 05:25:28.046869 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 05:25:28.046869 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application with Lock( May 10 05:25:28.046869 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 05:25:28.046869 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._enter() May 10 05:25:28.046869 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 05:25:28.046869 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 05:25:28.046869 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 05:25:28.046869 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.creator() May 10 05:25:28.046869 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 05:25:28.046869 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application created_value = creator( May 10 05:25:28.047845 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 05:25:28.047845 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 05:25:28.047845 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 05:25:28.047845 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 05:25:28.047845 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 05:25:28.047845 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 05:25:28.047845 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 05:25:28.047845 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application May 10 05:25:28.050755 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 599/1217] 10.222.0.23 () {56 vars in 1111 bytes} [Tue May 10 05:25:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 05:25:28.053368 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e8acb8-3c3e-40bc-b6dd-e6b987599115 None admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:25:28.155874 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e8acb8-3c3e-40bc-b6dd-e6b987599115 None admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:25:28.192161 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99debdb5-b500-4ffc-88a5-83d7adf9c88f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:25:28.193338 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99debdb5-b500-4ffc-88a5-83d7adf9c88f None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:25:28.193844 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99debdb5-b500-4ffc-88a5-83d7adf9c88f None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:25:28.194366 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99debdb5-b500-4ffc-88a5-83d7adf9c88f None admin] PATH_INFO: `/v3/projects` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:25:28.195421 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99debdb5-b500-4ffc-88a5-83d7adf9c88f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:25:28.196100 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99debdb5-b500-4ffc-88a5-83d7adf9c88f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:25:28.197967 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99debdb5-b500-4ffc-88a5-83d7adf9c88f None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:25:28.211848 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 619/1218] 10.222.0.23 () {56 vars in 1148 bytes} [Tue May 10 05:25:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 05:25:28.218057 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef619169-a9a7-4ce2-bb10-78ee5d1c1686 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:25:28.328574 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef619169-a9a7-4ce2-bb10-78ee5d1c1686 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:25:28.362726 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493452bc-d917-4d99-a5fe-7a721a041cd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:25:28.363562 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493452bc-d917-4d99-a5fe-7a721a041cd4 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:25:28.364035 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493452bc-d917-4d99-a5fe-7a721a041cd4 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:25:28.364515 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493452bc-d917-4d99-a5fe-7a721a041cd4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:25:28.365867 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493452bc-d917-4d99-a5fe-7a721a041cd4 None admin] RBAC: Adding query filter params (role.id=8a02b9040d1d4fccababc1eb4dac80e7, scope.project.id=5f23435f783540199d6dcfd0417c090e, user.id=67321ca3e5624273acd5b06264738000) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:25:28.366358 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493452bc-d917-4d99-a5fe-7a721a041cd4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:25:28.368277 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493452bc-d917-4d99-a5fe-7a721a041cd4 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:25:28.374609 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 600/1219] 10.222.0.23 () {56 vars in 1374 bytes} [Tue May 10 05:25:28 2022] GET /identity/v3/role_assignments?user.id=67321ca3e5624273acd5b06264738000&scope.project.id=5f23435f783540199d6dcfd0417c090e&role.id=8a02b9040d1d4fccababc1eb4dac80e7 => generated 259 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 05:25:30.998697 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c4fffa-1f3d-40f1-95af-ccf25098445f None None] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:25:30.999254 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c4fffa-1f3d-40f1-95af-ccf25098445f None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:25:30.999254 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c4fffa-1f3d-40f1-95af-ccf25098445f None None] PATH_INFO: `/` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:25:31.000771 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 620/1220] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 10 05:25:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 05:25:31.006514 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852877cf-eee9-49f0-8a11-ca164fc075d9 None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:25:31.006998 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852877cf-eee9-49f0-8a11-ca164fc075d9 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:25:31.007094 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852877cf-eee9-49f0-8a11-ca164fc075d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:25:31.023547 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-852877cf-eee9-49f0-8a11-ca164fc075d9 None None] MFA Rules not processed for user `44883b22532e44049d846938dc2cf423`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:25:31.024747 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-852877cf-eee9-49f0-8a11-ca164fc075d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:25:31.090831 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 601/1221] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 10 05:25:31 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 10 05:25:31.114102 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c4fffa-1f3d-40f1-95af-ccf25098445f None None] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:25:31.219598 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c4fffa-1f3d-40f1-95af-ccf25098445f None None] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:25:31.258323 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc94fec-4c86-41a6-8b8d-3ba36db1cf1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:25:31.259407 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc94fec-4c86-41a6-8b8d-3ba36db1cf1c None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:25:31.259887 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc94fec-4c86-41a6-8b8d-3ba36db1cf1c None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:25:31.260319 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc94fec-4c86-41a6-8b8d-3ba36db1cf1c None admin] PATH_INFO: `/v3/roles/service` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:25:31.273999 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc94fec-4c86-41a6-8b8d-3ba36db1cf1c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 05:25:31.281691 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application [None req-edc94fec-4c86-41a6-8b8d-3ba36db1cf1c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 10 05:25:31.281691 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 05:25:31.281691 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 05:25:31.281691 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 05:25:31.281691 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 05:25:31.281691 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 05:25:31.281691 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 05:25:31.281691 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 05:25:31.281691 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 05:25:31.281691 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 05:25:31.281691 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 05:25:31.281691 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 05:25:31.281691 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 05:25:31.281691 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 05:25:31.281691 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 05:25:31.281691 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 05:25:31.282915 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 05:25:31.282915 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 05:25:31.282915 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 05:25:31.282915 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 05:25:31.282915 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 05:25:31.282915 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 05:25:31.282915 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 05:25:31.282915 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 05:25:31.282915 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 05:25:31.282915 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.get_or_create( May 10 05:25:31.282915 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 05:25:31.282915 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application with Lock( May 10 05:25:31.282915 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 05:25:31.282915 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self._enter() May 10 05:25:31.282915 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 05:25:31.282915 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 05:25:31.285164 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 05:25:31.285164 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.creator() May 10 05:25:31.285164 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 05:25:31.285164 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application created_value = creator( May 10 05:25:31.285164 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 05:25:31.285164 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 05:25:31.285164 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 05:25:31.285164 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 05:25:31.285164 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 05:25:31.285164 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 05:25:31.285164 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 10 05:25:31.285164 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application May 10 05:25:31.285164 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 621/1222] 10.222.0.23 () {56 vars in 1102 bytes} [Tue May 10 05:25:31 2022] GET /identity/v3/roles/service => generated 85 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 05:25:31.289265 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852877cf-eee9-49f0-8a11-ca164fc075d9 None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:25:31.396182 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852877cf-eee9-49f0-8a11-ca164fc075d9 None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:25:31.429779 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47340c84-1723-4e52-adec-823426a7810d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:25:31.430636 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47340c84-1723-4e52-adec-823426a7810d None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:25:31.430947 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47340c84-1723-4e52-adec-823426a7810d None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:25:31.431255 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47340c84-1723-4e52-adec-823426a7810d None admin] PATH_INFO: `/v3/roles` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:25:31.432129 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47340c84-1723-4e52-adec-823426a7810d None admin] RBAC: Adding query filter params (name=service) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:25:31.432459 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47340c84-1723-4e52-adec-823426a7810d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:25:31.434034 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47340c84-1723-4e52-adec-823426a7810d None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:25:31.442728 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 602/1223] 10.222.0.23 () {56 vars in 1103 bytes} [Tue May 10 05:25:31 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:25:31.448762 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc94fec-4c86-41a6-8b8d-3ba36db1cf1c None admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:25:31.554141 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc94fec-4c86-41a6-8b8d-3ba36db1cf1c None admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:25:31.589796 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023c537f-5cd6-4d5b-b0af-b40d963d3ca0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:25:31.590624 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023c537f-5cd6-4d5b-b0af-b40d963d3ca0 None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:25:31.590881 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023c537f-5cd6-4d5b-b0af-b40d963d3ca0 None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:25:31.591143 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023c537f-5cd6-4d5b-b0af-b40d963d3ca0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:25:31.602032 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023c537f-5cd6-4d5b-b0af-b40d963d3ca0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:25:31.603491 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023c537f-5cd6-4d5b-b0af-b40d963d3ca0 None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:25:31.619892 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application [None req-023c537f-5cd6-4d5b-b0af-b40d963d3ca0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 05:25:31.619892 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 05:25:31.619892 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 05:25:31.619892 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 05:25:31.619892 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 05:25:31.619892 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 05:25:31.619892 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 05:25:31.619892 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 05:25:31.619892 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 05:25:31.619892 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 05:25:31.619892 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 05:25:31.619892 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 05:25:31.619892 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 05:25:31.619892 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 05:25:31.619892 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 05:25:31.621256 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 05:25:31.621256 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 05:25:31.621256 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 05:25:31.621256 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 05:25:31.621256 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 05:25:31.621256 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 05:25:31.621256 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.get_or_create( May 10 05:25:31.621256 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 05:25:31.621256 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application with Lock( May 10 05:25:31.621256 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 05:25:31.621256 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self._enter() May 10 05:25:31.621256 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 05:25:31.621256 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 05:25:31.621256 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 05:25:31.621256 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.creator() May 10 05:25:31.621256 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 05:25:31.621256 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application created_value = creator( May 10 05:25:31.623690 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 05:25:31.623690 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 05:25:31.623690 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 05:25:31.623690 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application May 10 05:25:31.623690 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 622/1224] 10.222.0.23 () {56 vars in 1108 bytes} [Tue May 10 05:25:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 05:25:31.627773 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47340c84-1723-4e52-adec-823426a7810d None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:25:31.730533 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47340c84-1723-4e52-adec-823426a7810d None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:25:31.767060 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd686dce-3f21-4186-82f1-8cd880018025 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:25:31.767833 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd686dce-3f21-4186-82f1-8cd880018025 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:25:31.768152 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd686dce-3f21-4186-82f1-8cd880018025 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:25:31.768444 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd686dce-3f21-4186-82f1-8cd880018025 None admin] PATH_INFO: `/v3/domains` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:25:31.769193 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd686dce-3f21-4186-82f1-8cd880018025 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:25:31.769515 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd686dce-3f21-4186-82f1-8cd880018025 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:25:31.770944 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd686dce-3f21-4186-82f1-8cd880018025 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:25:31.785292 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 603/1225] 10.222.0.23 () {56 vars in 1109 bytes} [Tue May 10 05:25:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:25:31.791448 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023c537f-5cd6-4d5b-b0af-b40d963d3ca0 None admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:25:31.895822 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023c537f-5cd6-4d5b-b0af-b40d963d3ca0 None admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:25:31.930448 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff009f2f-c2ad-41d6-8772-a099ec301d25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:25:31.931346 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff009f2f-c2ad-41d6-8772-a099ec301d25 None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:25:31.931707 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff009f2f-c2ad-41d6-8772-a099ec301d25 None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:25:31.931994 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff009f2f-c2ad-41d6-8772-a099ec301d25 None admin] PATH_INFO: `/v3/users/placement` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:25:31.940798 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff009f2f-c2ad-41d6-8772-a099ec301d25 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:25:31.942472 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff009f2f-c2ad-41d6-8772-a099ec301d25 None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:25:31.957361 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application [None req-ff009f2f-c2ad-41d6-8772-a099ec301d25 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 10 05:25:31.957361 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 05:25:31.957361 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 05:25:31.957361 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 05:25:31.957361 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 05:25:31.957361 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 05:25:31.957361 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 05:25:31.957361 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 05:25:31.957361 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 05:25:31.957361 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 05:25:31.957361 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 05:25:31.957361 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 05:25:31.957361 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 05:25:31.957361 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 05:25:31.957361 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 05:25:31.957361 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 05:25:31.958640 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 05:25:31.958640 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 05:25:31.958640 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 05:25:31.958640 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 05:25:31.958640 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 05:25:31.958640 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 05:25:31.958640 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 05:25:31.958640 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 05:25:31.958640 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 05:25:31.958640 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.get_or_create( May 10 05:25:31.958640 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 05:25:31.958640 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application with Lock( May 10 05:25:31.958640 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 05:25:31.958640 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self._enter() May 10 05:25:31.958640 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 05:25:31.958640 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 05:25:31.958640 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 05:25:31.958640 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.creator() May 10 05:25:31.959897 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 05:25:31.959897 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application created_value = creator( May 10 05:25:31.959897 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 05:25:31.959897 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 05:25:31.959897 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 05:25:31.959897 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 05:25:31.959897 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 05:25:31.959897 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 05:25:31.959897 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 10 05:25:31.959897 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application May 10 05:25:31.963431 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 623/1226] 10.222.0.23 () {56 vars in 1108 bytes} [Tue May 10 05:25:31 2022] GET /identity/v3/users/placement => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 05:25:31.964370 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd686dce-3f21-4186-82f1-8cd880018025 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:25:32.066347 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd686dce-3f21-4186-82f1-8cd880018025 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:25:32.099386 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5138ce24-a21e-4732-a984-030585b8c93e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:25:32.100103 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5138ce24-a21e-4732-a984-030585b8c93e None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:25:32.100372 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5138ce24-a21e-4732-a984-030585b8c93e None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:25:32.100641 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5138ce24-a21e-4732-a984-030585b8c93e None admin] PATH_INFO: `/v3/users` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:25:32.101595 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5138ce24-a21e-4732-a984-030585b8c93e None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:25:32.101820 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5138ce24-a21e-4732-a984-030585b8c93e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:25:32.103264 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5138ce24-a21e-4732-a984-030585b8c93e None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:25:32.121413 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 604/1227] 10.222.0.23 () {56 vars in 1143 bytes} [Tue May 10 05:25:31 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 05:25:32.128073 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff009f2f-c2ad-41d6-8772-a099ec301d25 None admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:25:32.239895 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff009f2f-c2ad-41d6-8772-a099ec301d25 None admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:25:32.274853 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c4e440-7e30-4442-888f-b884b61498b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:25:32.275659 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c4e440-7e30-4442-888f-b884b61498b5 None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:25:32.275934 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c4e440-7e30-4442-888f-b884b61498b5 None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:25:32.276200 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c4e440-7e30-4442-888f-b884b61498b5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:25:32.287491 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c4e440-7e30-4442-888f-b884b61498b5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:25:32.289049 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c4e440-7e30-4442-888f-b884b61498b5 None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:25:32.306394 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application [None req-64c4e440-7e30-4442-888f-b884b61498b5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 05:25:32.306394 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 05:25:32.306394 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 05:25:32.306394 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 05:25:32.306394 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 05:25:32.306394 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 05:25:32.306394 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 05:25:32.306394 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 05:25:32.306394 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 05:25:32.306394 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 05:25:32.306394 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 05:25:32.306394 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 05:25:32.306394 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 05:25:32.306394 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 05:25:32.306394 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 05:25:32.307502 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 05:25:32.307502 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 05:25:32.307502 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 05:25:32.307502 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 05:25:32.307502 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 05:25:32.307502 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 05:25:32.307502 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.get_or_create( May 10 05:25:32.307502 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 05:25:32.307502 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application with Lock( May 10 05:25:32.307502 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 05:25:32.307502 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self._enter() May 10 05:25:32.307502 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 05:25:32.307502 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 05:25:32.307502 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 05:25:32.307502 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.creator() May 10 05:25:32.307502 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 05:25:32.307502 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application created_value = creator( May 10 05:25:32.313229 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 05:25:32.313229 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 05:25:32.313229 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 05:25:32.313229 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application May 10 05:25:32.313229 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 624/1228] 10.222.0.23 () {56 vars in 1108 bytes} [Tue May 10 05:25:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 05:25:32.313584 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5138ce24-a21e-4732-a984-030585b8c93e None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:25:32.417347 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5138ce24-a21e-4732-a984-030585b8c93e None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:25:32.451262 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bce2a4-3967-49f3-b461-fcbed24eccf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:25:32.451962 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bce2a4-3967-49f3-b461-fcbed24eccf0 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:25:32.452240 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bce2a4-3967-49f3-b461-fcbed24eccf0 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:25:32.452510 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bce2a4-3967-49f3-b461-fcbed24eccf0 None admin] PATH_INFO: `/v3/domains` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:25:32.453233 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05bce2a4-3967-49f3-b461-fcbed24eccf0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:25:32.453534 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05bce2a4-3967-49f3-b461-fcbed24eccf0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:25:32.454901 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05bce2a4-3967-49f3-b461-fcbed24eccf0 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:25:32.468655 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 605/1229] 10.222.0.23 () {56 vars in 1109 bytes} [Tue May 10 05:25:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 05:25:32.474215 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c4e440-7e30-4442-888f-b884b61498b5 None admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:25:32.572354 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c4e440-7e30-4442-888f-b884b61498b5 None admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:25:32.605932 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bbec98-0989-42ba-8b81-8ee4881701cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:25:32.606731 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bbec98-0989-42ba-8b81-8ee4881701cf None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:25:32.607010 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bbec98-0989-42ba-8b81-8ee4881701cf None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:25:32.607277 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bbec98-0989-42ba-8b81-8ee4881701cf None admin] PATH_INFO: `/v3/projects/service` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:25:32.613941 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24bbec98-0989-42ba-8b81-8ee4881701cf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:25:32.615394 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24bbec98-0989-42ba-8b81-8ee4881701cf None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:25:32.629695 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application [None req-24bbec98-0989-42ba-8b81-8ee4881701cf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 05:25:32.629695 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 05:25:32.629695 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 05:25:32.629695 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 05:25:32.629695 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 05:25:32.629695 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 05:25:32.629695 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 05:25:32.629695 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 05:25:32.629695 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 05:25:32.629695 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 05:25:32.629695 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 05:25:32.629695 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 05:25:32.629695 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 05:25:32.629695 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 05:25:32.629695 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 05:25:32.630747 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 05:25:32.630747 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 05:25:32.630747 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 05:25:32.630747 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 05:25:32.630747 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 05:25:32.630747 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 05:25:32.630747 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.get_or_create( May 10 05:25:32.630747 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 05:25:32.630747 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application with Lock( May 10 05:25:32.630747 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 05:25:32.630747 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self._enter() May 10 05:25:32.630747 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 05:25:32.630747 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 05:25:32.630747 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 05:25:32.630747 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.creator() May 10 05:25:32.630747 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 05:25:32.630747 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application created_value = creator( May 10 05:25:32.631733 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 05:25:32.631733 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 05:25:32.631733 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 05:25:32.631733 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 05:25:32.631733 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 05:25:32.631733 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 05:25:32.631733 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 05:25:32.631733 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application May 10 05:25:32.631733 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 625/1230] 10.222.0.23 () {56 vars in 1111 bytes} [Tue May 10 05:25:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 05:25:32.636977 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bce2a4-3967-49f3-b461-fcbed24eccf0 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:25:32.736939 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bce2a4-3967-49f3-b461-fcbed24eccf0 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:25:32.776306 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618374c9-b4da-47a3-92e8-8158af3af34b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:25:32.777179 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618374c9-b4da-47a3-92e8-8158af3af34b None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:25:32.777814 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618374c9-b4da-47a3-92e8-8158af3af34b None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:25:32.778165 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618374c9-b4da-47a3-92e8-8158af3af34b None admin] PATH_INFO: `/v3/projects` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:25:32.779236 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618374c9-b4da-47a3-92e8-8158af3af34b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:25:32.779707 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618374c9-b4da-47a3-92e8-8158af3af34b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:25:32.781890 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618374c9-b4da-47a3-92e8-8158af3af34b None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:25:32.799117 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 606/1231] 10.222.0.23 () {56 vars in 1148 bytes} [Tue May 10 05:25:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 05:25:32.805291 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bbec98-0989-42ba-8b81-8ee4881701cf None admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:25:32.911455 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bbec98-0989-42ba-8b81-8ee4881701cf None admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:25:32.948612 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7d362f-f11f-49da-bd32-652c7880f8e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:25:32.949508 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7d362f-f11f-49da-bd32-652c7880f8e0 None admin] REQUEST_METHOD: `PUT` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:25:32.949777 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7d362f-f11f-49da-bd32-652c7880f8e0 None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:25:32.950045 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7d362f-f11f-49da-bd32-652c7880f8e0 None admin] PATH_INFO: `/v3/projects/5f23435f783540199d6dcfd0417c090e/users/67321ca3e5624273acd5b06264738000/roles/8a02b9040d1d4fccababc1eb4dac80e7` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:25:32.964219 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7d362f-f11f-49da-bd32-652c7880f8e0 None admin] RBAC: Authorizing `identity:create_grant(project_id=5f23435f783540199d6dcfd0417c090e, user_id=67321ca3e5624273acd5b06264738000, role_id=8a02b9040d1d4fccababc1eb4dac80e7)` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:25:32.965696 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7d362f-f11f-49da-bd32-652c7880f8e0 None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:25:32.977954 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 626/1232] 10.222.0.23 () {58 vars in 1439 bytes} [Tue May 10 05:25:32 2022] PUT /identity/v3/projects/5f23435f783540199d6dcfd0417c090e/users/67321ca3e5624273acd5b06264738000/roles/8a02b9040d1d4fccababc1eb4dac80e7 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 05:25:35.295442 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e561d96d-5220-4e2c-9364-f6864186dc8e None None] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:25:35.296034 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e561d96d-5220-4e2c-9364-f6864186dc8e None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:25:35.296150 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e561d96d-5220-4e2c-9364-f6864186dc8e None None] PATH_INFO: `/` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:25:35.297619 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 607/1233] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 10 05:25:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 05:25:35.305286 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb56d7e3-4e82-42f2-b1b4-6f8486c9de2e None None] REQUEST_METHOD: `POST` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:25:35.305797 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb56d7e3-4e82-42f2-b1b4-6f8486c9de2e None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:25:35.305797 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb56d7e3-4e82-42f2-b1b4-6f8486c9de2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:25:35.322799 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.auth.core [None req-fb56d7e3-4e82-42f2-b1b4-6f8486c9de2e None None] MFA Rules not processed for user `44883b22532e44049d846938dc2cf423`. Rule list: `[]` (Enabled: `True`). {{(pid=79879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:25:35.324036 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-fb56d7e3-4e82-42f2-b1b4-6f8486c9de2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:25:35.398309 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 627/1234] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 10 05:25:35 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 05:25:35.421355 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e561d96d-5220-4e2c-9364-f6864186dc8e None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:25:35.520519 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e561d96d-5220-4e2c-9364-f6864186dc8e None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:25:35.555899 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce25816-40ea-44c9-88bc-b3c2eab9a98c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:25:35.557005 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce25816-40ea-44c9-88bc-b3c2eab9a98c None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:25:35.557496 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce25816-40ea-44c9-88bc-b3c2eab9a98c None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:25:35.557785 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce25816-40ea-44c9-88bc-b3c2eab9a98c None admin] PATH_INFO: `/v3/roles/service` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:25:35.569361 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce25816-40ea-44c9-88bc-b3c2eab9a98c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 05:25:35.577036 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application [None req-7ce25816-40ea-44c9-88bc-b3c2eab9a98c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 10 05:25:35.577036 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 05:25:35.577036 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 05:25:35.577036 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 05:25:35.577036 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 05:25:35.577036 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 05:25:35.577036 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 05:25:35.577036 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 05:25:35.577036 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 05:25:35.577036 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 05:25:35.577036 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 05:25:35.577036 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 05:25:35.577036 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 05:25:35.577036 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 05:25:35.577036 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 05:25:35.577036 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 05:25:35.578178 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 05:25:35.578178 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 05:25:35.578178 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 05:25:35.578178 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 05:25:35.578178 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 05:25:35.578178 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 05:25:35.578178 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 05:25:35.578178 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 05:25:35.578178 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 05:25:35.578178 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.get_or_create( May 10 05:25:35.578178 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 05:25:35.578178 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application with Lock( May 10 05:25:35.578178 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 05:25:35.578178 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._enter() May 10 05:25:35.578178 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 05:25:35.578178 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 05:25:35.579228 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 05:25:35.579228 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.creator() May 10 05:25:35.579228 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 05:25:35.579228 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application created_value = creator( May 10 05:25:35.579228 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 05:25:35.579228 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 05:25:35.579228 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 05:25:35.579228 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 05:25:35.579228 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 05:25:35.579228 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 05:25:35.579228 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 10 05:25:35.579228 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application May 10 05:25:35.579228 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 608/1235] 10.222.0.23 () {56 vars in 1102 bytes} [Tue May 10 05:25:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 05:25:35.589713 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb56d7e3-4e82-42f2-b1b4-6f8486c9de2e None None] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:25:35.697898 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb56d7e3-4e82-42f2-b1b4-6f8486c9de2e None None] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:25:35.736050 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8713f0ce-a7f4-4857-920b-566e80df69fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:25:35.736856 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8713f0ce-a7f4-4857-920b-566e80df69fa None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:25:35.737236 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8713f0ce-a7f4-4857-920b-566e80df69fa None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:25:35.737598 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8713f0ce-a7f4-4857-920b-566e80df69fa None admin] PATH_INFO: `/v3/roles` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:25:35.738478 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8713f0ce-a7f4-4857-920b-566e80df69fa None admin] RBAC: Adding query filter params (name=service) {{(pid=79879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:25:35.738837 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8713f0ce-a7f4-4857-920b-566e80df69fa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:25:35.740487 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8713f0ce-a7f4-4857-920b-566e80df69fa None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:25:35.750250 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 628/1236] 10.222.0.23 () {56 vars in 1103 bytes} [Tue May 10 05:25:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:25:35.756284 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce25816-40ea-44c9-88bc-b3c2eab9a98c None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:25:35.868489 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce25816-40ea-44c9-88bc-b3c2eab9a98c None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:25:35.908042 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1342de-2f66-428b-901c-e334d9605811 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:25:35.908814 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1342de-2f66-428b-901c-e334d9605811 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:25:35.909093 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1342de-2f66-428b-901c-e334d9605811 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:25:35.909368 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1342de-2f66-428b-901c-e334d9605811 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:25:35.920459 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1342de-2f66-428b-901c-e334d9605811 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:25:35.922191 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1342de-2f66-428b-901c-e334d9605811 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:25:35.939235 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application [None req-9c1342de-2f66-428b-901c-e334d9605811 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 05:25:35.939235 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 05:25:35.939235 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 05:25:35.939235 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 05:25:35.939235 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 05:25:35.939235 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 05:25:35.939235 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 05:25:35.939235 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 05:25:35.939235 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 05:25:35.939235 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 05:25:35.939235 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 05:25:35.939235 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 05:25:35.939235 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 05:25:35.939235 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 05:25:35.939235 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 05:25:35.940470 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 05:25:35.940470 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 05:25:35.940470 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 05:25:35.940470 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 05:25:35.940470 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 05:25:35.940470 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 05:25:35.940470 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.get_or_create( May 10 05:25:35.940470 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 05:25:35.940470 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application with Lock( May 10 05:25:35.940470 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 05:25:35.940470 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._enter() May 10 05:25:35.940470 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 05:25:35.940470 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 05:25:35.940470 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 05:25:35.940470 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.creator() May 10 05:25:35.940470 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 05:25:35.940470 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application created_value = creator( May 10 05:25:35.941738 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 05:25:35.941738 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 05:25:35.941738 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 05:25:35.941738 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application May 10 05:25:35.941738 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 609/1237] 10.222.0.23 () {56 vars in 1108 bytes} [Tue May 10 05:25:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 05:25:35.946487 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8713f0ce-a7f4-4857-920b-566e80df69fa None admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:25:36.049565 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8713f0ce-a7f4-4857-920b-566e80df69fa None admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:25:36.085413 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8f2c58-1b34-45ea-9e7e-a2172f25caf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:25:36.086180 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8f2c58-1b34-45ea-9e7e-a2172f25caf1 None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:25:36.086464 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8f2c58-1b34-45ea-9e7e-a2172f25caf1 None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:25:36.086790 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8f2c58-1b34-45ea-9e7e-a2172f25caf1 None admin] PATH_INFO: `/v3/domains` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:25:36.087548 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8f2c58-1b34-45ea-9e7e-a2172f25caf1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:25:36.087882 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8f2c58-1b34-45ea-9e7e-a2172f25caf1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:25:36.089545 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8f2c58-1b34-45ea-9e7e-a2172f25caf1 None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:25:36.102171 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 629/1238] 10.222.0.23 () {56 vars in 1109 bytes} [Tue May 10 05:25:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 05:25:36.108601 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1342de-2f66-428b-901c-e334d9605811 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:25:36.218169 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1342de-2f66-428b-901c-e334d9605811 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:25:36.257197 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1208b2-33bb-4f36-b448-b7f249d73db3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:25:36.258012 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1208b2-33bb-4f36-b448-b7f249d73db3 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:25:36.258287 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1208b2-33bb-4f36-b448-b7f249d73db3 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:25:36.258605 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1208b2-33bb-4f36-b448-b7f249d73db3 None admin] PATH_INFO: `/v3/users/placement` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:25:36.266819 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1208b2-33bb-4f36-b448-b7f249d73db3 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:25:36.268428 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1208b2-33bb-4f36-b448-b7f249d73db3 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:25:36.285134 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application [None req-db1208b2-33bb-4f36-b448-b7f249d73db3 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 10 05:25:36.285134 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 05:25:36.285134 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 05:25:36.285134 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 05:25:36.285134 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 05:25:36.285134 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 05:25:36.285134 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 05:25:36.285134 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 05:25:36.285134 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 05:25:36.285134 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 05:25:36.285134 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 05:25:36.285134 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 05:25:36.285134 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 05:25:36.285134 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 05:25:36.285134 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 05:25:36.285134 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 05:25:36.286216 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 05:25:36.286216 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 05:25:36.286216 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 05:25:36.286216 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 05:25:36.286216 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 05:25:36.286216 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 05:25:36.286216 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 05:25:36.286216 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 05:25:36.286216 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 05:25:36.286216 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.get_or_create( May 10 05:25:36.286216 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 05:25:36.286216 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application with Lock( May 10 05:25:36.286216 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 05:25:36.286216 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._enter() May 10 05:25:36.286216 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 05:25:36.286216 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 05:25:36.286216 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 05:25:36.286216 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.creator() May 10 05:25:36.287227 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 05:25:36.287227 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application created_value = creator( May 10 05:25:36.287227 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 05:25:36.287227 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 05:25:36.287227 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 05:25:36.287227 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 05:25:36.287227 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 05:25:36.287227 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 05:25:36.287227 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 10 05:25:36.287227 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application May 10 05:25:36.291336 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 610/1239] 10.222.0.23 () {56 vars in 1108 bytes} [Tue May 10 05:25:36 2022] GET /identity/v3/users/placement => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 05:25:36.292291 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8f2c58-1b34-45ea-9e7e-a2172f25caf1 None admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:25:36.401683 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8f2c58-1b34-45ea-9e7e-a2172f25caf1 None admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:25:36.437280 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db42b601-8cd0-45d8-a567-c80f0fab5767 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:25:36.437956 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db42b601-8cd0-45d8-a567-c80f0fab5767 None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:25:36.438236 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db42b601-8cd0-45d8-a567-c80f0fab5767 None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:25:36.438512 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db42b601-8cd0-45d8-a567-c80f0fab5767 None admin] PATH_INFO: `/v3/users` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:25:36.439359 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db42b601-8cd0-45d8-a567-c80f0fab5767 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:25:36.439696 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db42b601-8cd0-45d8-a567-c80f0fab5767 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:25:36.441183 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db42b601-8cd0-45d8-a567-c80f0fab5767 None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:25:36.458275 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 630/1240] 10.222.0.23 () {56 vars in 1143 bytes} [Tue May 10 05:25:36 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 05:25:36.464246 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1208b2-33bb-4f36-b448-b7f249d73db3 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:25:36.571719 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1208b2-33bb-4f36-b448-b7f249d73db3 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:25:36.609230 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88eb85d-7b50-4230-9eae-186c3e5697e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:25:36.609898 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88eb85d-7b50-4230-9eae-186c3e5697e0 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:25:36.610176 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88eb85d-7b50-4230-9eae-186c3e5697e0 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:25:36.610446 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88eb85d-7b50-4230-9eae-186c3e5697e0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:25:36.690370 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88eb85d-7b50-4230-9eae-186c3e5697e0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:25:36.691881 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88eb85d-7b50-4230-9eae-186c3e5697e0 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:25:36.800851 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 611/1241] 10.222.0.23 () {58 vars in 1282 bytes} [Tue May 10 05:25:36 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 10 05:25:36.802116 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db42b601-8cd0-45d8-a567-c80f0fab5767 None admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:25:36.909795 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db42b601-8cd0-45d8-a567-c80f0fab5767 None admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:25:36.946803 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bdbd47-d17d-48a9-b1d8-ea0a760425f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:25:36.947640 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bdbd47-d17d-48a9-b1d8-ea0a760425f4 None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:25:36.947952 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bdbd47-d17d-48a9-b1d8-ea0a760425f4 None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:25:36.948224 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bdbd47-d17d-48a9-b1d8-ea0a760425f4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:25:36.957956 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57bdbd47-d17d-48a9-b1d8-ea0a760425f4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:25:36.959399 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57bdbd47-d17d-48a9-b1d8-ea0a760425f4 None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:25:36.976553 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application [None req-57bdbd47-d17d-48a9-b1d8-ea0a760425f4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 05:25:36.976553 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 05:25:36.976553 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 05:25:36.976553 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 05:25:36.976553 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 05:25:36.976553 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 05:25:36.976553 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 05:25:36.976553 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 05:25:36.976553 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 05:25:36.976553 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 05:25:36.976553 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 05:25:36.976553 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 05:25:36.976553 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 05:25:36.976553 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 05:25:36.976553 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 05:25:36.977933 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 05:25:36.977933 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 05:25:36.977933 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 05:25:36.977933 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 05:25:36.977933 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 05:25:36.977933 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 05:25:36.977933 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.get_or_create( May 10 05:25:36.977933 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 05:25:36.977933 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application with Lock( May 10 05:25:36.977933 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 05:25:36.977933 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self._enter() May 10 05:25:36.977933 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 05:25:36.977933 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 05:25:36.977933 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 05:25:36.977933 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.creator() May 10 05:25:36.977933 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 05:25:36.977933 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application created_value = creator( May 10 05:25:36.979033 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 05:25:36.979033 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 05:25:36.979033 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 05:25:36.979033 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application May 10 05:25:36.979033 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 631/1242] 10.222.0.23 () {56 vars in 1108 bytes} [Tue May 10 05:25:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 05:25:36.983792 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88eb85d-7b50-4230-9eae-186c3e5697e0 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:25:37.083564 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88eb85d-7b50-4230-9eae-186c3e5697e0 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:25:37.118624 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edb1021-8b25-487d-83fd-0b2468dee5b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:25:37.119500 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edb1021-8b25-487d-83fd-0b2468dee5b8 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:25:37.119856 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edb1021-8b25-487d-83fd-0b2468dee5b8 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:25:37.120205 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edb1021-8b25-487d-83fd-0b2468dee5b8 None admin] PATH_INFO: `/v3/domains` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:25:37.121235 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4edb1021-8b25-487d-83fd-0b2468dee5b8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:25:37.121604 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4edb1021-8b25-487d-83fd-0b2468dee5b8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:25:37.123471 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4edb1021-8b25-487d-83fd-0b2468dee5b8 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:25:37.140260 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 612/1243] 10.222.0.23 () {56 vars in 1109 bytes} [Tue May 10 05:25:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:25:37.142719 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bdbd47-d17d-48a9-b1d8-ea0a760425f4 None admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:25:37.242105 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bdbd47-d17d-48a9-b1d8-ea0a760425f4 None admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:25:37.282222 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c124c45-5928-4392-9cad-d93d69ee145a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:25:37.283098 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c124c45-5928-4392-9cad-d93d69ee145a None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:25:37.283390 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c124c45-5928-4392-9cad-d93d69ee145a None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:25:37.283740 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c124c45-5928-4392-9cad-d93d69ee145a None admin] PATH_INFO: `/v3/projects/service` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:25:37.290856 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c124c45-5928-4392-9cad-d93d69ee145a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:25:37.292408 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c124c45-5928-4392-9cad-d93d69ee145a None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:25:37.306950 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application [None req-8c124c45-5928-4392-9cad-d93d69ee145a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 05:25:37.306950 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 05:25:37.306950 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 05:25:37.306950 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 05:25:37.306950 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 05:25:37.306950 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 05:25:37.306950 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 05:25:37.306950 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 05:25:37.306950 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 05:25:37.306950 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 05:25:37.306950 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 05:25:37.306950 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 05:25:37.306950 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 05:25:37.306950 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 05:25:37.306950 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 05:25:37.308130 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 05:25:37.308130 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 05:25:37.308130 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 05:25:37.308130 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 05:25:37.308130 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 05:25:37.308130 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 05:25:37.308130 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.get_or_create( May 10 05:25:37.308130 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 05:25:37.308130 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application with Lock( May 10 05:25:37.308130 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 05:25:37.308130 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self._enter() May 10 05:25:37.308130 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 05:25:37.308130 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 05:25:37.308130 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 05:25:37.308130 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.creator() May 10 05:25:37.308130 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 05:25:37.308130 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application created_value = creator( May 10 05:25:37.309433 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 05:25:37.309433 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 05:25:37.309433 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 05:25:37.309433 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 05:25:37.309433 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 05:25:37.309433 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 05:25:37.309433 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 05:25:37.309433 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application May 10 05:25:37.309433 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 632/1244] 10.222.0.23 () {56 vars in 1111 bytes} [Tue May 10 05:25:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 05:25:37.314345 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edb1021-8b25-487d-83fd-0b2468dee5b8 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:25:37.422842 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edb1021-8b25-487d-83fd-0b2468dee5b8 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:25:37.457955 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cb0f42-63e8-4921-b26a-e7a2ed5de839 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:25:37.458598 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cb0f42-63e8-4921-b26a-e7a2ed5de839 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:25:37.458876 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cb0f42-63e8-4921-b26a-e7a2ed5de839 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:25:37.459147 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cb0f42-63e8-4921-b26a-e7a2ed5de839 None admin] PATH_INFO: `/v3/projects` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:25:37.459969 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02cb0f42-63e8-4921-b26a-e7a2ed5de839 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:25:37.460273 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02cb0f42-63e8-4921-b26a-e7a2ed5de839 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:25:37.461698 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02cb0f42-63e8-4921-b26a-e7a2ed5de839 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:25:37.474950 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 613/1245] 10.222.0.23 () {56 vars in 1148 bytes} [Tue May 10 05:25:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:25:37.481307 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c124c45-5928-4392-9cad-d93d69ee145a None admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:25:37.582127 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c124c45-5928-4392-9cad-d93d69ee145a None admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:25:37.620383 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ed3610-0159-4a9c-a713-6f6f611f6144 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:25:37.621041 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ed3610-0159-4a9c-a713-6f6f611f6144 None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:25:37.621320 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ed3610-0159-4a9c-a713-6f6f611f6144 None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:25:37.621593 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ed3610-0159-4a9c-a713-6f6f611f6144 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:25:37.622431 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ed3610-0159-4a9c-a713-6f6f611f6144 None admin] RBAC: Adding query filter params (role.id=8a02b9040d1d4fccababc1eb4dac80e7, scope.project.id=5f23435f783540199d6dcfd0417c090e, user.id=67321ca3e5624273acd5b06264738000) {{(pid=79879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:25:37.622742 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ed3610-0159-4a9c-a713-6f6f611f6144 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:25:37.624571 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ed3610-0159-4a9c-a713-6f6f611f6144 None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:25:37.630595 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 633/1246] 10.222.0.23 () {56 vars in 1374 bytes} [Tue May 10 05:25:37 2022] GET /identity/v3/role_assignments?user.id=67321ca3e5624273acd5b06264738000&scope.project.id=5f23435f783540199d6dcfd0417c090e&role.id=8a02b9040d1d4fccababc1eb4dac80e7 => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:25:40.085006 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f92b024-dce4-4cda-bc66-0eadd076fa8f None None] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:25:40.085617 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f92b024-dce4-4cda-bc66-0eadd076fa8f None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:25:40.085617 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f92b024-dce4-4cda-bc66-0eadd076fa8f None None] PATH_INFO: `/` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:25:40.086978 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 614/1247] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 10 05:25:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 05:25:40.092738 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239eeaad-13d5-4c6b-9a93-9037a419cee3 None None] REQUEST_METHOD: `POST` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:25:40.093277 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239eeaad-13d5-4c6b-9a93-9037a419cee3 None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:25:40.093277 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239eeaad-13d5-4c6b-9a93-9037a419cee3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:25:40.110897 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.auth.core [None req-239eeaad-13d5-4c6b-9a93-9037a419cee3 None None] MFA Rules not processed for user `44883b22532e44049d846938dc2cf423`. Rule list: `[]` (Enabled: `True`). {{(pid=79879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:25:40.112116 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-239eeaad-13d5-4c6b-9a93-9037a419cee3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:25:40.186306 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 634/1248] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 10 05:25:40 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 10 05:25:40.209596 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f92b024-dce4-4cda-bc66-0eadd076fa8f None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:25:40.321239 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f92b024-dce4-4cda-bc66-0eadd076fa8f None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:25:40.358385 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2b0c77-ffe8-43c4-b729-075b95659dfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:25:40.359105 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2b0c77-ffe8-43c4-b729-075b95659dfb None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:25:40.359387 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2b0c77-ffe8-43c4-b729-075b95659dfb None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:25:40.359694 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2b0c77-ffe8-43c4-b729-075b95659dfb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:25:40.370786 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2b0c77-ffe8-43c4-b729-075b95659dfb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 05:25:40.380021 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application [None req-1f2b0c77-ffe8-43c4-b729-075b95659dfb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 10 05:25:40.380021 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 05:25:40.380021 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 05:25:40.380021 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 05:25:40.380021 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 05:25:40.380021 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 05:25:40.380021 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 05:25:40.380021 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 05:25:40.380021 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 05:25:40.380021 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 05:25:40.380021 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 05:25:40.380021 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 05:25:40.380021 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 05:25:40.380021 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 05:25:40.380021 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 05:25:40.380021 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 05:25:40.381243 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 05:25:40.381243 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 05:25:40.381243 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 05:25:40.381243 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 05:25:40.381243 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 05:25:40.381243 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 05:25:40.381243 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 05:25:40.381243 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 05:25:40.381243 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 05:25:40.381243 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.get_or_create( May 10 05:25:40.381243 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 05:25:40.381243 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application with Lock( May 10 05:25:40.381243 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 05:25:40.381243 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._enter() May 10 05:25:40.381243 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 05:25:40.381243 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 05:25:40.382143 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 05:25:40.382143 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.creator() May 10 05:25:40.382143 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 05:25:40.382143 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application created_value = creator( May 10 05:25:40.382143 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 05:25:40.382143 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 05:25:40.382143 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 05:25:40.382143 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 05:25:40.382143 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 05:25:40.382143 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 05:25:40.382143 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 10 05:25:40.382143 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application May 10 05:25:40.382143 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 615/1249] 10.222.0.23 () {56 vars in 1096 bytes} [Tue May 10 05:25:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 05:25:40.388110 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239eeaad-13d5-4c6b-9a93-9037a419cee3 None None] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:25:40.501489 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239eeaad-13d5-4c6b-9a93-9037a419cee3 None None] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:25:40.539907 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6d679e-a3e9-433d-9125-fb85ae400440 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:25:40.540655 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6d679e-a3e9-433d-9125-fb85ae400440 None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:25:40.541012 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6d679e-a3e9-433d-9125-fb85ae400440 None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:25:40.541338 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6d679e-a3e9-433d-9125-fb85ae400440 None admin] PATH_INFO: `/v3/roles` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:25:40.542240 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6d679e-a3e9-433d-9125-fb85ae400440 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:25:40.542549 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6d679e-a3e9-433d-9125-fb85ae400440 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:25:40.544165 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6d679e-a3e9-433d-9125-fb85ae400440 None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:25:40.557317 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 635/1250] 10.222.0.23 () {56 vars in 1099 bytes} [Tue May 10 05:25:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 05:25:40.559097 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2b0c77-ffe8-43c4-b729-075b95659dfb None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:25:40.667094 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2b0c77-ffe8-43c4-b729-075b95659dfb None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:25:40.703530 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148b289e-427c-41de-812b-5feb22f4c916 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:25:40.704405 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148b289e-427c-41de-812b-5feb22f4c916 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:25:40.704774 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148b289e-427c-41de-812b-5feb22f4c916 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:25:40.705078 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148b289e-427c-41de-812b-5feb22f4c916 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:25:40.717077 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148b289e-427c-41de-812b-5feb22f4c916 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:25:40.718648 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148b289e-427c-41de-812b-5feb22f4c916 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:25:40.736476 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application [None req-148b289e-427c-41de-812b-5feb22f4c916 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 05:25:40.736476 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 05:25:40.736476 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 05:25:40.736476 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 05:25:40.736476 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 05:25:40.736476 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 05:25:40.736476 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 05:25:40.736476 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 05:25:40.736476 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 05:25:40.736476 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 05:25:40.736476 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 05:25:40.736476 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 05:25:40.736476 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 05:25:40.736476 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 05:25:40.736476 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 05:25:40.737627 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 05:25:40.737627 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 05:25:40.737627 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 05:25:40.737627 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 05:25:40.737627 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 05:25:40.737627 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 05:25:40.737627 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.get_or_create( May 10 05:25:40.737627 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 05:25:40.737627 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application with Lock( May 10 05:25:40.737627 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 05:25:40.737627 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._enter() May 10 05:25:40.737627 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 05:25:40.737627 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 05:25:40.737627 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 05:25:40.737627 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.creator() May 10 05:25:40.737627 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 05:25:40.737627 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application created_value = creator( May 10 05:25:40.738877 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 05:25:40.738877 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 05:25:40.738877 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 05:25:40.738877 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application May 10 05:25:40.738877 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 616/1251] 10.222.0.23 () {56 vars in 1108 bytes} [Tue May 10 05:25:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 05:25:40.743770 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6d679e-a3e9-433d-9125-fb85ae400440 None admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:25:40.861008 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6d679e-a3e9-433d-9125-fb85ae400440 None admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:25:40.905381 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cfe809-089b-4550-a3a0-17ff097b15e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:25:40.906283 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cfe809-089b-4550-a3a0-17ff097b15e7 None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:25:40.906722 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cfe809-089b-4550-a3a0-17ff097b15e7 None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:25:40.907213 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cfe809-089b-4550-a3a0-17ff097b15e7 None admin] PATH_INFO: `/v3/domains` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:25:40.908174 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7cfe809-089b-4550-a3a0-17ff097b15e7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:25:40.908545 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7cfe809-089b-4550-a3a0-17ff097b15e7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:25:40.910025 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7cfe809-089b-4550-a3a0-17ff097b15e7 None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:25:40.923445 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 636/1252] 10.222.0.23 () {56 vars in 1109 bytes} [Tue May 10 05:25:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:25:40.930381 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148b289e-427c-41de-812b-5feb22f4c916 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:25:41.044313 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148b289e-427c-41de-812b-5feb22f4c916 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:25:41.077163 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd53b44-0a39-4185-8619-80bf4ec0d8f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:25:41.077968 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd53b44-0a39-4185-8619-80bf4ec0d8f0 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:25:41.078244 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd53b44-0a39-4185-8619-80bf4ec0d8f0 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:25:41.078523 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd53b44-0a39-4185-8619-80bf4ec0d8f0 None admin] PATH_INFO: `/v3/users/placement` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:25:41.085771 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd53b44-0a39-4185-8619-80bf4ec0d8f0 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:25:41.087211 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd53b44-0a39-4185-8619-80bf4ec0d8f0 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:25:41.103485 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application [None req-0dd53b44-0a39-4185-8619-80bf4ec0d8f0 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 10 05:25:41.103485 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 05:25:41.103485 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 05:25:41.103485 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 05:25:41.103485 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 05:25:41.103485 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 05:25:41.103485 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 05:25:41.103485 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 05:25:41.103485 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 05:25:41.103485 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 05:25:41.103485 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 05:25:41.103485 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 05:25:41.103485 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 05:25:41.103485 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 05:25:41.103485 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 05:25:41.103485 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 05:25:41.104990 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 05:25:41.104990 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 05:25:41.104990 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 05:25:41.104990 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 05:25:41.104990 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 05:25:41.104990 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 05:25:41.104990 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 05:25:41.104990 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 05:25:41.104990 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 05:25:41.104990 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.get_or_create( May 10 05:25:41.104990 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 05:25:41.104990 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application with Lock( May 10 05:25:41.104990 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 05:25:41.104990 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._enter() May 10 05:25:41.104990 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 05:25:41.104990 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 05:25:41.104990 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 05:25:41.104990 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.creator() May 10 05:25:41.106157 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 05:25:41.106157 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application created_value = creator( May 10 05:25:41.106157 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 05:25:41.106157 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 05:25:41.106157 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 05:25:41.106157 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 05:25:41.106157 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 05:25:41.106157 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 05:25:41.106157 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 10 05:25:41.106157 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application May 10 05:25:41.106157 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 617/1253] 10.222.0.23 () {56 vars in 1108 bytes} [Tue May 10 05:25:40 2022] GET /identity/v3/users/placement => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 05:25:41.111606 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cfe809-089b-4550-a3a0-17ff097b15e7 None admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:25:41.225506 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cfe809-089b-4550-a3a0-17ff097b15e7 None admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:25:41.264127 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a457c3c-8171-42ef-a67b-3386e55a8900 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:25:41.264771 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a457c3c-8171-42ef-a67b-3386e55a8900 None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:25:41.265070 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a457c3c-8171-42ef-a67b-3386e55a8900 None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:25:41.265340 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a457c3c-8171-42ef-a67b-3386e55a8900 None admin] PATH_INFO: `/v3/users` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:25:41.266192 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a457c3c-8171-42ef-a67b-3386e55a8900 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:25:41.266507 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a457c3c-8171-42ef-a67b-3386e55a8900 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:25:41.267960 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a457c3c-8171-42ef-a67b-3386e55a8900 None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:25:41.292352 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 637/1254] 10.222.0.23 () {56 vars in 1143 bytes} [Tue May 10 05:25:41 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:25:41.293802 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd53b44-0a39-4185-8619-80bf4ec0d8f0 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:25:41.412373 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd53b44-0a39-4185-8619-80bf4ec0d8f0 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:25:41.453203 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088c0726-cb4b-483a-81f3-d1a0a00307ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:25:41.455165 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088c0726-cb4b-483a-81f3-d1a0a00307ed None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:25:41.455165 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088c0726-cb4b-483a-81f3-d1a0a00307ed None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:25:41.455165 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088c0726-cb4b-483a-81f3-d1a0a00307ed None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:25:41.536304 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088c0726-cb4b-483a-81f3-d1a0a00307ed None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:25:41.537829 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088c0726-cb4b-483a-81f3-d1a0a00307ed None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:25:41.652344 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 618/1255] 10.222.0.23 () {58 vars in 1282 bytes} [Tue May 10 05:25:41 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 10 05:25:41.658484 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a457c3c-8171-42ef-a67b-3386e55a8900 None admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:25:41.773280 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a457c3c-8171-42ef-a67b-3386e55a8900 None admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:25:41.814835 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6bf1ac-424f-4a89-9a3b-f44f44decd46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:25:41.816039 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6bf1ac-424f-4a89-9a3b-f44f44decd46 None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:25:41.816180 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6bf1ac-424f-4a89-9a3b-f44f44decd46 None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:25:41.816461 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6bf1ac-424f-4a89-9a3b-f44f44decd46 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:25:41.833287 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6bf1ac-424f-4a89-9a3b-f44f44decd46 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:25:41.835070 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6bf1ac-424f-4a89-9a3b-f44f44decd46 None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:25:41.858163 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application [None req-7b6bf1ac-424f-4a89-9a3b-f44f44decd46 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 05:25:41.858163 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 05:25:41.858163 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 05:25:41.858163 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 05:25:41.858163 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 05:25:41.858163 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 05:25:41.858163 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 05:25:41.858163 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 05:25:41.858163 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 05:25:41.858163 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 05:25:41.858163 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 05:25:41.858163 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 05:25:41.858163 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 05:25:41.858163 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 05:25:41.858163 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 05:25:41.859544 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 05:25:41.859544 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 05:25:41.859544 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 05:25:41.859544 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 05:25:41.859544 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 05:25:41.859544 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 05:25:41.859544 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.get_or_create( May 10 05:25:41.859544 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 05:25:41.859544 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application with Lock( May 10 05:25:41.859544 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 05:25:41.859544 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self._enter() May 10 05:25:41.859544 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 05:25:41.859544 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 05:25:41.859544 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 05:25:41.859544 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.creator() May 10 05:25:41.859544 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 05:25:41.859544 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application created_value = creator( May 10 05:25:41.860707 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 05:25:41.860707 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 05:25:41.860707 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 05:25:41.860707 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application May 10 05:25:41.861243 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 638/1256] 10.222.0.23 () {56 vars in 1108 bytes} [Tue May 10 05:25:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 05:25:41.868052 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088c0726-cb4b-483a-81f3-d1a0a00307ed None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:25:41.971981 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088c0726-cb4b-483a-81f3-d1a0a00307ed None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:25:42.007517 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beadd2b6-6b53-4471-abfc-6210b68270f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:25:42.008450 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beadd2b6-6b53-4471-abfc-6210b68270f6 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:25:42.008792 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beadd2b6-6b53-4471-abfc-6210b68270f6 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:25:42.009051 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beadd2b6-6b53-4471-abfc-6210b68270f6 None admin] PATH_INFO: `/v3/domains` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:25:42.009864 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beadd2b6-6b53-4471-abfc-6210b68270f6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:25:42.010200 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beadd2b6-6b53-4471-abfc-6210b68270f6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:25:42.011707 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beadd2b6-6b53-4471-abfc-6210b68270f6 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:25:42.024063 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 619/1257] 10.222.0.23 () {56 vars in 1109 bytes} [Tue May 10 05:25:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:25:42.030524 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6bf1ac-424f-4a89-9a3b-f44f44decd46 None admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:25:42.136368 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6bf1ac-424f-4a89-9a3b-f44f44decd46 None admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:25:42.175432 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2195fba-ca2e-4043-8ac4-3ae5c39b7b09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:25:42.176379 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2195fba-ca2e-4043-8ac4-3ae5c39b7b09 None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:25:42.176663 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2195fba-ca2e-4043-8ac4-3ae5c39b7b09 None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:25:42.176935 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2195fba-ca2e-4043-8ac4-3ae5c39b7b09 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:25:42.183992 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2195fba-ca2e-4043-8ac4-3ae5c39b7b09 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:25:42.185445 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2195fba-ca2e-4043-8ac4-3ae5c39b7b09 None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:25:42.202082 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application [None req-f2195fba-ca2e-4043-8ac4-3ae5c39b7b09 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 05:25:42.202082 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 05:25:42.202082 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 05:25:42.202082 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 05:25:42.202082 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 05:25:42.202082 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 05:25:42.202082 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 05:25:42.202082 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 05:25:42.202082 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 05:25:42.202082 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 05:25:42.202082 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 05:25:42.202082 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 05:25:42.202082 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 05:25:42.202082 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 05:25:42.202082 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 05:25:42.203115 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 05:25:42.203115 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 05:25:42.203115 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 05:25:42.203115 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 05:25:42.203115 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 05:25:42.203115 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 05:25:42.203115 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.get_or_create( May 10 05:25:42.203115 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 05:25:42.203115 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application with Lock( May 10 05:25:42.203115 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 05:25:42.203115 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self._enter() May 10 05:25:42.203115 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 05:25:42.203115 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 05:25:42.203115 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 05:25:42.203115 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.creator() May 10 05:25:42.203115 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 05:25:42.203115 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application created_value = creator( May 10 05:25:42.204878 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 05:25:42.204878 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 05:25:42.204878 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 05:25:42.204878 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 05:25:42.204878 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 05:25:42.204878 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 05:25:42.204878 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 05:25:42.204878 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application May 10 05:25:42.204878 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 639/1258] 10.222.0.23 () {56 vars in 1111 bytes} [Tue May 10 05:25:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 05:25:42.210256 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beadd2b6-6b53-4471-abfc-6210b68270f6 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:25:42.316767 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beadd2b6-6b53-4471-abfc-6210b68270f6 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:25:42.352608 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab7a53a-c6f6-40d0-9ac5-5dd7e93620f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:25:42.353280 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab7a53a-c6f6-40d0-9ac5-5dd7e93620f8 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:25:42.353563 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab7a53a-c6f6-40d0-9ac5-5dd7e93620f8 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:25:42.353834 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab7a53a-c6f6-40d0-9ac5-5dd7e93620f8 None admin] PATH_INFO: `/v3/projects` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:25:42.354641 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab7a53a-c6f6-40d0-9ac5-5dd7e93620f8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:25:42.354947 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab7a53a-c6f6-40d0-9ac5-5dd7e93620f8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:25:42.356414 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab7a53a-c6f6-40d0-9ac5-5dd7e93620f8 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:25:42.369739 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 620/1259] 10.222.0.23 () {56 vars in 1148 bytes} [Tue May 10 05:25:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:25:42.376666 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2195fba-ca2e-4043-8ac4-3ae5c39b7b09 None admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:25:42.485687 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2195fba-ca2e-4043-8ac4-3ae5c39b7b09 None admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:25:42.522705 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd04a6c-a02a-4241-bf96-3c35e1319687 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:25:42.523370 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd04a6c-a02a-4241-bf96-3c35e1319687 None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:25:42.523681 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd04a6c-a02a-4241-bf96-3c35e1319687 None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:25:42.523961 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd04a6c-a02a-4241-bf96-3c35e1319687 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:25:42.524820 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd04a6c-a02a-4241-bf96-3c35e1319687 None admin] RBAC: Adding query filter params (role.id=199ac1dd842441d7913c6ee89d8fbecc, scope.project.id=5f23435f783540199d6dcfd0417c090e, user.id=67321ca3e5624273acd5b06264738000) {{(pid=79879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:25:42.525134 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd04a6c-a02a-4241-bf96-3c35e1319687 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:25:42.526598 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd04a6c-a02a-4241-bf96-3c35e1319687 None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:25:42.533013 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 640/1260] 10.222.0.23 () {56 vars in 1374 bytes} [Tue May 10 05:25:42 2022] GET /identity/v3/role_assignments?user.id=67321ca3e5624273acd5b06264738000&scope.project.id=5f23435f783540199d6dcfd0417c090e&role.id=199ac1dd842441d7913c6ee89d8fbecc => generated 259 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:25:44.723718 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b531a0-aa83-4456-aa7e-2c67b14d26eb None None] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:25:44.724274 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b531a0-aa83-4456-aa7e-2c67b14d26eb None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:25:44.724274 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b531a0-aa83-4456-aa7e-2c67b14d26eb None None] PATH_INFO: `/` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:25:44.725552 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 621/1261] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 10 05:25:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 05:25:44.731891 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c4866d-cede-4787-8951-4cb52e5f87ce None None] REQUEST_METHOD: `POST` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:25:44.732671 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c4866d-cede-4787-8951-4cb52e5f87ce None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:25:44.732791 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c4866d-cede-4787-8951-4cb52e5f87ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:25:44.752410 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.auth.core [None req-22c4866d-cede-4787-8951-4cb52e5f87ce None None] MFA Rules not processed for user `44883b22532e44049d846938dc2cf423`. Rule list: `[]` (Enabled: `True`). {{(pid=79879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:25:44.753603 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-22c4866d-cede-4787-8951-4cb52e5f87ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:25:44.820536 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 641/1262] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 10 05:25:44 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 05:25:44.844371 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b531a0-aa83-4456-aa7e-2c67b14d26eb None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:25:44.948268 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b531a0-aa83-4456-aa7e-2c67b14d26eb None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:25:44.981640 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d631ea-3daa-483c-b4dc-09dc74283e28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:25:44.982359 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d631ea-3daa-483c-b4dc-09dc74283e28 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:25:44.982646 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d631ea-3daa-483c-b4dc-09dc74283e28 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:25:44.982920 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d631ea-3daa-483c-b4dc-09dc74283e28 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:25:44.993161 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d631ea-3daa-483c-b4dc-09dc74283e28 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 05:25:45.001077 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application [None req-38d631ea-3daa-483c-b4dc-09dc74283e28 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 10 05:25:45.001077 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 05:25:45.001077 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 05:25:45.001077 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 05:25:45.001077 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 05:25:45.001077 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 05:25:45.001077 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 05:25:45.001077 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 05:25:45.001077 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 05:25:45.001077 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 05:25:45.001077 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 05:25:45.001077 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 05:25:45.001077 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 05:25:45.001077 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 05:25:45.001077 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 05:25:45.001077 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 05:25:45.002142 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 05:25:45.002142 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 05:25:45.002142 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 05:25:45.002142 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 05:25:45.002142 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 05:25:45.002142 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 05:25:45.002142 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 05:25:45.002142 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 05:25:45.002142 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 05:25:45.002142 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.get_or_create( May 10 05:25:45.002142 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 05:25:45.002142 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application with Lock( May 10 05:25:45.002142 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 05:25:45.002142 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._enter() May 10 05:25:45.002142 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 05:25:45.002142 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 05:25:45.004170 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 05:25:45.004170 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.creator() May 10 05:25:45.004170 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 05:25:45.004170 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application created_value = creator( May 10 05:25:45.004170 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 05:25:45.004170 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 05:25:45.004170 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 05:25:45.004170 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 05:25:45.004170 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 05:25:45.004170 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 05:25:45.004170 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 10 05:25:45.004170 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application May 10 05:25:45.004170 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 622/1263] 10.222.0.23 () {56 vars in 1096 bytes} [Tue May 10 05:25:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 05:25:45.011945 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c4866d-cede-4787-8951-4cb52e5f87ce None None] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:25:45.135482 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c4866d-cede-4787-8951-4cb52e5f87ce None None] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:25:45.174762 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e990f461-b646-4c48-a3d3-b3961cb4027a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:25:45.175754 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e990f461-b646-4c48-a3d3-b3961cb4027a None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:25:45.176178 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e990f461-b646-4c48-a3d3-b3961cb4027a None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:25:45.176540 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e990f461-b646-4c48-a3d3-b3961cb4027a None admin] PATH_INFO: `/v3/roles` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:25:45.177683 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e990f461-b646-4c48-a3d3-b3961cb4027a None admin] RBAC: Adding query filter params (name=admin) {{(pid=79879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:25:45.178076 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e990f461-b646-4c48-a3d3-b3961cb4027a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:25:45.180279 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e990f461-b646-4c48-a3d3-b3961cb4027a None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:25:45.192309 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 642/1264] 10.222.0.23 () {56 vars in 1099 bytes} [Tue May 10 05:25:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:25:45.198321 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d631ea-3daa-483c-b4dc-09dc74283e28 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:25:45.299741 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d631ea-3daa-483c-b4dc-09dc74283e28 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:25:45.338483 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7c6f52-7292-4fa1-80bd-ba13c2277145 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:25:45.339266 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7c6f52-7292-4fa1-80bd-ba13c2277145 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:25:45.339541 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7c6f52-7292-4fa1-80bd-ba13c2277145 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:25:45.339846 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7c6f52-7292-4fa1-80bd-ba13c2277145 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:25:45.351540 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7c6f52-7292-4fa1-80bd-ba13c2277145 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:25:45.353015 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7c6f52-7292-4fa1-80bd-ba13c2277145 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:25:45.369657 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application [None req-cb7c6f52-7292-4fa1-80bd-ba13c2277145 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 05:25:45.369657 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 05:25:45.369657 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 05:25:45.369657 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 05:25:45.369657 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 05:25:45.369657 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 05:25:45.369657 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 05:25:45.369657 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 05:25:45.369657 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 05:25:45.369657 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 05:25:45.369657 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 05:25:45.369657 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 05:25:45.369657 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 05:25:45.369657 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 05:25:45.369657 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 05:25:45.370750 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 05:25:45.370750 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 05:25:45.370750 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 05:25:45.370750 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 05:25:45.370750 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 05:25:45.370750 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 05:25:45.370750 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.get_or_create( May 10 05:25:45.370750 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 05:25:45.370750 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application with Lock( May 10 05:25:45.370750 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 05:25:45.370750 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._enter() May 10 05:25:45.370750 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 05:25:45.370750 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 05:25:45.370750 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 05:25:45.370750 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.creator() May 10 05:25:45.370750 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 05:25:45.370750 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application created_value = creator( May 10 05:25:45.371721 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 05:25:45.371721 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 05:25:45.371721 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 05:25:45.371721 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application May 10 05:25:45.371721 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 623/1265] 10.222.0.23 () {56 vars in 1108 bytes} [Tue May 10 05:25:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 05:25:45.379148 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e990f461-b646-4c48-a3d3-b3961cb4027a None admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:25:45.488739 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e990f461-b646-4c48-a3d3-b3961cb4027a None admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:25:45.522420 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0962b087-d457-4d77-8fb0-83cd9d0612cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:25:45.523066 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0962b087-d457-4d77-8fb0-83cd9d0612cb None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:25:45.523342 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0962b087-d457-4d77-8fb0-83cd9d0612cb None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:25:45.523627 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0962b087-d457-4d77-8fb0-83cd9d0612cb None admin] PATH_INFO: `/v3/domains` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:25:45.524356 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0962b087-d457-4d77-8fb0-83cd9d0612cb None admin] RBAC: Adding query filter params (name=Default) {{(pid=79879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:25:45.524656 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0962b087-d457-4d77-8fb0-83cd9d0612cb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:25:45.526028 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0962b087-d457-4d77-8fb0-83cd9d0612cb None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:25:45.537454 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 643/1266] 10.222.0.23 () {56 vars in 1109 bytes} [Tue May 10 05:25:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 05:25:45.543438 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7c6f52-7292-4fa1-80bd-ba13c2277145 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:25:45.645814 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7c6f52-7292-4fa1-80bd-ba13c2277145 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:25:45.679165 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000a30ef-22c0-4a2f-a7f7-79b18c22d314 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:25:45.679994 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000a30ef-22c0-4a2f-a7f7-79b18c22d314 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:25:45.680277 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000a30ef-22c0-4a2f-a7f7-79b18c22d314 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:25:45.680547 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000a30ef-22c0-4a2f-a7f7-79b18c22d314 None admin] PATH_INFO: `/v3/users/placement` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:25:45.687992 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000a30ef-22c0-4a2f-a7f7-79b18c22d314 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:25:45.689440 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000a30ef-22c0-4a2f-a7f7-79b18c22d314 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:25:45.704192 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application [None req-000a30ef-22c0-4a2f-a7f7-79b18c22d314 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 10 05:25:45.704192 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 05:25:45.704192 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 05:25:45.704192 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 05:25:45.704192 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 05:25:45.704192 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 05:25:45.704192 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 05:25:45.704192 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 05:25:45.704192 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 05:25:45.704192 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 05:25:45.704192 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 05:25:45.704192 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 05:25:45.704192 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 05:25:45.704192 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 05:25:45.704192 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 05:25:45.704192 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 05:25:45.705255 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 05:25:45.705255 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 05:25:45.705255 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 05:25:45.705255 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 05:25:45.705255 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 05:25:45.705255 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 05:25:45.705255 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 05:25:45.705255 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 05:25:45.705255 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 05:25:45.705255 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.get_or_create( May 10 05:25:45.705255 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 05:25:45.705255 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application with Lock( May 10 05:25:45.705255 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 05:25:45.705255 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._enter() May 10 05:25:45.705255 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 05:25:45.705255 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 05:25:45.705255 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 05:25:45.705255 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.creator() May 10 05:25:45.706725 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 05:25:45.706725 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application created_value = creator( May 10 05:25:45.706725 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 05:25:45.706725 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 05:25:45.706725 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 05:25:45.706725 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 05:25:45.706725 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 05:25:45.706725 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 05:25:45.706725 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 10 05:25:45.706725 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application May 10 05:25:45.706725 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 624/1267] 10.222.0.23 () {56 vars in 1108 bytes} [Tue May 10 05:25:45 2022] GET /identity/v3/users/placement => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 05:25:45.714062 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0962b087-d457-4d77-8fb0-83cd9d0612cb None admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:25:45.833070 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0962b087-d457-4d77-8fb0-83cd9d0612cb None admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:25:45.869321 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9d9e52-6cd0-4393-b779-ea7e79e142d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:25:45.869983 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9d9e52-6cd0-4393-b779-ea7e79e142d4 None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:25:45.870271 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9d9e52-6cd0-4393-b779-ea7e79e142d4 None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:25:45.870545 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9d9e52-6cd0-4393-b779-ea7e79e142d4 None admin] PATH_INFO: `/v3/users` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:25:45.871388 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9d9e52-6cd0-4393-b779-ea7e79e142d4 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:25:45.871723 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9d9e52-6cd0-4393-b779-ea7e79e142d4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:25:45.873524 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9d9e52-6cd0-4393-b779-ea7e79e142d4 None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:25:45.890739 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 644/1268] 10.222.0.23 () {56 vars in 1143 bytes} [Tue May 10 05:25:45 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 05:25:45.900111 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000a30ef-22c0-4a2f-a7f7-79b18c22d314 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:25:46.010309 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000a30ef-22c0-4a2f-a7f7-79b18c22d314 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:25:46.043503 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99953d5-104c-4c91-844e-e96b2f4848ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:25:46.044311 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99953d5-104c-4c91-844e-e96b2f4848ad None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:25:46.044586 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99953d5-104c-4c91-844e-e96b2f4848ad None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:25:46.044848 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99953d5-104c-4c91-844e-e96b2f4848ad None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:25:46.055342 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99953d5-104c-4c91-844e-e96b2f4848ad None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:25:46.056822 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99953d5-104c-4c91-844e-e96b2f4848ad None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:25:46.073543 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application [None req-b99953d5-104c-4c91-844e-e96b2f4848ad None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 05:25:46.073543 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 05:25:46.073543 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 05:25:46.073543 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 05:25:46.073543 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 05:25:46.073543 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 05:25:46.073543 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 05:25:46.073543 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 05:25:46.073543 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 05:25:46.073543 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 05:25:46.073543 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 05:25:46.073543 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 05:25:46.073543 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 05:25:46.073543 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 05:25:46.073543 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 05:25:46.074553 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 05:25:46.074553 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 05:25:46.074553 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 05:25:46.074553 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 05:25:46.074553 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 05:25:46.074553 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 05:25:46.074553 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.get_or_create( May 10 05:25:46.074553 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 05:25:46.074553 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application with Lock( May 10 05:25:46.074553 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 05:25:46.074553 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._enter() May 10 05:25:46.074553 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 05:25:46.074553 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 05:25:46.074553 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 05:25:46.074553 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.creator() May 10 05:25:46.074553 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 05:25:46.074553 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application created_value = creator( May 10 05:25:46.075494 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 05:25:46.075494 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 05:25:46.075494 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 05:25:46.075494 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application May 10 05:25:46.075494 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 625/1269] 10.222.0.23 () {56 vars in 1108 bytes} [Tue May 10 05:25:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 05:25:46.081272 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9d9e52-6cd0-4393-b779-ea7e79e142d4 None admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:25:46.179884 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9d9e52-6cd0-4393-b779-ea7e79e142d4 None admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:25:46.213280 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707e34a9-c828-4d4c-85a2-a3bb1d1d9db1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:25:46.213924 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707e34a9-c828-4d4c-85a2-a3bb1d1d9db1 None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:25:46.214203 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707e34a9-c828-4d4c-85a2-a3bb1d1d9db1 None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:25:46.214473 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707e34a9-c828-4d4c-85a2-a3bb1d1d9db1 None admin] PATH_INFO: `/v3/domains` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:25:46.215186 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707e34a9-c828-4d4c-85a2-a3bb1d1d9db1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:25:46.215494 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707e34a9-c828-4d4c-85a2-a3bb1d1d9db1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:25:46.216887 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707e34a9-c828-4d4c-85a2-a3bb1d1d9db1 None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:25:46.227877 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 645/1270] 10.222.0.23 () {56 vars in 1109 bytes} [Tue May 10 05:25:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:25:46.233725 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99953d5-104c-4c91-844e-e96b2f4848ad None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:25:46.339633 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99953d5-104c-4c91-844e-e96b2f4848ad None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:25:46.376624 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1d7bcc-4321-4ab6-bcd6-10771330c621 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:25:46.377439 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1d7bcc-4321-4ab6-bcd6-10771330c621 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:25:46.377728 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1d7bcc-4321-4ab6-bcd6-10771330c621 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:25:46.377994 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1d7bcc-4321-4ab6-bcd6-10771330c621 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:25:46.385349 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1d7bcc-4321-4ab6-bcd6-10771330c621 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:25:46.386781 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1d7bcc-4321-4ab6-bcd6-10771330c621 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:25:46.401479 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application [None req-5a1d7bcc-4321-4ab6-bcd6-10771330c621 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 05:25:46.401479 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 05:25:46.401479 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 05:25:46.401479 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 05:25:46.401479 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 05:25:46.401479 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 05:25:46.401479 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 05:25:46.401479 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 05:25:46.401479 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 05:25:46.401479 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 05:25:46.401479 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 05:25:46.401479 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 05:25:46.401479 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 05:25:46.401479 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 05:25:46.401479 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 05:25:46.402495 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 05:25:46.402495 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 05:25:46.402495 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 05:25:46.402495 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 05:25:46.402495 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 05:25:46.402495 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 05:25:46.402495 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.get_or_create( May 10 05:25:46.402495 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 05:25:46.402495 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application with Lock( May 10 05:25:46.402495 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 05:25:46.402495 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._enter() May 10 05:25:46.402495 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 05:25:46.402495 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 05:25:46.402495 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 05:25:46.402495 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.creator() May 10 05:25:46.402495 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 05:25:46.402495 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application created_value = creator( May 10 05:25:46.403656 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 05:25:46.403656 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 05:25:46.403656 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 05:25:46.403656 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 05:25:46.403656 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 05:25:46.403656 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 05:25:46.403656 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 05:25:46.403656 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application May 10 05:25:46.403656 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 626/1271] 10.222.0.23 () {56 vars in 1111 bytes} [Tue May 10 05:25:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 05:25:46.410170 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707e34a9-c828-4d4c-85a2-a3bb1d1d9db1 None admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:25:46.514522 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707e34a9-c828-4d4c-85a2-a3bb1d1d9db1 None admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:25:46.548245 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c365e31-20b2-4e7d-85fb-33fcd66a161b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:25:46.548895 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c365e31-20b2-4e7d-85fb-33fcd66a161b None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:25:46.549176 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c365e31-20b2-4e7d-85fb-33fcd66a161b None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:25:46.549568 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c365e31-20b2-4e7d-85fb-33fcd66a161b None admin] PATH_INFO: `/v3/projects` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:25:46.550449 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c365e31-20b2-4e7d-85fb-33fcd66a161b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:25:46.550758 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c365e31-20b2-4e7d-85fb-33fcd66a161b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:25:46.552229 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c365e31-20b2-4e7d-85fb-33fcd66a161b None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:25:46.564059 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 646/1272] 10.222.0.23 () {56 vars in 1148 bytes} [Tue May 10 05:25:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:25:46.571122 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1d7bcc-4321-4ab6-bcd6-10771330c621 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:25:46.678440 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1d7bcc-4321-4ab6-bcd6-10771330c621 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:25:46.717824 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b895d5-6208-403e-adbf-1e23e1b6df6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:25:46.719093 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b895d5-6208-403e-adbf-1e23e1b6df6f None admin] REQUEST_METHOD: `PUT` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:25:46.719536 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b895d5-6208-403e-adbf-1e23e1b6df6f None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:25:46.719992 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b895d5-6208-403e-adbf-1e23e1b6df6f None admin] PATH_INFO: `/v3/projects/5f23435f783540199d6dcfd0417c090e/users/67321ca3e5624273acd5b06264738000/roles/199ac1dd842441d7913c6ee89d8fbecc` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:25:46.722644 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b895d5-6208-403e-adbf-1e23e1b6df6f None admin] RBAC: Authorizing `identity:create_grant(project_id=5f23435f783540199d6dcfd0417c090e, user_id=67321ca3e5624273acd5b06264738000, role_id=199ac1dd842441d7913c6ee89d8fbecc)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:25:46.724162 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b895d5-6208-403e-adbf-1e23e1b6df6f None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:25:46.738965 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 627/1273] 10.222.0.23 () {58 vars in 1439 bytes} [Tue May 10 05:25:46 2022] PUT /identity/v3/projects/5f23435f783540199d6dcfd0417c090e/users/67321ca3e5624273acd5b06264738000/roles/199ac1dd842441d7913c6ee89d8fbecc => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 05:25:48.934161 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c17f460-4ca7-4770-8e58-c9706c1ba878 None None] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:25:48.934726 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c17f460-4ca7-4770-8e58-c9706c1ba878 None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:25:48.934726 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c17f460-4ca7-4770-8e58-c9706c1ba878 None None] PATH_INFO: `/` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:25:48.936160 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 647/1274] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 10 05:25:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 05:25:48.943445 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a19410-acdb-426d-be7a-f23c98ccbe0c None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:25:48.944010 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a19410-acdb-426d-be7a-f23c98ccbe0c None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:25:48.944010 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a19410-acdb-426d-be7a-f23c98ccbe0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:25:48.962298 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-64a19410-acdb-426d-be7a-f23c98ccbe0c None None] MFA Rules not processed for user `44883b22532e44049d846938dc2cf423`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:25:48.963481 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-64a19410-acdb-426d-be7a-f23c98ccbe0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:25:49.029833 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 628/1275] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 10 05:25:48 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 05:25:49.052795 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c17f460-4ca7-4770-8e58-c9706c1ba878 None None] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:25:49.162836 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c17f460-4ca7-4770-8e58-c9706c1ba878 None None] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:25:49.201006 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8d5fec-ee22-41d8-816d-13b3c69153a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:25:49.202139 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8d5fec-ee22-41d8-816d-13b3c69153a8 None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:25:49.202418 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8d5fec-ee22-41d8-816d-13b3c69153a8 None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:25:49.202688 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8d5fec-ee22-41d8-816d-13b3c69153a8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:25:49.213425 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8d5fec-ee22-41d8-816d-13b3c69153a8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 05:25:49.220935 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application [None req-cc8d5fec-ee22-41d8-816d-13b3c69153a8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 10 05:25:49.220935 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 05:25:49.220935 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 05:25:49.220935 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 05:25:49.220935 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 05:25:49.220935 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 05:25:49.220935 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 05:25:49.220935 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 05:25:49.220935 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 05:25:49.220935 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 05:25:49.220935 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 05:25:49.220935 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 05:25:49.220935 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 05:25:49.220935 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 05:25:49.220935 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 05:25:49.220935 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 05:25:49.221974 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 05:25:49.221974 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 05:25:49.221974 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 05:25:49.221974 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 05:25:49.221974 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 05:25:49.221974 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 05:25:49.221974 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 05:25:49.221974 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 05:25:49.221974 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 05:25:49.221974 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.get_or_create( May 10 05:25:49.221974 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 05:25:49.221974 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application with Lock( May 10 05:25:49.221974 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 05:25:49.221974 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self._enter() May 10 05:25:49.221974 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 05:25:49.221974 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 05:25:49.222821 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 05:25:49.222821 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.creator() May 10 05:25:49.222821 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 05:25:49.222821 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application created_value = creator( May 10 05:25:49.222821 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 05:25:49.222821 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 05:25:49.222821 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 05:25:49.222821 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 05:25:49.222821 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 05:25:49.222821 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 05:25:49.222821 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 10 05:25:49.222821 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application May 10 05:25:49.222821 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 648/1276] 10.222.0.23 () {56 vars in 1096 bytes} [Tue May 10 05:25:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 05:25:49.228520 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a19410-acdb-426d-be7a-f23c98ccbe0c None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:25:49.345248 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a19410-acdb-426d-be7a-f23c98ccbe0c None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:25:49.379153 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d364ea8c-d518-4880-9a0b-f627c4efc9b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:25:49.379839 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d364ea8c-d518-4880-9a0b-f627c4efc9b4 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:25:49.380115 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d364ea8c-d518-4880-9a0b-f627c4efc9b4 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:25:49.380361 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d364ea8c-d518-4880-9a0b-f627c4efc9b4 None admin] PATH_INFO: `/v3/roles` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:25:49.381143 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d364ea8c-d518-4880-9a0b-f627c4efc9b4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:25:49.381457 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d364ea8c-d518-4880-9a0b-f627c4efc9b4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:25:49.382828 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d364ea8c-d518-4880-9a0b-f627c4efc9b4 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:25:49.392439 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 629/1277] 10.222.0.23 () {56 vars in 1099 bytes} [Tue May 10 05:25:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:25:49.398314 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8d5fec-ee22-41d8-816d-13b3c69153a8 None admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:25:49.503781 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8d5fec-ee22-41d8-816d-13b3c69153a8 None admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:25:49.537414 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6ce01f-9c1a-4bb8-83ce-383274f0a760 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:25:49.538192 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6ce01f-9c1a-4bb8-83ce-383274f0a760 None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:25:49.538464 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6ce01f-9c1a-4bb8-83ce-383274f0a760 None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:25:49.538729 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6ce01f-9c1a-4bb8-83ce-383274f0a760 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:25:49.549163 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6ce01f-9c1a-4bb8-83ce-383274f0a760 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:25:49.550609 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6ce01f-9c1a-4bb8-83ce-383274f0a760 None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:25:49.567556 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application [None req-dd6ce01f-9c1a-4bb8-83ce-383274f0a760 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 05:25:49.567556 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 05:25:49.567556 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 05:25:49.567556 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 05:25:49.567556 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 05:25:49.567556 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 05:25:49.567556 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 05:25:49.567556 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 05:25:49.567556 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 05:25:49.567556 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 05:25:49.567556 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 05:25:49.567556 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 05:25:49.567556 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 05:25:49.567556 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 05:25:49.567556 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 05:25:49.568597 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 05:25:49.568597 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 05:25:49.568597 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 05:25:49.568597 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 05:25:49.568597 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 05:25:49.568597 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 05:25:49.568597 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.get_or_create( May 10 05:25:49.568597 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 05:25:49.568597 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application with Lock( May 10 05:25:49.568597 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 05:25:49.568597 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self._enter() May 10 05:25:49.568597 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 05:25:49.568597 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 05:25:49.568597 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 05:25:49.568597 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.creator() May 10 05:25:49.568597 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 05:25:49.568597 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application created_value = creator( May 10 05:25:49.570598 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 05:25:49.570598 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 05:25:49.570598 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 05:25:49.570598 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application May 10 05:25:49.570598 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 649/1278] 10.222.0.23 () {56 vars in 1108 bytes} [Tue May 10 05:25:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 05:25:49.577952 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d364ea8c-d518-4880-9a0b-f627c4efc9b4 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:25:49.691880 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d364ea8c-d518-4880-9a0b-f627c4efc9b4 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:25:49.729778 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5174a78c-ea9d-404e-99cd-e42285b9a94c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:25:49.730370 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5174a78c-ea9d-404e-99cd-e42285b9a94c None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:25:49.730649 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5174a78c-ea9d-404e-99cd-e42285b9a94c None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:25:49.730921 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5174a78c-ea9d-404e-99cd-e42285b9a94c None admin] PATH_INFO: `/v3/domains` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:25:49.731743 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5174a78c-ea9d-404e-99cd-e42285b9a94c None admin] RBAC: Adding query filter params (name=Default) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:25:49.732080 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5174a78c-ea9d-404e-99cd-e42285b9a94c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:25:49.733455 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5174a78c-ea9d-404e-99cd-e42285b9a94c None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:25:49.746096 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 630/1279] 10.222.0.23 () {56 vars in 1109 bytes} [Tue May 10 05:25:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:25:49.752921 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6ce01f-9c1a-4bb8-83ce-383274f0a760 None admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:25:49.862472 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6ce01f-9c1a-4bb8-83ce-383274f0a760 None admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:25:49.897131 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bc3b98-a2ba-4cee-9d13-0de022fa2d09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:25:49.897933 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bc3b98-a2ba-4cee-9d13-0de022fa2d09 None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:25:49.898211 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bc3b98-a2ba-4cee-9d13-0de022fa2d09 None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:25:49.898485 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bc3b98-a2ba-4cee-9d13-0de022fa2d09 None admin] PATH_INFO: `/v3/users/placement` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:25:49.906110 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23bc3b98-a2ba-4cee-9d13-0de022fa2d09 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:25:49.907557 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23bc3b98-a2ba-4cee-9d13-0de022fa2d09 None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:25:49.921788 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application [None req-23bc3b98-a2ba-4cee-9d13-0de022fa2d09 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 10 05:25:49.921788 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 05:25:49.921788 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 05:25:49.921788 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 05:25:49.921788 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 05:25:49.921788 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 05:25:49.921788 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 05:25:49.921788 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 05:25:49.921788 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 05:25:49.921788 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 05:25:49.921788 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 05:25:49.921788 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 05:25:49.921788 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 05:25:49.921788 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 05:25:49.921788 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 05:25:49.921788 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 05:25:49.922864 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 05:25:49.922864 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 05:25:49.922864 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 05:25:49.922864 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 05:25:49.922864 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 05:25:49.922864 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 05:25:49.922864 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 05:25:49.922864 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 05:25:49.922864 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 05:25:49.922864 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.get_or_create( May 10 05:25:49.922864 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 05:25:49.922864 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application with Lock( May 10 05:25:49.922864 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 05:25:49.922864 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self._enter() May 10 05:25:49.922864 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 05:25:49.922864 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 05:25:49.922864 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 05:25:49.922864 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.creator() May 10 05:25:49.923908 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 05:25:49.923908 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application created_value = creator( May 10 05:25:49.923908 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 05:25:49.923908 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 05:25:49.923908 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 05:25:49.923908 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 05:25:49.923908 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 05:25:49.923908 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 05:25:49.923908 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 10 05:25:49.923908 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application May 10 05:25:49.923908 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 650/1280] 10.222.0.23 () {56 vars in 1108 bytes} [Tue May 10 05:25:49 2022] GET /identity/v3/users/placement => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 05:25:49.929283 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5174a78c-ea9d-404e-99cd-e42285b9a94c None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:25:50.033763 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5174a78c-ea9d-404e-99cd-e42285b9a94c None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:25:50.067785 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1645177-bfd7-42e3-9238-6428fed90d4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:25:50.068453 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1645177-bfd7-42e3-9238-6428fed90d4e None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:25:50.068733 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1645177-bfd7-42e3-9238-6428fed90d4e None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:25:50.069005 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1645177-bfd7-42e3-9238-6428fed90d4e None admin] PATH_INFO: `/v3/users` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:25:50.069854 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1645177-bfd7-42e3-9238-6428fed90d4e None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:25:50.070165 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1645177-bfd7-42e3-9238-6428fed90d4e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:25:50.071618 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1645177-bfd7-42e3-9238-6428fed90d4e None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:25:50.088478 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 631/1281] 10.222.0.23 () {56 vars in 1143 bytes} [Tue May 10 05:25:49 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:25:50.096884 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bc3b98-a2ba-4cee-9d13-0de022fa2d09 None admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:25:50.195599 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bc3b98-a2ba-4cee-9d13-0de022fa2d09 None admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:25:50.229239 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b66d5d-f64b-4f5c-a1f9-a1b92091b36f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:25:50.229869 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b66d5d-f64b-4f5c-a1f9-a1b92091b36f None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:25:50.230185 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b66d5d-f64b-4f5c-a1f9-a1b92091b36f None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:25:50.230453 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b66d5d-f64b-4f5c-a1f9-a1b92091b36f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:25:50.296510 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b66d5d-f64b-4f5c-a1f9-a1b92091b36f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:25:50.297962 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b66d5d-f64b-4f5c-a1f9-a1b92091b36f None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:25:50.393776 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 651/1282] 10.222.0.23 () {58 vars in 1282 bytes} [Tue May 10 05:25:50 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 10 05:25:50.399851 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1645177-bfd7-42e3-9238-6428fed90d4e None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:25:50.515959 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1645177-bfd7-42e3-9238-6428fed90d4e None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:25:50.549616 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4059e30-bb21-419d-a11b-b1759198f426 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:25:50.550347 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4059e30-bb21-419d-a11b-b1759198f426 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:25:50.550625 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4059e30-bb21-419d-a11b-b1759198f426 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:25:50.550903 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4059e30-bb21-419d-a11b-b1759198f426 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:25:50.561163 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4059e30-bb21-419d-a11b-b1759198f426 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:25:50.562631 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4059e30-bb21-419d-a11b-b1759198f426 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:25:50.580893 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application [None req-e4059e30-bb21-419d-a11b-b1759198f426 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 05:25:50.580893 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 05:25:50.580893 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 05:25:50.580893 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 05:25:50.580893 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 05:25:50.580893 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 05:25:50.580893 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 05:25:50.580893 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 05:25:50.580893 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 05:25:50.580893 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 05:25:50.580893 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 05:25:50.580893 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 05:25:50.580893 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 05:25:50.580893 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 05:25:50.580893 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 05:25:50.581878 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 05:25:50.581878 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 05:25:50.581878 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 05:25:50.581878 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 05:25:50.581878 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 05:25:50.581878 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 05:25:50.581878 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.get_or_create( May 10 05:25:50.581878 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 05:25:50.581878 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application with Lock( May 10 05:25:50.581878 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 05:25:50.581878 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._enter() May 10 05:25:50.581878 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 05:25:50.581878 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 05:25:50.581878 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 05:25:50.581878 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.creator() May 10 05:25:50.581878 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 05:25:50.581878 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application created_value = creator( May 10 05:25:50.582775 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 05:25:50.582775 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 05:25:50.582775 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 05:25:50.582775 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application May 10 05:25:50.582775 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 632/1283] 10.222.0.23 () {56 vars in 1108 bytes} [Tue May 10 05:25:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 05:25:50.588517 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b66d5d-f64b-4f5c-a1f9-a1b92091b36f None admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:25:50.688114 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b66d5d-f64b-4f5c-a1f9-a1b92091b36f None admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:25:50.723529 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac52030-7fe9-4c11-b327-ea264a803102 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:25:50.724212 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac52030-7fe9-4c11-b327-ea264a803102 None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:25:50.724495 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac52030-7fe9-4c11-b327-ea264a803102 None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:25:50.724771 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac52030-7fe9-4c11-b327-ea264a803102 None admin] PATH_INFO: `/v3/domains` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:25:50.725492 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac52030-7fe9-4c11-b327-ea264a803102 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:25:50.725802 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac52030-7fe9-4c11-b327-ea264a803102 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:25:50.727182 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac52030-7fe9-4c11-b327-ea264a803102 None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:25:50.739203 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 652/1284] 10.222.0.23 () {56 vars in 1109 bytes} [Tue May 10 05:25:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:25:50.744910 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4059e30-bb21-419d-a11b-b1759198f426 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:25:50.844967 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4059e30-bb21-419d-a11b-b1759198f426 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:25:50.899716 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33afa52-f9d4-49b5-9bb2-1637c698cff3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:25:50.900526 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33afa52-f9d4-49b5-9bb2-1637c698cff3 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:25:50.900795 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33afa52-f9d4-49b5-9bb2-1637c698cff3 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:25:50.901063 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33afa52-f9d4-49b5-9bb2-1637c698cff3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:25:50.908773 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33afa52-f9d4-49b5-9bb2-1637c698cff3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:25:50.910230 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33afa52-f9d4-49b5-9bb2-1637c698cff3 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:25:50.923611 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application [None req-d33afa52-f9d4-49b5-9bb2-1637c698cff3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 05:25:50.923611 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 05:25:50.923611 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 05:25:50.923611 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 05:25:50.923611 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 05:25:50.923611 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 05:25:50.923611 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 05:25:50.923611 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 05:25:50.923611 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 05:25:50.923611 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 05:25:50.923611 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 05:25:50.923611 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 05:25:50.923611 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 05:25:50.923611 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 05:25:50.923611 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 05:25:50.924719 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 05:25:50.924719 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 05:25:50.924719 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 05:25:50.924719 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 05:25:50.924719 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 05:25:50.924719 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 05:25:50.924719 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.get_or_create( May 10 05:25:50.924719 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 05:25:50.924719 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application with Lock( May 10 05:25:50.924719 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 05:25:50.924719 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._enter() May 10 05:25:50.924719 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 05:25:50.924719 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 05:25:50.924719 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 05:25:50.924719 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.creator() May 10 05:25:50.924719 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 05:25:50.924719 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application created_value = creator( May 10 05:25:50.925717 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 05:25:50.925717 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 05:25:50.925717 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 05:25:50.925717 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 05:25:50.925717 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 05:25:50.925717 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 05:25:50.925717 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 05:25:50.925717 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: ERROR keystone.server.flask.application May 10 05:25:50.925717 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 633/1285] 10.222.0.23 () {56 vars in 1111 bytes} [Tue May 10 05:25:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 05:25:50.931185 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac52030-7fe9-4c11-b327-ea264a803102 None admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:25:51.030502 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac52030-7fe9-4c11-b327-ea264a803102 None admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:25:51.063610 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc6aae3-121e-41a0-8b8d-fbdc414e9830 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:25:51.064272 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc6aae3-121e-41a0-8b8d-fbdc414e9830 None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:25:51.064548 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc6aae3-121e-41a0-8b8d-fbdc414e9830 None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:25:51.064818 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc6aae3-121e-41a0-8b8d-fbdc414e9830 None admin] PATH_INFO: `/v3/projects` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:25:51.065648 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc6aae3-121e-41a0-8b8d-fbdc414e9830 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:25:51.065954 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc6aae3-121e-41a0-8b8d-fbdc414e9830 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:25:51.067388 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc6aae3-121e-41a0-8b8d-fbdc414e9830 None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:25:51.079007 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 653/1286] 10.222.0.23 () {56 vars in 1148 bytes} [Tue May 10 05:25:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:25:51.085190 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33afa52-f9d4-49b5-9bb2-1637c698cff3 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:25:51.200212 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33afa52-f9d4-49b5-9bb2-1637c698cff3 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:25:51.233524 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3e4e54-d00b-4bb6-8228-5bbe33290b72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:25:51.234171 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3e4e54-d00b-4bb6-8228-5bbe33290b72 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:25:51.234452 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3e4e54-d00b-4bb6-8228-5bbe33290b72 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:25:51.234728 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3e4e54-d00b-4bb6-8228-5bbe33290b72 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:25:51.235555 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3e4e54-d00b-4bb6-8228-5bbe33290b72 None admin] RBAC: Adding query filter params (role.id=199ac1dd842441d7913c6ee89d8fbecc, scope.project.id=5f23435f783540199d6dcfd0417c090e, user.id=67321ca3e5624273acd5b06264738000) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:25:51.235901 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3e4e54-d00b-4bb6-8228-5bbe33290b72 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:25:51.237362 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3e4e54-d00b-4bb6-8228-5bbe33290b72 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:25:51.243177 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 634/1287] 10.222.0.23 () {56 vars in 1374 bytes} [Tue May 10 05:25:51 2022] GET /identity/v3/role_assignments?user.id=67321ca3e5624273acd5b06264738000&scope.project.id=5f23435f783540199d6dcfd0417c090e&role.id=199ac1dd842441d7913c6ee89d8fbecc => generated 608 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:25:53.445625 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b089075f-da9b-461e-8931-d652629fadb3 None None] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:25:53.446527 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b089075f-da9b-461e-8931-d652629fadb3 None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:25:53.446527 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b089075f-da9b-461e-8931-d652629fadb3 None None] PATH_INFO: `/` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:25:53.448688 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 654/1288] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 10 05:25:53 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 05:25:53.454092 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0762ac41-1163-4de9-bf37-5580f3187990 None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:25:53.454527 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0762ac41-1163-4de9-bf37-5580f3187990 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:25:53.454619 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0762ac41-1163-4de9-bf37-5580f3187990 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:25:53.474493 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-0762ac41-1163-4de9-bf37-5580f3187990 None None] MFA Rules not processed for user `44883b22532e44049d846938dc2cf423`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:25:53.475858 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-0762ac41-1163-4de9-bf37-5580f3187990 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:25:53.551325 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 635/1289] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 10 05:25:53 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 05:25:53.579216 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b089075f-da9b-461e-8931-d652629fadb3 None None] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:25:53.697330 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b089075f-da9b-461e-8931-d652629fadb3 None None] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:25:53.733346 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98c6812-1dad-40e3-b395-4e44cd8956a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:25:53.734129 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98c6812-1dad-40e3-b395-4e44cd8956a2 None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:25:53.734407 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98c6812-1dad-40e3-b395-4e44cd8956a2 None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:25:53.734661 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98c6812-1dad-40e3-b395-4e44cd8956a2 None admin] PATH_INFO: `/v3/services/placement` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:25:53.735307 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98c6812-1dad-40e3-b395-4e44cd8956a2 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:25:53.736712 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98c6812-1dad-40e3-b395-4e44cd8956a2 None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:25:53.750935 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application [None req-d98c6812-1dad-40e3-b395-4e44cd8956a2 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 10 05:25:53.750935 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 05:25:53.750935 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 10 05:25:53.750935 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 10 05:25:53.750935 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 10 05:25:53.750935 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 10 05:25:53.750935 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 10 05:25:53.750935 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 05:25:53.750935 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 10 05:25:53.750935 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application May 10 05:25:53.750935 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 05:25:53.750935 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application May 10 05:25:53.750935 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 05:25:53.750935 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 05:25:53.750935 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 05:25:53.750935 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 05:25:53.750935 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 05:25:53.752160 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 05:25:53.752160 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 05:25:53.752160 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 05:25:53.752160 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 05:25:53.752160 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 05:25:53.752160 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 05:25:53.752160 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 10 05:25:53.752160 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self._get_service(service_id) May 10 05:25:53.752160 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 10 05:25:53.752160 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 10 05:25:53.752160 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 05:25:53.752160 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 05:25:53.752160 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 05:25:53.752160 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 05:25:53.752160 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 05:25:53.752160 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.get_or_create( May 10 05:25:53.753851 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 05:25:53.753851 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application with Lock( May 10 05:25:53.753851 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 05:25:53.753851 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self._enter() May 10 05:25:53.753851 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 05:25:53.753851 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 05:25:53.753851 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 05:25:53.753851 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.creator() May 10 05:25:53.753851 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 05:25:53.753851 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application created_value = creator( May 10 05:25:53.753851 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 10 05:25:53.753851 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 05:25:53.753851 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 10 05:25:53.753851 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application May 10 05:25:53.753851 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 655/1290] 10.222.0.23 () {56 vars in 1117 bytes} [Tue May 10 05:25:53 2022] GET /identity/v3/services/placement => generated 90 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 05:25:53.762510 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0762ac41-1163-4de9-bf37-5580f3187990 None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:25:53.877940 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0762ac41-1163-4de9-bf37-5580f3187990 None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:25:53.915190 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3482fd1d-9ca5-4048-afc6-187117409d69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:25:53.915876 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3482fd1d-9ca5-4048-afc6-187117409d69 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:25:53.916153 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3482fd1d-9ca5-4048-afc6-187117409d69 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:25:53.916423 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3482fd1d-9ca5-4048-afc6-187117409d69 None admin] PATH_INFO: `/v3/services` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:25:53.917125 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3482fd1d-9ca5-4048-afc6-187117409d69 None admin] RBAC: Adding query filter params (name=placement) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:25:53.917425 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3482fd1d-9ca5-4048-afc6-187117409d69 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:25:53.918786 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3482fd1d-9ca5-4048-afc6-187117409d69 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:25:53.923703 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 636/1291] 10.222.0.23 () {56 vars in 1116 bytes} [Tue May 10 05:25:53 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:25:53.932226 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98c6812-1dad-40e3-b395-4e44cd8956a2 None admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:25:54.037207 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98c6812-1dad-40e3-b395-4e44cd8956a2 None admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:25:54.077511 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a258c1-853d-4a72-a8c6-f27727525b7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:25:54.078537 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a258c1-853d-4a72-a8c6-f27727525b7e None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:25:54.078970 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a258c1-853d-4a72-a8c6-f27727525b7e None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:25:54.079390 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a258c1-853d-4a72-a8c6-f27727525b7e None admin] PATH_INFO: `/v3/services` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:25:54.080550 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a258c1-853d-4a72-a8c6-f27727525b7e None admin] RBAC: Adding query filter params (type=placement) {{(pid=79879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:25:54.081013 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a258c1-853d-4a72-a8c6-f27727525b7e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:25:54.083206 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a258c1-853d-4a72-a8c6-f27727525b7e None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:25:54.090556 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 656/1292] 10.222.0.23 () {56 vars in 1116 bytes} [Tue May 10 05:25:53 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 05:25:56.285573 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a1ad43-d30c-4312-98a8-642792f49133 None None] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:25:56.286144 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a1ad43-d30c-4312-98a8-642792f49133 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:25:56.286144 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a1ad43-d30c-4312-98a8-642792f49133 None None] PATH_INFO: `/` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:25:56.287516 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 637/1293] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 10 05:25:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 05:25:56.293892 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fecd1b6-5875-421b-b45d-59649aa01915 None None] REQUEST_METHOD: `POST` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:25:56.294604 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fecd1b6-5875-421b-b45d-59649aa01915 None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:25:56.294752 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fecd1b6-5875-421b-b45d-59649aa01915 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:25:56.320314 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.auth.core [None req-6fecd1b6-5875-421b-b45d-59649aa01915 None None] MFA Rules not processed for user `44883b22532e44049d846938dc2cf423`. Rule list: `[]` (Enabled: `True`). {{(pid=79879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:25:56.321490 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-6fecd1b6-5875-421b-b45d-59649aa01915 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:25:56.389921 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 657/1294] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 10 05:25:56 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 05:25:56.420128 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a1ad43-d30c-4312-98a8-642792f49133 None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:25:56.534209 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a1ad43-d30c-4312-98a8-642792f49133 None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:25:56.567737 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38851a72-2fca-4acf-b834-dcddd0e1ec93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:25:56.568391 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38851a72-2fca-4acf-b834-dcddd0e1ec93 None admin] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:25:56.568666 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38851a72-2fca-4acf-b834-dcddd0e1ec93 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:25:56.568934 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38851a72-2fca-4acf-b834-dcddd0e1ec93 None admin] PATH_INFO: `/v3/services` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:25:56.569655 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38851a72-2fca-4acf-b834-dcddd0e1ec93 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:25:56.571031 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38851a72-2fca-4acf-b834-dcddd0e1ec93 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:25:56.586952 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 638/1295] 10.222.0.23 () {60 vars in 1141 bytes} [Tue May 10 05:25:56 2022] POST /identity/v3/services => generated 246 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 05:25:58.841494 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e2aa28-ed79-44b4-8549-6805ba3b4ba4 None None] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:25:58.842330 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e2aa28-ed79-44b4-8549-6805ba3b4ba4 None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:25:58.842330 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e2aa28-ed79-44b4-8549-6805ba3b4ba4 None None] PATH_INFO: `/` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:25:58.844033 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 658/1296] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 10 05:25:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 05:25:58.849867 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb07a811-c127-420e-a0fe-82c26e2e7675 None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:25:58.850319 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb07a811-c127-420e-a0fe-82c26e2e7675 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:25:58.850410 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb07a811-c127-420e-a0fe-82c26e2e7675 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:25:58.868522 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-fb07a811-c127-420e-a0fe-82c26e2e7675 None None] MFA Rules not processed for user `44883b22532e44049d846938dc2cf423`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:25:58.869786 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-fb07a811-c127-420e-a0fe-82c26e2e7675 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:25:58.944447 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 639/1297] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 10 05:25:58 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 05:25:58.972164 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e2aa28-ed79-44b4-8549-6805ba3b4ba4 None None] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:25:59.084048 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e2aa28-ed79-44b4-8549-6805ba3b4ba4 None None] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:25:59.117412 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f22ebbc-a324-40e6-ad0e-2ef7e2a8d023 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:25:59.118128 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f22ebbc-a324-40e6-ad0e-2ef7e2a8d023 None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:25:59.118402 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f22ebbc-a324-40e6-ad0e-2ef7e2a8d023 None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:25:59.118673 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f22ebbc-a324-40e6-ad0e-2ef7e2a8d023 None admin] PATH_INFO: `/v3/services/placement` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:25:59.119314 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f22ebbc-a324-40e6-ad0e-2ef7e2a8d023 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:25:59.120718 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f22ebbc-a324-40e6-ad0e-2ef7e2a8d023 None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:25:59.132572 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application [None req-5f22ebbc-a324-40e6-ad0e-2ef7e2a8d023 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 10 05:25:59.132572 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 05:25:59.132572 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 10 05:25:59.132572 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 10 05:25:59.132572 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 10 05:25:59.132572 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 10 05:25:59.132572 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 10 05:25:59.132572 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 05:25:59.132572 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 10 05:25:59.132572 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application May 10 05:25:59.132572 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 05:25:59.132572 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application May 10 05:25:59.132572 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 05:25:59.132572 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 05:25:59.132572 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 05:25:59.132572 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 05:25:59.132572 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 05:25:59.133752 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 05:25:59.133752 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 05:25:59.133752 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 05:25:59.133752 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 05:25:59.133752 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 05:25:59.133752 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 05:25:59.133752 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 10 05:25:59.133752 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self._get_service(service_id) May 10 05:25:59.133752 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 10 05:25:59.133752 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 10 05:25:59.133752 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 05:25:59.133752 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 05:25:59.133752 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 05:25:59.133752 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 05:25:59.133752 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 05:25:59.133752 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.get_or_create( May 10 05:25:59.134967 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 05:25:59.134967 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application with Lock( May 10 05:25:59.134967 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 05:25:59.134967 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self._enter() May 10 05:25:59.134967 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 05:25:59.134967 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 05:25:59.134967 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 05:25:59.134967 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.creator() May 10 05:25:59.134967 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 05:25:59.134967 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application created_value = creator( May 10 05:25:59.134967 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 10 05:25:59.134967 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 05:25:59.134967 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 10 05:25:59.134967 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application May 10 05:25:59.134967 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 659/1298] 10.222.0.23 () {56 vars in 1117 bytes} [Tue May 10 05:25:58 2022] GET /identity/v3/services/placement => generated 90 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 05:25:59.140009 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb07a811-c127-420e-a0fe-82c26e2e7675 None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:25:59.239283 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb07a811-c127-420e-a0fe-82c26e2e7675 None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:25:59.274595 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b381c2b-4abb-4bbd-a96a-2ff5d0fc0e22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:25:59.275256 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b381c2b-4abb-4bbd-a96a-2ff5d0fc0e22 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:25:59.275534 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b381c2b-4abb-4bbd-a96a-2ff5d0fc0e22 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:25:59.275835 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b381c2b-4abb-4bbd-a96a-2ff5d0fc0e22 None admin] PATH_INFO: `/v3/services` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:25:59.276543 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b381c2b-4abb-4bbd-a96a-2ff5d0fc0e22 None admin] RBAC: Adding query filter params (name=placement) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:25:59.276845 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b381c2b-4abb-4bbd-a96a-2ff5d0fc0e22 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:25:59.278196 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b381c2b-4abb-4bbd-a96a-2ff5d0fc0e22 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:25:59.283426 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 640/1299] 10.222.0.23 () {56 vars in 1116 bytes} [Tue May 10 05:25:59 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 05:25:59.289616 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f22ebbc-a324-40e6-ad0e-2ef7e2a8d023 None admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:25:59.390195 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f22ebbc-a324-40e6-ad0e-2ef7e2a8d023 None admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:25:59.422801 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815d8cc8-92b8-4e03-b266-3f4df39c7379 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:25:59.423435 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815d8cc8-92b8-4e03-b266-3f4df39c7379 None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:25:59.423739 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815d8cc8-92b8-4e03-b266-3f4df39c7379 None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:25:59.423998 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815d8cc8-92b8-4e03-b266-3f4df39c7379 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:25:59.424808 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815d8cc8-92b8-4e03-b266-3f4df39c7379 None admin] RBAC: Adding query filter params (interface=public, service_id=a0c626cfb21d4fa29ee4b87ced908e40, region_id=RegionOne) {{(pid=79879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:25:59.425114 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815d8cc8-92b8-4e03-b266-3f4df39c7379 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:25:59.426483 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815d8cc8-92b8-4e03-b266-3f4df39c7379 None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:25:59.431330 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 660/1300] 10.222.0.23 () {56 vars in 1251 bytes} [Tue May 10 05:25:59 2022] GET /identity/v3/endpoints?service_id=a0c626cfb21d4fa29ee4b87ced908e40&interface=public®ion_id=RegionOne => generated 194 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:25:59.436959 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b381c2b-4abb-4bbd-a96a-2ff5d0fc0e22 None admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:25:59.537150 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b381c2b-4abb-4bbd-a96a-2ff5d0fc0e22 None admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:25:59.570785 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cc4f0c-ae8f-4660-aca5-ba0e21090ba2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:25:59.571444 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cc4f0c-ae8f-4660-aca5-ba0e21090ba2 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:25:59.571767 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cc4f0c-ae8f-4660-aca5-ba0e21090ba2 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:25:59.572032 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cc4f0c-ae8f-4660-aca5-ba0e21090ba2 None admin] PATH_INFO: `/v3/services` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:25:59.572714 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8cc4f0c-ae8f-4660-aca5-ba0e21090ba2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:25:59.574068 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8cc4f0c-ae8f-4660-aca5-ba0e21090ba2 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:25:59.580875 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 641/1301] 10.222.0.23 () {56 vars in 1087 bytes} [Tue May 10 05:25:59 2022] GET /identity/v3/services => generated 2191 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 05:26:01.760200 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e136cc59-f39e-4fee-aa76-7adcea3c4095 None None] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:26:01.761054 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e136cc59-f39e-4fee-aa76-7adcea3c4095 None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:26:01.761054 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e136cc59-f39e-4fee-aa76-7adcea3c4095 None None] PATH_INFO: `/` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:26:01.763141 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 661/1302] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 10 05:26:01 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 05:26:01.770340 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ee01bc-f0f4-4031-85a5-b26a65bbab90 None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:26:01.771109 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ee01bc-f0f4-4031-85a5-b26a65bbab90 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:26:01.771902 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ee01bc-f0f4-4031-85a5-b26a65bbab90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:26:01.795844 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-c5ee01bc-f0f4-4031-85a5-b26a65bbab90 None None] MFA Rules not processed for user `44883b22532e44049d846938dc2cf423`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:26:01.797039 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-c5ee01bc-f0f4-4031-85a5-b26a65bbab90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:26:01.867167 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 642/1303] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 10 05:26:01 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 05:26:01.893886 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e136cc59-f39e-4fee-aa76-7adcea3c4095 None None] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:26:02.009619 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e136cc59-f39e-4fee-aa76-7adcea3c4095 None None] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:26:02.045671 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fafb51c-e968-48f4-a8d7-2924696bfe22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:26:02.046463 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fafb51c-e968-48f4-a8d7-2924696bfe22 None admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:26:02.046742 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fafb51c-e968-48f4-a8d7-2924696bfe22 None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:26:02.047012 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fafb51c-e968-48f4-a8d7-2924696bfe22 None admin] PATH_INFO: `/v3/services/placement` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:26:02.047690 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fafb51c-e968-48f4-a8d7-2924696bfe22 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:26:02.049068 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fafb51c-e968-48f4-a8d7-2924696bfe22 None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:26:02.061216 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application [None req-3fafb51c-e968-48f4-a8d7-2924696bfe22 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 10 05:26:02.061216 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 05:26:02.061216 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 10 05:26:02.061216 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 10 05:26:02.061216 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 10 05:26:02.061216 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 10 05:26:02.061216 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 10 05:26:02.061216 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 05:26:02.061216 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 10 05:26:02.061216 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application May 10 05:26:02.061216 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 05:26:02.061216 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application May 10 05:26:02.061216 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 05:26:02.061216 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 05:26:02.061216 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 05:26:02.061216 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 05:26:02.061216 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 05:26:02.062409 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 05:26:02.062409 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 05:26:02.062409 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 05:26:02.062409 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 05:26:02.062409 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 05:26:02.062409 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 05:26:02.062409 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 10 05:26:02.062409 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self._get_service(service_id) May 10 05:26:02.062409 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 10 05:26:02.062409 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 10 05:26:02.062409 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 05:26:02.062409 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 05:26:02.062409 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 05:26:02.062409 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 05:26:02.062409 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 05:26:02.062409 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.get_or_create( May 10 05:26:02.063432 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 05:26:02.063432 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application with Lock( May 10 05:26:02.063432 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 05:26:02.063432 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self._enter() May 10 05:26:02.063432 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 05:26:02.063432 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 05:26:02.063432 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 05:26:02.063432 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application return self.creator() May 10 05:26:02.063432 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 05:26:02.063432 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application created_value = creator( May 10 05:26:02.063432 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 10 05:26:02.063432 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 05:26:02.063432 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 10 05:26:02.063432 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: ERROR keystone.server.flask.application May 10 05:26:02.063432 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 662/1304] 10.222.0.23 () {56 vars in 1117 bytes} [Tue May 10 05:26:01 2022] GET /identity/v3/services/placement => generated 90 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 05:26:02.069405 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ee01bc-f0f4-4031-85a5-b26a65bbab90 None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:26:02.172371 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ee01bc-f0f4-4031-85a5-b26a65bbab90 None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:26:02.205718 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657f5612-230d-4927-9560-e7644dda2bb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:26:02.206374 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657f5612-230d-4927-9560-e7644dda2bb5 None admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:26:02.206648 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657f5612-230d-4927-9560-e7644dda2bb5 None admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:26:02.206911 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657f5612-230d-4927-9560-e7644dda2bb5 None admin] PATH_INFO: `/v3/services` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:26:02.207644 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657f5612-230d-4927-9560-e7644dda2bb5 None admin] RBAC: Adding query filter params (name=placement) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:26:02.207940 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657f5612-230d-4927-9560-e7644dda2bb5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:26:02.209302 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657f5612-230d-4927-9560-e7644dda2bb5 None admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:26:02.214305 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 643/1305] 10.222.0.23 () {56 vars in 1116 bytes} [Tue May 10 05:26:02 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:26:02.220321 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fafb51c-e968-48f4-a8d7-2924696bfe22 None admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:26:02.321705 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fafb51c-e968-48f4-a8d7-2924696bfe22 None admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:26:02.362793 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af850939-94c9-46df-8971-59a1511b527e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:26:02.363438 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af850939-94c9-46df-8971-59a1511b527e None admin] REQUEST_METHOD: `POST` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:26:02.363780 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af850939-94c9-46df-8971-59a1511b527e None admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:26:02.364058 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af850939-94c9-46df-8971-59a1511b527e None admin] PATH_INFO: `/v3/endpoints` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:26:02.364812 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af850939-94c9-46df-8971-59a1511b527e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:26:02.366193 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af850939-94c9-46df-8971-59a1511b527e None admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:26:02.389158 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 663/1306] 10.222.0.23 () {60 vars in 1144 bytes} [Tue May 10 05:26:02 2022] POST /identity/v3/endpoints => generated 331 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 05:27:05.829276 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c88dccf-b49d-41a9-aa45-b6bd7ef124a9 None None] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:27:05.829877 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c88dccf-b49d-41a9-aa45-b6bd7ef124a9 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:27:05.829877 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c88dccf-b49d-41a9-aa45-b6bd7ef124a9 None None] PATH_INFO: `/` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:27:05.831201 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 644/1307] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 10 05:27:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 05:27:05.836775 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca02f10-a464-4f7f-8ae7-1a0b7739adbd None None] REQUEST_METHOD: `POST` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:27:05.837221 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca02f10-a464-4f7f-8ae7-1a0b7739adbd None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:27:05.837304 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca02f10-a464-4f7f-8ae7-1a0b7739adbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:27:05.910806 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.auth.core [None req-6ca02f10-a464-4f7f-8ae7-1a0b7739adbd None None] MFA Rules not processed for user `44883b22532e44049d846938dc2cf423`. Rule list: `[]` (Enabled: `True`). {{(pid=79879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:27:05.912203 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-6ca02f10-a464-4f7f-8ae7-1a0b7739adbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:27:06.028342 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 664/1308] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 10 05:27:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 05:27:06.067318 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3b14cd-39cf-4432-887b-155177244d86 None None] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:27:06.068101 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3b14cd-39cf-4432-887b-155177244d86 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:27:06.068719 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3b14cd-39cf-4432-887b-155177244d86 None None] PATH_INFO: `/` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:27:06.070772 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 645/1309] 10.222.0.23 () {54 vars in 964 bytes} [Tue May 10 05:27:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 05:27:06.077073 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a82949b-61b0-40ce-90bf-c7530820a94a None None] REQUEST_METHOD: `POST` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:27:06.077388 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a82949b-61b0-40ce-90bf-c7530820a94a None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:27:06.077645 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a82949b-61b0-40ce-90bf-c7530820a94a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:27:06.159172 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.auth.core [None req-9a82949b-61b0-40ce-90bf-c7530820a94a None None] MFA Rules not processed for user `3c8461cfdd9648b8abcaf8d34b7a102a`. Rule list: `[]` (Enabled: `True`). {{(pid=79879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:27:06.160325 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-9a82949b-61b0-40ce-90bf-c7530820a94a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:27:06.246680 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 665/1310] 10.222.0.23 () {58 vars in 1061 bytes} [Tue May 10 05:27:06 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 05:27:06.247645 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3b14cd-39cf-4432-887b-155177244d86 None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:27:06.249739 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-fc3b14cd-39cf-4432-887b-155177244d86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:27:06.384099 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3b14cd-39cf-4432-887b-155177244d86 None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:27:06.458386 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de7a08d-9f3f-421e-a941-3544610a6e14 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c8461cfdd9648b8abcaf8d34b7a102a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f23435f783540199d6dcfd0417c090e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:27:06.459284 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de7a08d-9f3f-421e-a941-3544610a6e14 service neutron] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:27:06.459566 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de7a08d-9f3f-421e-a941-3544610a6e14 service neutron] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:27:06.459860 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de7a08d-9f3f-421e-a941-3544610a6e14 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:27:06.461506 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-1de7a08d-9f3f-421e-a941-3544610a6e14 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:27:06.581373 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de7a08d-9f3f-421e-a941-3544610a6e14 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:27:06.582878 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de7a08d-9f3f-421e-a941-3544610a6e14 service neutron] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:27:06.602874 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 646/1311] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 10 05:27:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 05:27:09.097974 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db7b6ca-eeb5-4994-8c12-dab0724d20e9 None None] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:27:09.098585 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db7b6ca-eeb5-4994-8c12-dab0724d20e9 None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:27:09.098585 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db7b6ca-eeb5-4994-8c12-dab0724d20e9 None None] PATH_INFO: `/` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:27:09.100047 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 666/1312] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 10 05:27:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 05:27:09.105598 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74856025-8378-4a7a-a6fc-522c2a6be98e None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:27:09.106057 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74856025-8378-4a7a-a6fc-522c2a6be98e None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:27:09.106147 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74856025-8378-4a7a-a6fc-522c2a6be98e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:27:09.189782 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-74856025-8378-4a7a-a6fc-522c2a6be98e None None] MFA Rules not processed for user `44883b22532e44049d846938dc2cf423`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:27:09.190896 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-74856025-8378-4a7a-a6fc-522c2a6be98e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:27:09.292396 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 647/1313] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 10 05:27:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 05:27:09.330022 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db7b6ca-eeb5-4994-8c12-dab0724d20e9 None None] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:27:09.331557 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-6db7b6ca-eeb5-4994-8c12-dab0724d20e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:27:09.495892 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db7b6ca-eeb5-4994-8c12-dab0724d20e9 None None] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:27:09.577744 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5547d131-bf9f-41b3-9825-ce735f08d34e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c8461cfdd9648b8abcaf8d34b7a102a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f23435f783540199d6dcfd0417c090e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:27:09.578401 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5547d131-bf9f-41b3-9825-ce735f08d34e service neutron] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:27:09.578635 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5547d131-bf9f-41b3-9825-ce735f08d34e service neutron] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:27:09.578910 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5547d131-bf9f-41b3-9825-ce735f08d34e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:27:09.580679 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-5547d131-bf9f-41b3-9825-ce735f08d34e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:27:09.705129 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5547d131-bf9f-41b3-9825-ce735f08d34e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:27:09.706790 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5547d131-bf9f-41b3-9825-ce735f08d34e service neutron] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:27:09.728001 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 667/1314] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 10 05:27:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 05:27:12.231102 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d39dbd-7307-408c-afbf-53bb6a61427b None None] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:27:12.231671 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d39dbd-7307-408c-afbf-53bb6a61427b None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:27:12.231671 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d39dbd-7307-408c-afbf-53bb6a61427b None None] PATH_INFO: `/` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:27:12.232972 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 648/1315] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 10 05:27:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 05:27:12.238751 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5402a77a-dffc-4471-a787-0abd1c4165c3 None None] REQUEST_METHOD: `POST` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:27:12.239210 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5402a77a-dffc-4471-a787-0abd1c4165c3 None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:27:12.239321 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5402a77a-dffc-4471-a787-0abd1c4165c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:27:12.304765 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.auth.core [None req-5402a77a-dffc-4471-a787-0abd1c4165c3 None None] MFA Rules not processed for user `6356a96ee91d4828b89e3791aae2bb59`. Rule list: `[]` (Enabled: `True`). {{(pid=79879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:27:12.305956 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-5402a77a-dffc-4471-a787-0abd1c4165c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:27:12.401584 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 668/1316] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 10 05:27:12 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 05:27:12.441080 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d39dbd-7307-408c-afbf-53bb6a61427b None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:27:12.442635 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-55d39dbd-7307-408c-afbf-53bb6a61427b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:27:12.553432 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d39dbd-7307-408c-afbf-53bb6a61427b None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:27:12.627295 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4572fb8-0ff0-44a8-9897-6ac74d3ca2fa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c8461cfdd9648b8abcaf8d34b7a102a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f23435f783540199d6dcfd0417c090e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:27:12.628318 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4572fb8-0ff0-44a8-9897-6ac74d3ca2fa service neutron] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:27:12.628725 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4572fb8-0ff0-44a8-9897-6ac74d3ca2fa service neutron] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:27:12.629161 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4572fb8-0ff0-44a8-9897-6ac74d3ca2fa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:27:12.631958 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-a4572fb8-0ff0-44a8-9897-6ac74d3ca2fa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:27:12.770194 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4572fb8-0ff0-44a8-9897-6ac74d3ca2fa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:27:12.771670 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4572fb8-0ff0-44a8-9897-6ac74d3ca2fa service neutron] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:27:12.790097 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 649/1317] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 10 05:27:12 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 05:27:15.533603 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc1c3e9-a87a-43c0-ac90-12db7b41c3b6 None None] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:27:15.534490 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc1c3e9-a87a-43c0-ac90-12db7b41c3b6 None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:27:15.534490 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc1c3e9-a87a-43c0-ac90-12db7b41c3b6 None None] PATH_INFO: `/` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:27:15.536908 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 669/1318] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 10 05:27:15 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 05:27:15.543434 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efe9971-74df-4318-bc22-6f1968ad8783 None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:27:15.544268 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efe9971-74df-4318-bc22-6f1968ad8783 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:27:15.544427 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efe9971-74df-4318-bc22-6f1968ad8783 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:27:15.623799 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-8efe9971-74df-4318-bc22-6f1968ad8783 None None] MFA Rules not processed for user `44883b22532e44049d846938dc2cf423`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:27:15.625375 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-8efe9971-74df-4318-bc22-6f1968ad8783 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:27:15.726210 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 650/1319] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 10 05:27:15 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 05:27:15.785350 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc1c3e9-a87a-43c0-ac90-12db7b41c3b6 None None] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:27:15.787917 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-0dc1c3e9-a87a-43c0-ac90-12db7b41c3b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:27:15.905114 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc1c3e9-a87a-43c0-ac90-12db7b41c3b6 None None] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:27:15.987377 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53091763-ddbd-4033-88b4-ab045fa74676 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c8461cfdd9648b8abcaf8d34b7a102a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f23435f783540199d6dcfd0417c090e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:27:15.987993 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53091763-ddbd-4033-88b4-ab045fa74676 service neutron] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:27:15.988268 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53091763-ddbd-4033-88b4-ab045fa74676 service neutron] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:27:15.988542 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53091763-ddbd-4033-88b4-ab045fa74676 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:27:15.990169 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-53091763-ddbd-4033-88b4-ab045fa74676 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:27:16.099480 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53091763-ddbd-4033-88b4-ab045fa74676 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:27:16.100969 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53091763-ddbd-4033-88b4-ab045fa74676 service neutron] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:27:16.118476 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 670/1320] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 10 05:27:15 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 05:27:18.980529 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29138a3a-8107-45e3-83d9-d033e2ff3038 None None] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:27:18.981132 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29138a3a-8107-45e3-83d9-d033e2ff3038 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:27:18.981132 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29138a3a-8107-45e3-83d9-d033e2ff3038 None None] PATH_INFO: `/` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:27:18.982479 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 651/1321] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 10 05:27:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 05:27:18.987986 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb0a7d9-2713-409d-91b3-3dd3aa5562bc None None] REQUEST_METHOD: `POST` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:27:18.988433 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb0a7d9-2713-409d-91b3-3dd3aa5562bc None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:27:18.988654 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb0a7d9-2713-409d-91b3-3dd3aa5562bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:27:19.052565 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.auth.core [None req-fcb0a7d9-2713-409d-91b3-3dd3aa5562bc None None] MFA Rules not processed for user `44883b22532e44049d846938dc2cf423`. Rule list: `[]` (Enabled: `True`). {{(pid=79879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:27:19.053750 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-fcb0a7d9-2713-409d-91b3-3dd3aa5562bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:27:19.152541 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 671/1322] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 10 05:27:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 05:27:19.187381 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29138a3a-8107-45e3-83d9-d033e2ff3038 None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:27:19.188979 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-29138a3a-8107-45e3-83d9-d033e2ff3038 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:27:19.291835 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29138a3a-8107-45e3-83d9-d033e2ff3038 None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:27:19.364520 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7deb402f-e3e8-4fa3-80d4-9276291feaa3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c8461cfdd9648b8abcaf8d34b7a102a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f23435f783540199d6dcfd0417c090e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:27:19.365171 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7deb402f-e3e8-4fa3-80d4-9276291feaa3 service neutron] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:27:19.365447 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7deb402f-e3e8-4fa3-80d4-9276291feaa3 service neutron] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:27:19.365714 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7deb402f-e3e8-4fa3-80d4-9276291feaa3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:27:19.367460 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-7deb402f-e3e8-4fa3-80d4-9276291feaa3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:27:19.481786 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7deb402f-e3e8-4fa3-80d4-9276291feaa3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:27:19.483266 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7deb402f-e3e8-4fa3-80d4-9276291feaa3 service neutron] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:27:19.502965 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 652/1323] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 10 05:27:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 05:27:21.756067 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec05b2c-8cf8-4808-b53e-084c79b5f766 None None] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:27:21.756601 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec05b2c-8cf8-4808-b53e-084c79b5f766 None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:27:21.756601 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec05b2c-8cf8-4808-b53e-084c79b5f766 None None] PATH_INFO: `/` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:27:21.758280 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 672/1324] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 10 05:27:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 05:27:21.763134 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1497f7a1-d7ff-424d-9bc4-36992095cf2d None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:27:21.763598 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1497f7a1-d7ff-424d-9bc4-36992095cf2d None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:27:21.763692 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1497f7a1-d7ff-424d-9bc4-36992095cf2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:27:21.828564 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-1497f7a1-d7ff-424d-9bc4-36992095cf2d None None] MFA Rules not processed for user `44883b22532e44049d846938dc2cf423`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:27:21.829791 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-1497f7a1-d7ff-424d-9bc4-36992095cf2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:27:21.925123 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 653/1325] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 10 05:27:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 05:27:21.960421 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec05b2c-8cf8-4808-b53e-084c79b5f766 None None] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:27:21.962081 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-eec05b2c-8cf8-4808-b53e-084c79b5f766 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:27:22.069205 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec05b2c-8cf8-4808-b53e-084c79b5f766 None None] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:27:22.140766 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813dc6d0-9326-4614-a598-75cac76456d2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c8461cfdd9648b8abcaf8d34b7a102a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f23435f783540199d6dcfd0417c090e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:27:22.141418 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813dc6d0-9326-4614-a598-75cac76456d2 service neutron] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:27:22.141694 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813dc6d0-9326-4614-a598-75cac76456d2 service neutron] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:27:22.141968 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813dc6d0-9326-4614-a598-75cac76456d2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:27:22.143613 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-813dc6d0-9326-4614-a598-75cac76456d2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:27:22.251327 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813dc6d0-9326-4614-a598-75cac76456d2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:27:22.252800 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813dc6d0-9326-4614-a598-75cac76456d2 service neutron] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:27:22.270749 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 673/1326] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 10 05:27:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 05:27:24.523925 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cfdb0a-ae8a-4906-a04c-2c4ad1068402 None None] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:27:24.524483 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cfdb0a-ae8a-4906-a04c-2c4ad1068402 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:27:24.524483 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cfdb0a-ae8a-4906-a04c-2c4ad1068402 None None] PATH_INFO: `/` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:27:24.526144 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 654/1327] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 10 05:27:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 05:27:24.531736 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c044520f-0a11-4064-bd88-1697ab65c9c8 None None] REQUEST_METHOD: `POST` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:27:24.532168 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c044520f-0a11-4064-bd88-1697ab65c9c8 None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:27:24.532331 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c044520f-0a11-4064-bd88-1697ab65c9c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:27:24.602777 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.auth.core [None req-c044520f-0a11-4064-bd88-1697ab65c9c8 None None] MFA Rules not processed for user `6356a96ee91d4828b89e3791aae2bb59`. Rule list: `[]` (Enabled: `True`). {{(pid=79879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:27:24.603991 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-c044520f-0a11-4064-bd88-1697ab65c9c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:27:24.705336 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 674/1328] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 10 05:27:24 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 05:27:24.759014 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab0ca3a-379f-4171-89e4-d7665128dad8 None None] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:27:24.759492 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab0ca3a-379f-4171-89e4-d7665128dad8 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:27:24.759860 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab0ca3a-379f-4171-89e4-d7665128dad8 None None] PATH_INFO: `/` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:27:24.761538 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 655/1329] 10.222.0.23 () {54 vars in 964 bytes} [Tue May 10 05:27:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 05:27:24.768306 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079d62af-b983-4577-933b-b1fffccae235 None None] REQUEST_METHOD: `POST` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:27:24.768596 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079d62af-b983-4577-933b-b1fffccae235 None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:27:24.768846 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079d62af-b983-4577-933b-b1fffccae235 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:27:24.844078 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.auth.core [None req-079d62af-b983-4577-933b-b1fffccae235 None None] MFA Rules not processed for user `3c8461cfdd9648b8abcaf8d34b7a102a`. Rule list: `[]` (Enabled: `True`). {{(pid=79879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:27:24.845386 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-079d62af-b983-4577-933b-b1fffccae235 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:27:24.921544 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 675/1330] 10.222.0.23 () {58 vars in 1061 bytes} [Tue May 10 05:27:24 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 05:27:24.930754 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab0ca3a-379f-4171-89e4-d7665128dad8 None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:27:24.932456 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-3ab0ca3a-379f-4171-89e4-d7665128dad8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:27:25.039630 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab0ca3a-379f-4171-89e4-d7665128dad8 None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:27:25.116607 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd49cf7-11b4-43ac-92e8-6ab0e8e4ade7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c8461cfdd9648b8abcaf8d34b7a102a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f23435f783540199d6dcfd0417c090e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:27:25.117274 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd49cf7-11b4-43ac-92e8-6ab0e8e4ade7 service neutron] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:27:25.117556 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd49cf7-11b4-43ac-92e8-6ab0e8e4ade7 service neutron] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:27:25.117824 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd49cf7-11b4-43ac-92e8-6ab0e8e4ade7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:27:25.119478 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-0dd49cf7-11b4-43ac-92e8-6ab0e8e4ade7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:27:25.237657 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd49cf7-11b4-43ac-92e8-6ab0e8e4ade7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:27:25.239122 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd49cf7-11b4-43ac-92e8-6ab0e8e4ade7 service neutron] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:27:25.258250 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 656/1331] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 10 05:27:24 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 05:27:28.083326 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1881e41c-88bc-4814-ab6d-3e6b8b7f03cf None None] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:27:28.083905 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1881e41c-88bc-4814-ab6d-3e6b8b7f03cf None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:27:28.083905 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1881e41c-88bc-4814-ab6d-3e6b8b7f03cf None None] PATH_INFO: `/` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:27:28.086886 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 676/1332] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 10 05:27:28 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 05:27:28.091276 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f26862-5bf9-40f1-8a69-59644f293714 None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:27:28.091914 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f26862-5bf9-40f1-8a69-59644f293714 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:27:28.091914 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f26862-5bf9-40f1-8a69-59644f293714 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:27:28.161906 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-22f26862-5bf9-40f1-8a69-59644f293714 None None] MFA Rules not processed for user `44883b22532e44049d846938dc2cf423`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:27:28.163157 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-22f26862-5bf9-40f1-8a69-59644f293714 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:27:28.263847 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 657/1333] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 10 05:27:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 05:27:28.299377 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1881e41c-88bc-4814-ab6d-3e6b8b7f03cf None None] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:27:28.300939 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-1881e41c-88bc-4814-ab6d-3e6b8b7f03cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:27:28.415581 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1881e41c-88bc-4814-ab6d-3e6b8b7f03cf None None] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:27:28.490150 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43346fa9-c510-4c1e-a4ad-f65fbbcbc5df service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c8461cfdd9648b8abcaf8d34b7a102a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f23435f783540199d6dcfd0417c090e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:27:28.490819 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43346fa9-c510-4c1e-a4ad-f65fbbcbc5df service neutron] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:27:28.491102 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43346fa9-c510-4c1e-a4ad-f65fbbcbc5df service neutron] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:27:28.491359 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43346fa9-c510-4c1e-a4ad-f65fbbcbc5df service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:27:28.493246 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-43346fa9-c510-4c1e-a4ad-f65fbbcbc5df service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:27:28.610458 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43346fa9-c510-4c1e-a4ad-f65fbbcbc5df service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:27:28.611873 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43346fa9-c510-4c1e-a4ad-f65fbbcbc5df service neutron] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:27:28.631045 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 677/1334] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 10 05:27:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 05:27:30.875646 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf7f484-4b23-45ee-9613-22d54462a7a7 None None] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:27:30.876528 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf7f484-4b23-45ee-9613-22d54462a7a7 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:27:30.876636 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf7f484-4b23-45ee-9613-22d54462a7a7 None None] PATH_INFO: `/` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:27:30.878939 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 658/1335] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 10 05:27:30 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 05:27:30.884701 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00c1a1e-1792-4487-899f-1a4b747315e7 None None] REQUEST_METHOD: `POST` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:27:30.885129 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00c1a1e-1792-4487-899f-1a4b747315e7 None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:27:30.885250 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00c1a1e-1792-4487-899f-1a4b747315e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:27:30.956800 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.auth.core [None req-b00c1a1e-1792-4487-899f-1a4b747315e7 None None] MFA Rules not processed for user `44883b22532e44049d846938dc2cf423`. Rule list: `[]` (Enabled: `True`). {{(pid=79879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:27:30.958014 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-b00c1a1e-1792-4487-899f-1a4b747315e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:27:31.056231 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 678/1336] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 10 05:27:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 05:27:31.099295 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf7f484-4b23-45ee-9613-22d54462a7a7 None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:27:31.101782 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-5cf7f484-4b23-45ee-9613-22d54462a7a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:27:31.214244 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf7f484-4b23-45ee-9613-22d54462a7a7 None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:27:31.291282 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f19fe0-fab2-43e9-8861-4895d6b92b1f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c8461cfdd9648b8abcaf8d34b7a102a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f23435f783540199d6dcfd0417c090e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:27:31.292050 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f19fe0-fab2-43e9-8861-4895d6b92b1f service neutron] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:27:31.292329 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f19fe0-fab2-43e9-8861-4895d6b92b1f service neutron] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:27:31.292601 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f19fe0-fab2-43e9-8861-4895d6b92b1f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:27:31.294396 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-04f19fe0-fab2-43e9-8861-4895d6b92b1f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:27:31.406532 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f19fe0-fab2-43e9-8861-4895d6b92b1f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:27:31.408040 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f19fe0-fab2-43e9-8861-4895d6b92b1f service neutron] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:27:31.425681 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 659/1337] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 10 05:27:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 05:27:34.071985 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a619f050-8d94-47a0-857e-c9201f780785 None None] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:27:34.072614 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a619f050-8d94-47a0-857e-c9201f780785 None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:27:34.072614 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a619f050-8d94-47a0-857e-c9201f780785 None None] PATH_INFO: `/` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:27:34.073945 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 679/1338] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 10 05:27:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 05:27:34.080318 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e5baf0-26f3-44dc-a79f-a62a68e5707c None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:27:34.081087 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e5baf0-26f3-44dc-a79f-a62a68e5707c None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:27:34.081181 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e5baf0-26f3-44dc-a79f-a62a68e5707c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:27:34.155176 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-59e5baf0-26f3-44dc-a79f-a62a68e5707c None None] MFA Rules not processed for user `44883b22532e44049d846938dc2cf423`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:27:34.156427 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-59e5baf0-26f3-44dc-a79f-a62a68e5707c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:27:34.251841 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 660/1339] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 10 05:27:34 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 05:27:34.294849 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a619f050-8d94-47a0-857e-c9201f780785 None None] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:27:34.296430 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-a619f050-8d94-47a0-857e-c9201f780785 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:27:34.414640 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a619f050-8d94-47a0-857e-c9201f780785 None None] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:27:34.490488 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3366cc-eb9b-4c48-a9a3-6f974aa55d34 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c8461cfdd9648b8abcaf8d34b7a102a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f23435f783540199d6dcfd0417c090e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:27:34.491150 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3366cc-eb9b-4c48-a9a3-6f974aa55d34 service neutron] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:27:34.491434 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3366cc-eb9b-4c48-a9a3-6f974aa55d34 service neutron] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:27:34.491741 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3366cc-eb9b-4c48-a9a3-6f974aa55d34 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:27:34.493405 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-ec3366cc-eb9b-4c48-a9a3-6f974aa55d34 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:27:34.617921 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3366cc-eb9b-4c48-a9a3-6f974aa55d34 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:27:34.620032 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3366cc-eb9b-4c48-a9a3-6f974aa55d34 service neutron] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:27:34.643170 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 680/1340] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 10 05:27:34 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 05:27:38.982336 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5e7a27-a21f-4113-91a5-e7dbed3bb2bb None None] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:27:38.982893 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5e7a27-a21f-4113-91a5-e7dbed3bb2bb None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:27:38.982893 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5e7a27-a21f-4113-91a5-e7dbed3bb2bb None None] PATH_INFO: `/` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:27:38.984237 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 661/1341] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 10 05:27:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 05:27:38.989754 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4c3790-09bd-4c49-b92e-55ba489d7575 None None] REQUEST_METHOD: `POST` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:27:38.990214 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4c3790-09bd-4c49-b92e-55ba489d7575 None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:27:38.990310 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4c3790-09bd-4c49-b92e-55ba489d7575 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:27:39.062675 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.auth.core [None req-5d4c3790-09bd-4c49-b92e-55ba489d7575 None None] MFA Rules not processed for user `44883b22532e44049d846938dc2cf423`. Rule list: `[]` (Enabled: `True`). {{(pid=79879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:27:39.063838 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-5d4c3790-09bd-4c49-b92e-55ba489d7575 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:27:39.172196 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 681/1342] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 10 05:27:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 05:27:39.210617 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5e7a27-a21f-4113-91a5-e7dbed3bb2bb None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:27:39.213014 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-7d5e7a27-a21f-4113-91a5-e7dbed3bb2bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:27:39.310572 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5e7a27-a21f-4113-91a5-e7dbed3bb2bb None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:27:39.315022 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ff5973-0940-4618-baef-e6c0344f385d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c8461cfdd9648b8abcaf8d34b7a102a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f23435f783540199d6dcfd0417c090e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:27:39.315618 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ff5973-0940-4618-baef-e6c0344f385d service neutron] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:27:39.315919 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ff5973-0940-4618-baef-e6c0344f385d service neutron] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:27:39.316149 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ff5973-0940-4618-baef-e6c0344f385d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:27:39.325489 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ff5973-0940-4618-baef-e6c0344f385d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:27:39.326923 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ff5973-0940-4618-baef-e6c0344f385d service neutron] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:27:39.337371 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 662/1343] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 10 05:27:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 05:27:42.112614 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731a9746-df72-42e1-8a4e-01b7dd3f01dc None None] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:27:42.113236 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731a9746-df72-42e1-8a4e-01b7dd3f01dc None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:27:42.113236 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731a9746-df72-42e1-8a4e-01b7dd3f01dc None None] PATH_INFO: `/` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:27:42.114449 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 682/1344] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 10 05:27:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 05:27:42.119867 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3501a800-0ca2-4751-abe2-2dacf5aa21ca None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:27:42.120325 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3501a800-0ca2-4751-abe2-2dacf5aa21ca None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:27:42.120544 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3501a800-0ca2-4751-abe2-2dacf5aa21ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:27:42.150864 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-3501a800-0ca2-4751-abe2-2dacf5aa21ca None None] MFA Rules not processed for user `44883b22532e44049d846938dc2cf423`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:27:42.152082 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-3501a800-0ca2-4751-abe2-2dacf5aa21ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:27:42.230074 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 663/1345] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 10 05:27:42 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 05:27:42.266502 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731a9746-df72-42e1-8a4e-01b7dd3f01dc None None] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:27:42.268365 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-731a9746-df72-42e1-8a4e-01b7dd3f01dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:27:42.281902 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731a9746-df72-42e1-8a4e-01b7dd3f01dc None None] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:27:42.285860 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a9d3f9-d067-493f-876e-6b1962ad5b8c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c8461cfdd9648b8abcaf8d34b7a102a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f23435f783540199d6dcfd0417c090e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:27:42.286494 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a9d3f9-d067-493f-876e-6b1962ad5b8c service neutron] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:27:42.286749 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a9d3f9-d067-493f-876e-6b1962ad5b8c service neutron] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:27:42.287056 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a9d3f9-d067-493f-876e-6b1962ad5b8c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:27:42.296341 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a9d3f9-d067-493f-876e-6b1962ad5b8c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:27:42.297785 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a9d3f9-d067-493f-876e-6b1962ad5b8c service neutron] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:27:42.307461 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 683/1346] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 10 05:27:42 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 05:27:46.863904 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48d6e81-ff68-4c70-a82b-80629143827d None None] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:27:46.864468 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48d6e81-ff68-4c70-a82b-80629143827d None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:27:46.864468 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48d6e81-ff68-4c70-a82b-80629143827d None None] PATH_INFO: `/` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:27:46.865923 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 664/1347] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 10 05:27:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 05:27:46.871378 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650ae464-d58e-4095-8b77-3d33778e6018 None None] REQUEST_METHOD: `POST` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:27:46.871833 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650ae464-d58e-4095-8b77-3d33778e6018 None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:27:46.871982 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650ae464-d58e-4095-8b77-3d33778e6018 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:27:46.890340 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.auth.core [None req-650ae464-d58e-4095-8b77-3d33778e6018 None None] MFA Rules not processed for user `44883b22532e44049d846938dc2cf423`. Rule list: `[]` (Enabled: `True`). {{(pid=79879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:27:46.891524 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-650ae464-d58e-4095-8b77-3d33778e6018 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:27:46.899975 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 684/1348] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 10 05:27:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 05:27:46.937837 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48d6e81-ff68-4c70-a82b-80629143827d None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:27:46.950144 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48d6e81-ff68-4c70-a82b-80629143827d None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:27:46.954323 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87ee6ed-671a-489a-9cbd-5470cd686b0c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c8461cfdd9648b8abcaf8d34b7a102a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f23435f783540199d6dcfd0417c090e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:27:46.954960 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87ee6ed-671a-489a-9cbd-5470cd686b0c service neutron] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:27:46.955238 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87ee6ed-671a-489a-9cbd-5470cd686b0c service neutron] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:27:46.955509 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87ee6ed-671a-489a-9cbd-5470cd686b0c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:27:46.964487 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87ee6ed-671a-489a-9cbd-5470cd686b0c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:27:46.965920 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87ee6ed-671a-489a-9cbd-5470cd686b0c service neutron] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:27:46.975263 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 665/1349] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 10 05:27:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 05:27:52.258623 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3825dc-cad5-429b-9310-a809c560605f None None] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:27:52.259900 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3825dc-cad5-429b-9310-a809c560605f None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:27:52.260354 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3825dc-cad5-429b-9310-a809c560605f None None] PATH_INFO: `/` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:27:52.261906 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 685/1350] 10.222.0.23 () {54 vars in 921 bytes} [Tue May 10 05:27:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 05:27:52.268249 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6453025c-3fab-4d03-9676-86c034884f64 None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:27:52.268719 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6453025c-3fab-4d03-9676-86c034884f64 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:27:52.269001 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6453025c-3fab-4d03-9676-86c034884f64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:27:52.346684 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-6453025c-3fab-4d03-9676-86c034884f64 None None] MFA Rules not processed for user `67321ca3e5624273acd5b06264738000`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:27:52.348265 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-6453025c-3fab-4d03-9676-86c034884f64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:27:52.465393 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 666/1351] 10.222.0.23 () {58 vars in 1018 bytes} [Tue May 10 05:27:52 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 05:27:56.405481 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd38afd5-ea72-4bfa-9549-293f2b4e409e None None] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:27:56.406418 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd38afd5-ea72-4bfa-9549-293f2b4e409e None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:27:56.406701 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd38afd5-ea72-4bfa-9549-293f2b4e409e None None] PATH_INFO: `/` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:27:56.408289 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 686/1352] 10.222.0.23 () {54 vars in 921 bytes} [Tue May 10 05:27:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 05:27:56.415772 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc40175-e4b9-488d-a108-100162f856f8 None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:27:56.416632 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc40175-e4b9-488d-a108-100162f856f8 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:27:56.416973 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc40175-e4b9-488d-a108-100162f856f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:27:56.435938 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-6fc40175-e4b9-488d-a108-100162f856f8 None None] MFA Rules not processed for user `67321ca3e5624273acd5b06264738000`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:27:56.437242 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-6fc40175-e4b9-488d-a108-100162f856f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:27:56.446542 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 667/1353] 10.222.0.23 () {58 vars in 1018 bytes} [Tue May 10 05:27:56 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 05:27:58.110142 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711418a9-ef37-4ee3-9786-3c9e8995a3d6 None None] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:27:58.110701 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711418a9-ef37-4ee3-9786-3c9e8995a3d6 None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:27:58.110701 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711418a9-ef37-4ee3-9786-3c9e8995a3d6 None None] PATH_INFO: `/` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:27:58.112262 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 687/1354] 10.222.0.23 () {54 vars in 921 bytes} [Tue May 10 05:27:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 05:27:58.117442 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5749d6-2bfb-4416-bb6b-6dca9033ca63 None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:27:58.117886 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5749d6-2bfb-4416-bb6b-6dca9033ca63 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:27:58.118135 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5749d6-2bfb-4416-bb6b-6dca9033ca63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:27:58.137973 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-4d5749d6-2bfb-4416-bb6b-6dca9033ca63 None None] MFA Rules not processed for user `67321ca3e5624273acd5b06264738000`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:27:58.139169 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-4d5749d6-2bfb-4416-bb6b-6dca9033ca63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:27:58.148268 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 668/1355] 10.222.0.23 () {58 vars in 1018 bytes} [Tue May 10 05:27:58 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 05:28:02.026116 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ad4031-1422-4177-ac19-d7edf91909e4 None None] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:28:02.026664 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ad4031-1422-4177-ac19-d7edf91909e4 None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:28:02.026664 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ad4031-1422-4177-ac19-d7edf91909e4 None None] PATH_INFO: `/` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:28:02.028069 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 688/1356] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 10 05:28:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 05:28:02.033367 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104c95e0-b9ee-47f4-87e5-6d2e81ae98d4 None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:28:02.034186 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104c95e0-b9ee-47f4-87e5-6d2e81ae98d4 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:28:02.034684 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104c95e0-b9ee-47f4-87e5-6d2e81ae98d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:28:02.056217 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-104c95e0-b9ee-47f4-87e5-6d2e81ae98d4 None None] MFA Rules not processed for user `44883b22532e44049d846938dc2cf423`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:28:02.057393 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-104c95e0-b9ee-47f4-87e5-6d2e81ae98d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:28:02.071634 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 669/1357] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 10 05:28:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 05:28:02.115811 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cc4b75-8034-4da3-aaa9-29c7777581c8 None None] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:28:02.116118 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cc4b75-8034-4da3-aaa9-29c7777581c8 None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:28:02.116359 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cc4b75-8034-4da3-aaa9-29c7777581c8 None None] PATH_INFO: `/` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:28:02.117889 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 689/1358] 10.222.0.23 () {54 vars in 961 bytes} [Tue May 10 05:28:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 05:28:02.123173 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670df8d2-96c9-4166-ad80-471723a38f4f None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:28:02.123838 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670df8d2-96c9-4166-ad80-471723a38f4f None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:28:02.124678 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670df8d2-96c9-4166-ad80-471723a38f4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:28:02.170630 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-670df8d2-96c9-4166-ad80-471723a38f4f None None] MFA Rules not processed for user `7f50f224ca944983aecfde86375473da`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:28:02.171878 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-670df8d2-96c9-4166-ad80-471723a38f4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:28:02.250330 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 670/1359] 10.222.0.23 () {58 vars in 1058 bytes} [Tue May 10 05:28:02 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 05:28:02.258522 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cc4b75-8034-4da3-aaa9-29c7777581c8 None None] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:28:02.273489 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cc4b75-8034-4da3-aaa9-29c7777581c8 None None] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:28:02.279409 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1ba23e-6bdb-4504-9b88-5cd7a8b9db93 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f50f224ca944983aecfde86375473da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f23435f783540199d6dcfd0417c090e', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:28:02.280137 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1ba23e-6bdb-4504-9b88-5cd7a8b9db93 service nova] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:28:02.280487 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1ba23e-6bdb-4504-9b88-5cd7a8b9db93 service nova] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:28:02.280829 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1ba23e-6bdb-4504-9b88-5cd7a8b9db93 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:28:02.289747 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1ba23e-6bdb-4504-9b88-5cd7a8b9db93 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:28:02.291421 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1ba23e-6bdb-4504-9b88-5cd7a8b9db93 service nova] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:28:02.301261 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 690/1360] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 10 05:28:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 05:28:04.723642 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6825a4ee-802c-48bf-b88f-72186a2e4d3e None None] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:28:04.724583 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6825a4ee-802c-48bf-b88f-72186a2e4d3e None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:28:04.724583 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6825a4ee-802c-48bf-b88f-72186a2e4d3e None None] PATH_INFO: `/` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:28:04.725661 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 671/1361] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 10 05:28:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 05:28:04.731029 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd5e308-d1f9-44d0-a675-48baa26f763d None None] REQUEST_METHOD: `POST` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:28:04.731922 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd5e308-d1f9-44d0-a675-48baa26f763d None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:28:04.732159 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd5e308-d1f9-44d0-a675-48baa26f763d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:28:04.750604 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.auth.core [None req-8bd5e308-d1f9-44d0-a675-48baa26f763d None None] MFA Rules not processed for user `44883b22532e44049d846938dc2cf423`. Rule list: `[]` (Enabled: `True`). {{(pid=79879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:28:04.751808 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-8bd5e308-d1f9-44d0-a675-48baa26f763d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:28:04.760187 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 691/1362] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 10 05:28:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 05:28:04.803832 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6825a4ee-802c-48bf-b88f-72186a2e4d3e None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:28:04.818973 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6825a4ee-802c-48bf-b88f-72186a2e4d3e None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:28:04.824608 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633c48e2-1c5f-4b23-90a2-2c81cc068932 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f50f224ca944983aecfde86375473da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f23435f783540199d6dcfd0417c090e', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:28:04.825261 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633c48e2-1c5f-4b23-90a2-2c81cc068932 service nova] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:28:04.826907 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633c48e2-1c5f-4b23-90a2-2c81cc068932 service nova] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:28:04.826907 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633c48e2-1c5f-4b23-90a2-2c81cc068932 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:28:04.837041 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633c48e2-1c5f-4b23-90a2-2c81cc068932 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:28:04.838644 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633c48e2-1c5f-4b23-90a2-2c81cc068932 service nova] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:28:04.848578 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 672/1363] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 10 05:28:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 05:28:07.337222 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1528e327-36ad-4c8d-9a44-7e81e8bb13e5 None None] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:28:07.337798 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1528e327-36ad-4c8d-9a44-7e81e8bb13e5 None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:28:07.337798 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1528e327-36ad-4c8d-9a44-7e81e8bb13e5 None None] PATH_INFO: `/` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:28:07.339157 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 692/1364] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 10 05:28:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 05:28:07.344473 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57175a97-c25e-466d-a4b7-8b80532c6556 None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:28:07.344927 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57175a97-c25e-466d-a4b7-8b80532c6556 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:28:07.345026 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57175a97-c25e-466d-a4b7-8b80532c6556 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:28:07.363478 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-57175a97-c25e-466d-a4b7-8b80532c6556 None None] MFA Rules not processed for user `44883b22532e44049d846938dc2cf423`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:28:07.364849 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-57175a97-c25e-466d-a4b7-8b80532c6556 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:28:07.373579 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 673/1365] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 10 05:28:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 05:28:07.418043 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae3b45d-8d16-42e4-a00b-23f3e0c85fe9 None None] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:28:07.418329 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae3b45d-8d16-42e4-a00b-23f3e0c85fe9 None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:28:07.418611 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae3b45d-8d16-42e4-a00b-23f3e0c85fe9 None None] PATH_INFO: `/` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:28:07.420080 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 693/1366] 10.222.0.23 () {54 vars in 961 bytes} [Tue May 10 05:28:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 05:28:07.426318 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78818c7-2357-48d3-91ea-7dbb1754e7b4 None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:28:07.426616 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78818c7-2357-48d3-91ea-7dbb1754e7b4 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:28:07.427041 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78818c7-2357-48d3-91ea-7dbb1754e7b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:28:07.446318 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-c78818c7-2357-48d3-91ea-7dbb1754e7b4 None None] MFA Rules not processed for user `7f50f224ca944983aecfde86375473da`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:28:07.447540 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-c78818c7-2357-48d3-91ea-7dbb1754e7b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:28:07.461573 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 674/1367] 10.222.0.23 () {58 vars in 1058 bytes} [Tue May 10 05:28:07 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 05:28:07.470497 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae3b45d-8d16-42e4-a00b-23f3e0c85fe9 None None] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:28:07.510313 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae3b45d-8d16-42e4-a00b-23f3e0c85fe9 None None] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:28:07.517733 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce823fe-6721-4de1-bb45-edca582aaa91 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f50f224ca944983aecfde86375473da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f23435f783540199d6dcfd0417c090e', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:28:07.518388 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce823fe-6721-4de1-bb45-edca582aaa91 service nova] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:28:07.518668 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce823fe-6721-4de1-bb45-edca582aaa91 service nova] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:28:07.518938 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce823fe-6721-4de1-bb45-edca582aaa91 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:28:07.528271 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce823fe-6721-4de1-bb45-edca582aaa91 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:28:07.529820 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce823fe-6721-4de1-bb45-edca582aaa91 service nova] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:28:07.539310 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 694/1368] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 10 05:28:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 05:28:09.802864 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46694e40-2fa7-404e-b455-e58ef8e7aa9e None None] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:28:09.803432 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46694e40-2fa7-404e-b455-e58ef8e7aa9e None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:28:09.803998 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46694e40-2fa7-404e-b455-e58ef8e7aa9e None None] PATH_INFO: `/` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:28:09.805499 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 675/1369] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 10 05:28:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 05:28:09.811169 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0a18b3-be8a-4cd5-ad94-0dba247d6244 None None] REQUEST_METHOD: `POST` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:28:09.811637 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0a18b3-be8a-4cd5-ad94-0dba247d6244 None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:28:09.811744 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0a18b3-be8a-4cd5-ad94-0dba247d6244 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:28:09.831674 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.auth.core [None req-1f0a18b3-be8a-4cd5-ad94-0dba247d6244 None None] MFA Rules not processed for user `44883b22532e44049d846938dc2cf423`. Rule list: `[]` (Enabled: `True`). {{(pid=79879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:28:09.833097 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-1f0a18b3-be8a-4cd5-ad94-0dba247d6244 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:28:09.841080 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 695/1370] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 10 05:28:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 05:28:09.884724 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46694e40-2fa7-404e-b455-e58ef8e7aa9e None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:28:09.900080 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46694e40-2fa7-404e-b455-e58ef8e7aa9e None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:28:09.906724 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1664060-826d-465d-a351-bb3c626322df service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f50f224ca944983aecfde86375473da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f23435f783540199d6dcfd0417c090e', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:28:09.907761 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1664060-826d-465d-a351-bb3c626322df service nova] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:28:09.908254 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1664060-826d-465d-a351-bb3c626322df service nova] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:28:09.908756 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1664060-826d-465d-a351-bb3c626322df service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:28:09.918100 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1664060-826d-465d-a351-bb3c626322df service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:28:09.920006 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1664060-826d-465d-a351-bb3c626322df service nova] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:28:09.930886 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 676/1371] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 10 05:28:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 05:28:10.164560 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e1623b-9d12-4e78-b08f-9e5a83601a2c None None] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:28:10.164773 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e1623b-9d12-4e78-b08f-9e5a83601a2c None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:28:10.165234 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e1623b-9d12-4e78-b08f-9e5a83601a2c None None] PATH_INFO: `/` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:28:10.166828 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 696/1372] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 10 05:28:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 05:28:10.172844 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b94d347-18c5-467b-afbe-821cfc84c500 None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:28:10.173106 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b94d347-18c5-467b-afbe-821cfc84c500 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:28:10.173579 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b94d347-18c5-467b-afbe-821cfc84c500 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:28:10.193171 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-5b94d347-18c5-467b-afbe-821cfc84c500 None None] MFA Rules not processed for user `44883b22532e44049d846938dc2cf423`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:28:10.194373 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-5b94d347-18c5-467b-afbe-821cfc84c500 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:28:10.202651 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 677/1373] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 10 05:28:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 05:28:10.524193 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321c8851-2098-4bcf-9b67-7926e53f54a5 None None] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:28:10.524544 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321c8851-2098-4bcf-9b67-7926e53f54a5 None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:28:10.524760 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321c8851-2098-4bcf-9b67-7926e53f54a5 None None] PATH_INFO: `/` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:28:10.526130 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 697/1374] 10.222.0.23 () {54 vars in 963 bytes} [Tue May 10 05:28:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 05:28:10.531518 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a98656-fefc-418f-91be-234326f6c39d None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:28:10.531858 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a98656-fefc-418f-91be-234326f6c39d None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:28:10.532138 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a98656-fefc-418f-91be-234326f6c39d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:28:10.579103 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-98a98656-fefc-418f-91be-234326f6c39d None None] MFA Rules not processed for user `355be413675540a39ccb00e1a0722316`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:28:10.580330 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-98a98656-fefc-418f-91be-234326f6c39d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:28:10.643723 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 678/1375] 10.222.0.23 () {58 vars in 1060 bytes} [Tue May 10 05:28:10 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 05:28:10.649827 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321c8851-2098-4bcf-9b67-7926e53f54a5 None None] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:28:10.661106 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321c8851-2098-4bcf-9b67-7926e53f54a5 None None] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:28:10.664802 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1f51d6-c982-4d81-9d96-45f4ba8edd0e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355be413675540a39ccb00e1a0722316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f23435f783540199d6dcfd0417c090e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:28:10.665447 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1f51d6-c982-4d81-9d96-45f4ba8edd0e service cinder] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:28:10.665727 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1f51d6-c982-4d81-9d96-45f4ba8edd0e service cinder] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:28:10.665995 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1f51d6-c982-4d81-9d96-45f4ba8edd0e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:28:10.675362 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1f51d6-c982-4d81-9d96-45f4ba8edd0e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:28:10.676834 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1f51d6-c982-4d81-9d96-45f4ba8edd0e service cinder] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:28:10.686294 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 698/1376] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 10 05:28:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 05:28:12.203549 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5342cb42-cba6-4765-98c6-e55d49b627b6 None None] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:28:12.204159 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5342cb42-cba6-4765-98c6-e55d49b627b6 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:28:12.204159 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5342cb42-cba6-4765-98c6-e55d49b627b6 None None] PATH_INFO: `/` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:28:12.205527 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 679/1377] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 10 05:28:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 05:28:12.211661 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3c35ee-a1fa-4334-8168-0bf74e2e0be2 None None] REQUEST_METHOD: `POST` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:28:12.212251 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3c35ee-a1fa-4334-8168-0bf74e2e0be2 None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:28:12.212251 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3c35ee-a1fa-4334-8168-0bf74e2e0be2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:28:12.232316 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.auth.core [None req-7f3c35ee-a1fa-4334-8168-0bf74e2e0be2 None None] MFA Rules not processed for user `44883b22532e44049d846938dc2cf423`. Rule list: `[]` (Enabled: `True`). {{(pid=79879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:28:12.233569 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-7f3c35ee-a1fa-4334-8168-0bf74e2e0be2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:28:12.242797 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 699/1378] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 10 05:28:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 05:28:12.288059 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5342cb42-cba6-4765-98c6-e55d49b627b6 None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:28:12.304151 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5342cb42-cba6-4765-98c6-e55d49b627b6 None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:28:12.310132 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8790ea97-b2c3-4c5d-9bfa-f1bf33087b03 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f50f224ca944983aecfde86375473da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f23435f783540199d6dcfd0417c090e', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:28:12.310836 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8790ea97-b2c3-4c5d-9bfa-f1bf33087b03 service nova] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:28:12.311121 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8790ea97-b2c3-4c5d-9bfa-f1bf33087b03 service nova] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:28:12.311401 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8790ea97-b2c3-4c5d-9bfa-f1bf33087b03 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:28:12.321176 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8790ea97-b2c3-4c5d-9bfa-f1bf33087b03 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:28:12.322825 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8790ea97-b2c3-4c5d-9bfa-f1bf33087b03 service nova] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:28:12.333933 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 680/1379] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 10 05:28:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 05:28:14.592817 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d6212a-95e3-4edb-a581-5990f058d068 None None] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:28:14.593356 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d6212a-95e3-4edb-a581-5990f058d068 None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:28:14.593468 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d6212a-95e3-4edb-a581-5990f058d068 None None] PATH_INFO: `/` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:28:14.595050 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 700/1380] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 10 05:28:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 05:28:14.600627 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88462935-a064-4f96-a0a0-af44398a3fdd None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:28:14.601099 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88462935-a064-4f96-a0a0-af44398a3fdd None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:28:14.601183 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88462935-a064-4f96-a0a0-af44398a3fdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:28:14.619514 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-88462935-a064-4f96-a0a0-af44398a3fdd None None] MFA Rules not processed for user `44883b22532e44049d846938dc2cf423`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:28:14.621007 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-88462935-a064-4f96-a0a0-af44398a3fdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:28:14.629861 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 681/1381] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 10 05:28:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 05:28:14.673821 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d6212a-95e3-4edb-a581-5990f058d068 None None] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:28:14.688734 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d6212a-95e3-4edb-a581-5990f058d068 None None] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:28:14.694502 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fbd508-d03e-4804-a8e4-3357952b76fe service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f50f224ca944983aecfde86375473da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f23435f783540199d6dcfd0417c090e', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:28:14.695150 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fbd508-d03e-4804-a8e4-3357952b76fe service nova] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:28:14.695429 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fbd508-d03e-4804-a8e4-3357952b76fe service nova] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:28:14.695740 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fbd508-d03e-4804-a8e4-3357952b76fe service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:28:14.705487 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9fbd508-d03e-4804-a8e4-3357952b76fe service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:28:14.707084 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9fbd508-d03e-4804-a8e4-3357952b76fe service nova] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:28:14.718577 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 701/1382] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 10 05:28:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 05:28:16.960321 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34099bd5-22eb-439c-97af-f5ce65261eac None None] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:28:16.960949 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34099bd5-22eb-439c-97af-f5ce65261eac None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:28:16.960949 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34099bd5-22eb-439c-97af-f5ce65261eac None None] PATH_INFO: `/` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:28:16.962604 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 682/1383] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 10 05:28:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 05:28:16.969050 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a1dc9f-baf2-446c-a574-08ed19697484 None None] REQUEST_METHOD: `POST` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:28:16.969986 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a1dc9f-baf2-446c-a574-08ed19697484 None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:28:16.970439 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a1dc9f-baf2-446c-a574-08ed19697484 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:28:16.990965 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.auth.core [None req-f9a1dc9f-baf2-446c-a574-08ed19697484 None None] MFA Rules not processed for user `44883b22532e44049d846938dc2cf423`. Rule list: `[]` (Enabled: `True`). {{(pid=79879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:28:16.992537 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-f9a1dc9f-baf2-446c-a574-08ed19697484 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:28:17.001803 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 702/1384] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 10 05:28:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 05:28:17.043727 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34099bd5-22eb-439c-97af-f5ce65261eac None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:28:17.059136 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34099bd5-22eb-439c-97af-f5ce65261eac None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:28:17.064975 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12db7ca1-b48f-4d16-ab5b-12b9c61e8bf6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f50f224ca944983aecfde86375473da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f23435f783540199d6dcfd0417c090e', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:28:17.065808 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12db7ca1-b48f-4d16-ab5b-12b9c61e8bf6 service nova] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:28:17.066333 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12db7ca1-b48f-4d16-ab5b-12b9c61e8bf6 service nova] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:28:17.066751 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12db7ca1-b48f-4d16-ab5b-12b9c61e8bf6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:28:17.075401 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12db7ca1-b48f-4d16-ab5b-12b9c61e8bf6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:28:17.077204 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12db7ca1-b48f-4d16-ab5b-12b9c61e8bf6 service nova] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:28:17.087639 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 683/1385] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 10 05:28:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 05:28:19.320929 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba874c47-f8e1-4ff8-8235-0902619b20d8 None None] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:28:19.321560 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba874c47-f8e1-4ff8-8235-0902619b20d8 None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:28:19.321560 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba874c47-f8e1-4ff8-8235-0902619b20d8 None None] PATH_INFO: `/` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:28:19.323057 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 703/1386] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 10 05:28:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 05:28:19.328688 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c30ec6f-30a4-4560-97c3-3cd0458d9620 None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:28:19.329263 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c30ec6f-30a4-4560-97c3-3cd0458d9620 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:28:19.329369 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c30ec6f-30a4-4560-97c3-3cd0458d9620 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:28:19.349042 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-2c30ec6f-30a4-4560-97c3-3cd0458d9620 None None] MFA Rules not processed for user `44883b22532e44049d846938dc2cf423`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:28:19.350226 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-2c30ec6f-30a4-4560-97c3-3cd0458d9620 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:28:19.358448 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 684/1387] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 10 05:28:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 05:28:19.405580 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba874c47-f8e1-4ff8-8235-0902619b20d8 None None] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:28:19.420909 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba874c47-f8e1-4ff8-8235-0902619b20d8 None None] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:28:19.426388 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e41f4c-b257-41ca-834d-c4f8d0ef3205 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f50f224ca944983aecfde86375473da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f23435f783540199d6dcfd0417c090e', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:28:19.427102 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e41f4c-b257-41ca-834d-c4f8d0ef3205 service nova] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:28:19.427315 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e41f4c-b257-41ca-834d-c4f8d0ef3205 service nova] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:28:19.427672 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e41f4c-b257-41ca-834d-c4f8d0ef3205 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:28:19.435812 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e41f4c-b257-41ca-834d-c4f8d0ef3205 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:28:19.437473 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e41f4c-b257-41ca-834d-c4f8d0ef3205 service nova] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:28:19.446957 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 704/1388] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 10 05:28:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 05:28:22.221397 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b2fa7c-db46-4045-9726-e970d9a0c6c4 None None] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:28:22.222249 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b2fa7c-db46-4045-9726-e970d9a0c6c4 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:28:22.222249 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b2fa7c-db46-4045-9726-e970d9a0c6c4 None None] PATH_INFO: `/` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:28:22.223792 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 685/1389] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 10 05:28:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 05:28:22.230134 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a422838-8362-4b75-ad66-6277806539c8 None None] REQUEST_METHOD: `POST` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:28:22.230628 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a422838-8362-4b75-ad66-6277806539c8 None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:28:22.230780 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a422838-8362-4b75-ad66-6277806539c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:28:22.252236 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.auth.core [None req-8a422838-8362-4b75-ad66-6277806539c8 None None] MFA Rules not processed for user `44883b22532e44049d846938dc2cf423`. Rule list: `[]` (Enabled: `True`). {{(pid=79879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:28:22.253503 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-8a422838-8362-4b75-ad66-6277806539c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:28:22.263175 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 705/1390] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 10 05:28:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 05:28:22.309292 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b2fa7c-db46-4045-9726-e970d9a0c6c4 None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:28:22.326897 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b2fa7c-db46-4045-9726-e970d9a0c6c4 None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:28:22.333445 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07837fb-4c23-4834-9ac5-d612bd218849 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f50f224ca944983aecfde86375473da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f23435f783540199d6dcfd0417c090e', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:28:22.334142 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07837fb-4c23-4834-9ac5-d612bd218849 service nova] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:28:22.334437 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07837fb-4c23-4834-9ac5-d612bd218849 service nova] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:28:22.334728 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07837fb-4c23-4834-9ac5-d612bd218849 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:28:22.343526 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07837fb-4c23-4834-9ac5-d612bd218849 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:28:22.345223 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07837fb-4c23-4834-9ac5-d612bd218849 service nova] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:28:22.354959 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 686/1391] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 10 05:28:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 05:28:24.758295 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38929d1a-8a2c-4d9a-a4fa-bbaad6302bd6 None None] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:28:24.758893 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38929d1a-8a2c-4d9a-a4fa-bbaad6302bd6 None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:28:24.758893 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38929d1a-8a2c-4d9a-a4fa-bbaad6302bd6 None None] PATH_INFO: `/` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:28:24.760142 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 706/1392] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 10 05:28:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 05:28:24.765526 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63a523d-daf1-4ffb-bb05-70bf9d92070c None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:28:24.765994 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63a523d-daf1-4ffb-bb05-70bf9d92070c None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:28:24.766098 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63a523d-daf1-4ffb-bb05-70bf9d92070c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:28:24.784724 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-c63a523d-daf1-4ffb-bb05-70bf9d92070c None None] MFA Rules not processed for user `44883b22532e44049d846938dc2cf423`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:28:24.786024 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-c63a523d-daf1-4ffb-bb05-70bf9d92070c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:28:24.794529 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 687/1393] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 10 05:28:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 05:28:24.837729 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38929d1a-8a2c-4d9a-a4fa-bbaad6302bd6 None None] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:28:24.852527 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38929d1a-8a2c-4d9a-a4fa-bbaad6302bd6 None None] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:28:24.858345 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f7fa2e-d8b4-4bbe-9084-8abe38217198 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f50f224ca944983aecfde86375473da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f23435f783540199d6dcfd0417c090e', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:28:24.858956 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f7fa2e-d8b4-4bbe-9084-8abe38217198 service nova] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:28:24.859270 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f7fa2e-d8b4-4bbe-9084-8abe38217198 service nova] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:28:24.859507 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f7fa2e-d8b4-4bbe-9084-8abe38217198 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:28:24.867563 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f7fa2e-d8b4-4bbe-9084-8abe38217198 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:28:24.869177 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f7fa2e-d8b4-4bbe-9084-8abe38217198 service nova] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:28:24.878880 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 707/1394] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 10 05:28:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 05:28:26.081524 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64b2cb0-c45c-42d8-a239-b0295488ba57 None None] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:28:26.082087 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64b2cb0-c45c-42d8-a239-b0295488ba57 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:28:26.082087 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64b2cb0-c45c-42d8-a239-b0295488ba57 None None] PATH_INFO: `/` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:28:26.083620 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 688/1395] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 10 05:28:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 05:28:26.089126 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa40eca7-7f08-4060-a0c6-11fcbcaa4572 None None] REQUEST_METHOD: `POST` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:28:26.089607 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa40eca7-7f08-4060-a0c6-11fcbcaa4572 None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:28:26.089607 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa40eca7-7f08-4060-a0c6-11fcbcaa4572 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:28:26.107517 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.auth.core [None req-aa40eca7-7f08-4060-a0c6-11fcbcaa4572 None None] MFA Rules not processed for user `44883b22532e44049d846938dc2cf423`. Rule list: `[]` (Enabled: `True`). {{(pid=79879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:28:26.108728 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-aa40eca7-7f08-4060-a0c6-11fcbcaa4572 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:28:26.117113 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 708/1396] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 10 05:28:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 05:28:26.172129 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecea3a2-b44e-40a8-9083-2b4627f38321 None None] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:28:26.172413 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecea3a2-b44e-40a8-9083-2b4627f38321 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:28:26.172687 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecea3a2-b44e-40a8-9083-2b4627f38321 None None] PATH_INFO: `/` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:28:26.174056 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 689/1397] 10.222.0.23 () {54 vars in 962 bytes} [Tue May 10 05:28:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 05:28:26.179537 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958304e8-343a-4a8d-9f78-06d09dcc99b0 None None] REQUEST_METHOD: `POST` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:28:26.179863 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958304e8-343a-4a8d-9f78-06d09dcc99b0 None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:28:26.180139 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958304e8-343a-4a8d-9f78-06d09dcc99b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:28:26.230120 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.auth.core [None req-958304e8-343a-4a8d-9f78-06d09dcc99b0 None None] MFA Rules not processed for user `a5b56aedcfd74914938b0b9cdd102f48`. Rule list: `[]` (Enabled: `True`). {{(pid=79879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:28:26.231307 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-958304e8-343a-4a8d-9f78-06d09dcc99b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:28:26.288136 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 709/1398] 10.222.0.23 () {58 vars in 1059 bytes} [Tue May 10 05:28:26 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 05:28:26.296138 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecea3a2-b44e-40a8-9083-2b4627f38321 None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:28:26.307199 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecea3a2-b44e-40a8-9083-2b4627f38321 None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:28:26.310892 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8268e45-3674-4816-8c9b-0b2e65c52926 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5b56aedcfd74914938b0b9cdd102f48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f23435f783540199d6dcfd0417c090e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:28:26.311534 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8268e45-3674-4816-8c9b-0b2e65c52926 service glance] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:28:26.311952 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8268e45-3674-4816-8c9b-0b2e65c52926 service glance] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:28:26.312228 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8268e45-3674-4816-8c9b-0b2e65c52926 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:28:26.320975 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8268e45-3674-4816-8c9b-0b2e65c52926 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:28:26.322441 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8268e45-3674-4816-8c9b-0b2e65c52926 service glance] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:28:26.331604 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 690/1399] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 10 05:28:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 05:28:26.750074 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67fe6db-7929-45ca-a437-2acf743a7b3e None None] REQUEST_METHOD: `POST` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:28:26.750410 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67fe6db-7929-45ca-a437-2acf743a7b3e None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:28:26.750780 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67fe6db-7929-45ca-a437-2acf743a7b3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:28:26.801450 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.auth.core [None req-c67fe6db-7929-45ca-a437-2acf743a7b3e None None] MFA Rules not processed for user `c5281b2a1c9a461995653be826207db4`. Rule list: `[]` (Enabled: `True`). {{(pid=79879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:28:26.802655 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-c67fe6db-7929-45ca-a437-2acf743a7b3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:28:26.866963 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 710/1400] 10.222.0.23 () {58 vars in 1009 bytes} [Tue May 10 05:28:26 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 05:28:26.909940 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd280b97-4d65-4b5b-9cc1-d3b8d6cb24b2 None None] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:28:26.910233 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd280b97-4d65-4b5b-9cc1-d3b8d6cb24b2 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:28:26.910518 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd280b97-4d65-4b5b-9cc1-d3b8d6cb24b2 None None] PATH_INFO: `/` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:28:26.911999 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 691/1401] 10.222.0.23 () {54 vars in 942 bytes} [Tue May 10 05:28:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 05:28:26.918756 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d0036b-77ec-4f77-9330-29d578ad0ec9 None None] REQUEST_METHOD: `POST` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:28:26.919054 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d0036b-77ec-4f77-9330-29d578ad0ec9 None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:28:26.919329 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d0036b-77ec-4f77-9330-29d578ad0ec9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:28:26.974043 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.auth.core [None req-48d0036b-77ec-4f77-9330-29d578ad0ec9 None None] MFA Rules not processed for user `fd31dacf30804395bd029037b407c12a`. Rule list: `[]` (Enabled: `True`). {{(pid=79879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:28:26.975240 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-48d0036b-77ec-4f77-9330-29d578ad0ec9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:28:27.052217 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 711/1402] 10.222.0.23 () {58 vars in 1039 bytes} [Tue May 10 05:28:26 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 05:28:27.061815 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd280b97-4d65-4b5b-9cc1-d3b8d6cb24b2 None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:28:27.076969 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd280b97-4d65-4b5b-9cc1-d3b8d6cb24b2 None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:28:27.082474 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58555475-ced0-400e-9099-78ed0c766fab service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd31dacf30804395bd029037b407c12a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f23435f783540199d6dcfd0417c090e', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:28:27.083103 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58555475-ced0-400e-9099-78ed0c766fab service swift] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:28:27.083379 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58555475-ced0-400e-9099-78ed0c766fab service swift] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:28:27.083887 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58555475-ced0-400e-9099-78ed0c766fab service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:28:27.092232 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58555475-ced0-400e-9099-78ed0c766fab service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:28:27.093813 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58555475-ced0-400e-9099-78ed0c766fab service swift] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:28:27.101683 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 692/1403] 10.222.0.23 () {60 vars in 1384 bytes} [Tue May 10 05:28:27 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 10 05:28:27.112018 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db26182-0612-424c-9be8-98e5402917f9 None None] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:28:27.112489 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db26182-0612-424c-9be8-98e5402917f9 None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:28:27.112600 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db26182-0612-424c-9be8-98e5402917f9 None None] PATH_INFO: `/` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:28:27.114740 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 712/1404] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 10 05:28:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 05:28:27.120116 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54e5f15-ef82-4e21-aec5-22b8ed740f8a None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:28:27.120401 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54e5f15-ef82-4e21-aec5-22b8ed740f8a None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:28:27.120696 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54e5f15-ef82-4e21-aec5-22b8ed740f8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:28:27.139732 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-b54e5f15-ef82-4e21-aec5-22b8ed740f8a None None] MFA Rules not processed for user `44883b22532e44049d846938dc2cf423`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:28:27.140961 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-b54e5f15-ef82-4e21-aec5-22b8ed740f8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:28:27.149415 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 693/1405] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 10 05:28:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 05:28:27.193988 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db26182-0612-424c-9be8-98e5402917f9 None None] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:28:27.209433 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db26182-0612-424c-9be8-98e5402917f9 None None] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:28:27.216245 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7145864-a389-441d-86d1-dab633ce9315 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f50f224ca944983aecfde86375473da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f23435f783540199d6dcfd0417c090e', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:28:27.216910 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7145864-a389-441d-86d1-dab633ce9315 service nova] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:28:27.217196 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7145864-a389-441d-86d1-dab633ce9315 service nova] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:28:27.217473 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7145864-a389-441d-86d1-dab633ce9315 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:28:27.227931 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7145864-a389-441d-86d1-dab633ce9315 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:28:27.230314 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7145864-a389-441d-86d1-dab633ce9315 service nova] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:28:27.242447 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 713/1406] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 10 05:28:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 05:28:29.518136 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854d3acf-66d0-4137-b492-1417a71f87dd None None] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:28:29.518739 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854d3acf-66d0-4137-b492-1417a71f87dd None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:28:29.518739 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854d3acf-66d0-4137-b492-1417a71f87dd None None] PATH_INFO: `/` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:28:29.523961 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 694/1407] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 10 05:28:29 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 05:28:29.525356 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c74c615-f636-4b54-8635-c3aeb5159f0b None None] REQUEST_METHOD: `POST` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:28:29.525765 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c74c615-f636-4b54-8635-c3aeb5159f0b None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:28:29.525930 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c74c615-f636-4b54-8635-c3aeb5159f0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:28:29.546066 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.auth.core [None req-3c74c615-f636-4b54-8635-c3aeb5159f0b None None] MFA Rules not processed for user `44883b22532e44049d846938dc2cf423`. Rule list: `[]` (Enabled: `True`). {{(pid=79879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:28:29.547685 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-3c74c615-f636-4b54-8635-c3aeb5159f0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:28:29.556102 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 714/1408] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 10 05:28:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 05:28:29.599800 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854d3acf-66d0-4137-b492-1417a71f87dd None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:28:29.615985 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854d3acf-66d0-4137-b492-1417a71f87dd None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:28:29.622020 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b336ca7b-b95a-4b85-b903-30fe71c3c3dd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f50f224ca944983aecfde86375473da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f23435f783540199d6dcfd0417c090e', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:28:29.622996 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b336ca7b-b95a-4b85-b903-30fe71c3c3dd service nova] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:28:29.623879 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b336ca7b-b95a-4b85-b903-30fe71c3c3dd service nova] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:28:29.624369 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b336ca7b-b95a-4b85-b903-30fe71c3c3dd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:28:29.636027 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b336ca7b-b95a-4b85-b903-30fe71c3c3dd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:28:29.639129 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b336ca7b-b95a-4b85-b903-30fe71c3c3dd service nova] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:28:29.651173 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 695/1409] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 10 05:28:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 05:28:50.303586 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d60bbfd-9a46-4a5a-93d9-7a0002ddccbd None None] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:28:50.304231 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d60bbfd-9a46-4a5a-93d9-7a0002ddccbd None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:28:50.304231 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d60bbfd-9a46-4a5a-93d9-7a0002ddccbd None None] PATH_INFO: `/` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:28:50.305628 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 715/1410] 10.222.0.23 () {54 vars in 918 bytes} [Tue May 10 05:28:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 05:28:50.314338 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2caa739-520f-4f30-af2b-5fb674478013 None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:28:50.314791 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2caa739-520f-4f30-af2b-5fb674478013 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:28:50.314892 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2caa739-520f-4f30-af2b-5fb674478013 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:28:50.335366 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-f2caa739-520f-4f30-af2b-5fb674478013 None None] MFA Rules not processed for user `67321ca3e5624273acd5b06264738000`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:28:50.336569 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-f2caa739-520f-4f30-af2b-5fb674478013 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:28:50.346674 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 696/1411] 10.222.0.23 () {58 vars in 1015 bytes} [Tue May 10 05:28:50 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 05:28:50.361719 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c279cbb-b2fa-41aa-ac62-7d916d35eb7c None None] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:28:50.362010 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c279cbb-b2fa-41aa-ac62-7d916d35eb7c None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:28:50.362318 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c279cbb-b2fa-41aa-ac62-7d916d35eb7c None None] PATH_INFO: `/` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:28:50.364322 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 716/1412] 10.222.0.23 () {54 vars in 918 bytes} [Tue May 10 05:28:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 05:28:50.370706 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f0068d-fdfb-4f3f-b37a-f60ef2c99f76 None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:28:50.371001 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f0068d-fdfb-4f3f-b37a-f60ef2c99f76 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:28:50.371275 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f0068d-fdfb-4f3f-b37a-f60ef2c99f76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:28:50.390894 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-86f0068d-fdfb-4f3f-b37a-f60ef2c99f76 None None] MFA Rules not processed for user `7f50f224ca944983aecfde86375473da`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:28:50.392145 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-86f0068d-fdfb-4f3f-b37a-f60ef2c99f76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:28:50.403021 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 697/1413] 10.222.0.23 () {58 vars in 1015 bytes} [Tue May 10 05:28:50 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 05:28:53.064171 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f080e68d-d5dc-493c-97ef-591a77fa9d4b None None] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:28:53.064793 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f080e68d-d5dc-493c-97ef-591a77fa9d4b None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:28:53.064793 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f080e68d-d5dc-493c-97ef-591a77fa9d4b None None] PATH_INFO: `/` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:28:53.066110 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 717/1414] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 10 05:28:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 05:28:53.071780 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd70da20-d978-402d-99fd-659c1e0e5271 None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:28:53.072275 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd70da20-d978-402d-99fd-659c1e0e5271 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:28:53.072275 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd70da20-d978-402d-99fd-659c1e0e5271 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:28:53.092450 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-dd70da20-d978-402d-99fd-659c1e0e5271 None None] MFA Rules not processed for user `44883b22532e44049d846938dc2cf423`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:28:53.093642 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-dd70da20-d978-402d-99fd-659c1e0e5271 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:28:53.103628 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 698/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 10 05:28:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 05:28:53.159285 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f080e68d-d5dc-493c-97ef-591a77fa9d4b None None] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:28:53.177330 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f080e68d-d5dc-493c-97ef-591a77fa9d4b None None] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:28:53.183609 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92d54ac-6fa8-4f2b-84c4-0bf06610e5e5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f50f224ca944983aecfde86375473da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f23435f783540199d6dcfd0417c090e', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:28:53.184247 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92d54ac-6fa8-4f2b-84c4-0bf06610e5e5 service nova] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:28:53.184534 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92d54ac-6fa8-4f2b-84c4-0bf06610e5e5 service nova] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:28:53.184810 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92d54ac-6fa8-4f2b-84c4-0bf06610e5e5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:28:53.193728 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92d54ac-6fa8-4f2b-84c4-0bf06610e5e5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:28:53.195375 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92d54ac-6fa8-4f2b-84c4-0bf06610e5e5 service nova] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:28:53.204967 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 718/1416] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 10 05:28:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 05:28:54.192920 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a55cfb-0520-497d-873d-fc38a4e72b11 None None] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:28:54.193939 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a55cfb-0520-497d-873d-fc38a4e72b11 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:28:54.193939 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a55cfb-0520-497d-873d-fc38a4e72b11 None None] PATH_INFO: `/` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:28:54.196160 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 699/1417] 127.0.0.1 () {54 vars in 901 bytes} [Tue May 10 05:28:54 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 05:28:54.202282 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4074688f-bcc6-49bc-a568-0aa1888f36fb None None] REQUEST_METHOD: `POST` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:28:54.203037 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4074688f-bcc6-49bc-a568-0aa1888f36fb None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:28:54.203168 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4074688f-bcc6-49bc-a568-0aa1888f36fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:28:54.223836 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.auth.core [None req-4074688f-bcc6-49bc-a568-0aa1888f36fb None None] MFA Rules not processed for user `44883b22532e44049d846938dc2cf423`. Rule list: `[]` (Enabled: `True`). {{(pid=79879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:28:54.225036 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-4074688f-bcc6-49bc-a568-0aa1888f36fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:28:54.233563 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 719/1418] 127.0.0.1 () {58 vars in 998 bytes} [Tue May 10 05:28:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 05:28:54.392052 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a55cfb-0520-497d-873d-fc38a4e72b11 None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:28:54.408985 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a55cfb-0520-497d-873d-fc38a4e72b11 None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:28:54.414974 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cec3cbf-e23e-47ee-98d3-db0b59916ad7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f50f224ca944983aecfde86375473da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f23435f783540199d6dcfd0417c090e', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:28:54.415616 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cec3cbf-e23e-47ee-98d3-db0b59916ad7 service nova] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:28:54.415891 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cec3cbf-e23e-47ee-98d3-db0b59916ad7 service nova] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:28:54.416174 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cec3cbf-e23e-47ee-98d3-db0b59916ad7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:28:54.428517 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cec3cbf-e23e-47ee-98d3-db0b59916ad7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:28:54.430121 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cec3cbf-e23e-47ee-98d3-db0b59916ad7 service nova] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:28:54.440045 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 700/1419] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 10 05:28:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 05:28:55.389528 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858887c8-028c-4ae1-bb13-265dd2306c4d None None] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:28:55.390135 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858887c8-028c-4ae1-bb13-265dd2306c4d None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:28:55.390135 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858887c8-028c-4ae1-bb13-265dd2306c4d None None] PATH_INFO: `/` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:28:55.391482 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 720/1420] 127.0.0.1 () {54 vars in 901 bytes} [Tue May 10 05:28:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 05:28:55.397808 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6cd097-3f84-4814-bee9-9e72749576be None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:28:55.398487 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6cd097-3f84-4814-bee9-9e72749576be None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:28:55.398658 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6cd097-3f84-4814-bee9-9e72749576be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:28:55.422891 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-6a6cd097-3f84-4814-bee9-9e72749576be None None] MFA Rules not processed for user `44883b22532e44049d846938dc2cf423`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:28:55.424140 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-6a6cd097-3f84-4814-bee9-9e72749576be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:28:55.432678 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 701/1421] 127.0.0.1 () {58 vars in 998 bytes} [Tue May 10 05:28:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 05:28:55.587215 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858887c8-028c-4ae1-bb13-265dd2306c4d None None] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:28:55.608272 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858887c8-028c-4ae1-bb13-265dd2306c4d None None] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:28:55.615133 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c868e0-fab5-48a1-85ab-d654b24ca1db service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f50f224ca944983aecfde86375473da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f23435f783540199d6dcfd0417c090e', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:28:55.615797 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c868e0-fab5-48a1-85ab-d654b24ca1db service nova] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:28:55.616078 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c868e0-fab5-48a1-85ab-d654b24ca1db service nova] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:28:55.616351 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c868e0-fab5-48a1-85ab-d654b24ca1db service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:28:55.624845 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c868e0-fab5-48a1-85ab-d654b24ca1db service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:28:55.626462 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c868e0-fab5-48a1-85ab-d654b24ca1db service nova] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:28:55.636565 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 721/1422] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 10 05:28:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 05:28:56.556610 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed4af4f-a938-4fd4-a2b2-4b8aa76656d9 None None] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:28:56.557516 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed4af4f-a938-4fd4-a2b2-4b8aa76656d9 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:28:56.557516 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed4af4f-a938-4fd4-a2b2-4b8aa76656d9 None None] PATH_INFO: `/` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:28:56.559539 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 702/1423] 127.0.0.1 () {54 vars in 901 bytes} [Tue May 10 05:28:56 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 05:28:56.567162 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5757b05-0bf8-4cc7-8715-860155e22707 None None] REQUEST_METHOD: `POST` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:28:56.567920 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5757b05-0bf8-4cc7-8715-860155e22707 None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:28:56.568125 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5757b05-0bf8-4cc7-8715-860155e22707 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:28:56.593047 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.auth.core [None req-d5757b05-0bf8-4cc7-8715-860155e22707 None None] MFA Rules not processed for user `44883b22532e44049d846938dc2cf423`. Rule list: `[]` (Enabled: `True`). {{(pid=79879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:28:56.594234 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-d5757b05-0bf8-4cc7-8715-860155e22707 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:28:56.602945 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 722/1424] 127.0.0.1 () {58 vars in 998 bytes} [Tue May 10 05:28:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 05:28:56.748294 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed4af4f-a938-4fd4-a2b2-4b8aa76656d9 None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:28:56.764116 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed4af4f-a938-4fd4-a2b2-4b8aa76656d9 None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:28:56.769989 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965d1127-cc3b-4897-a97c-890a29e449bf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f50f224ca944983aecfde86375473da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f23435f783540199d6dcfd0417c090e', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:28:56.770651 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965d1127-cc3b-4897-a97c-890a29e449bf service nova] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:28:56.770924 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965d1127-cc3b-4897-a97c-890a29e449bf service nova] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:28:56.771196 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965d1127-cc3b-4897-a97c-890a29e449bf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:28:56.779330 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965d1127-cc3b-4897-a97c-890a29e449bf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:28:56.780938 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965d1127-cc3b-4897-a97c-890a29e449bf service nova] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:28:56.790401 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 703/1425] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 10 05:28:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 05:28:57.716039 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95d3937-58d4-49fc-8c7e-5175d27001b1 None None] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:28:57.716658 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95d3937-58d4-49fc-8c7e-5175d27001b1 None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:28:57.716658 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95d3937-58d4-49fc-8c7e-5175d27001b1 None None] PATH_INFO: `/` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:28:57.717970 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 723/1426] 127.0.0.1 () {54 vars in 901 bytes} [Tue May 10 05:28:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 05:28:57.724069 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc51e65-f3ee-4a76-8387-2bce74a6207a None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:28:57.724512 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc51e65-f3ee-4a76-8387-2bce74a6207a None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:28:57.724625 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc51e65-f3ee-4a76-8387-2bce74a6207a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:28:57.743760 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-ccc51e65-f3ee-4a76-8387-2bce74a6207a None None] MFA Rules not processed for user `44883b22532e44049d846938dc2cf423`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:28:57.744957 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-ccc51e65-f3ee-4a76-8387-2bce74a6207a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:28:57.754523 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 704/1427] 127.0.0.1 () {58 vars in 998 bytes} [Tue May 10 05:28:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 05:28:57.902832 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95d3937-58d4-49fc-8c7e-5175d27001b1 None None] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:28:57.923054 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95d3937-58d4-49fc-8c7e-5175d27001b1 None None] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:28:57.929765 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d191a87-e3f1-47c6-a157-f283346cbade service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f50f224ca944983aecfde86375473da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f23435f783540199d6dcfd0417c090e', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:28:57.930396 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d191a87-e3f1-47c6-a157-f283346cbade service nova] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:28:57.930678 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d191a87-e3f1-47c6-a157-f283346cbade service nova] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:28:57.930951 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d191a87-e3f1-47c6-a157-f283346cbade service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:28:57.939273 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d191a87-e3f1-47c6-a157-f283346cbade service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:28:57.940895 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d191a87-e3f1-47c6-a157-f283346cbade service nova] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:28:57.950400 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 724/1428] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 10 05:28:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 05:28:58.835540 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3608f5-6be4-470a-bcc8-8e2a1d1b1ea0 None None] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:28:58.836151 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3608f5-6be4-470a-bcc8-8e2a1d1b1ea0 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:28:58.836151 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3608f5-6be4-470a-bcc8-8e2a1d1b1ea0 None None] PATH_INFO: `/` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:28:58.837518 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 705/1429] 127.0.0.1 () {54 vars in 901 bytes} [Tue May 10 05:28:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 05:28:58.843556 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61006fdc-1068-4904-91c6-c3482cb6bd8e None None] REQUEST_METHOD: `POST` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:28:58.844377 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61006fdc-1068-4904-91c6-c3482cb6bd8e None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:28:58.844577 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61006fdc-1068-4904-91c6-c3482cb6bd8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:28:58.864972 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.auth.core [None req-61006fdc-1068-4904-91c6-c3482cb6bd8e None None] MFA Rules not processed for user `44883b22532e44049d846938dc2cf423`. Rule list: `[]` (Enabled: `True`). {{(pid=79879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:28:58.866210 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-61006fdc-1068-4904-91c6-c3482cb6bd8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:28:58.875278 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 725/1430] 127.0.0.1 () {58 vars in 998 bytes} [Tue May 10 05:28:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 05:28:59.035502 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3608f5-6be4-470a-bcc8-8e2a1d1b1ea0 None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:28:59.052558 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3608f5-6be4-470a-bcc8-8e2a1d1b1ea0 None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:28:59.059511 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4352e527-671d-4892-a0f7-39f8d681a018 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f50f224ca944983aecfde86375473da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f23435f783540199d6dcfd0417c090e', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:28:59.060230 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4352e527-671d-4892-a0f7-39f8d681a018 service nova] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:28:59.060496 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4352e527-671d-4892-a0f7-39f8d681a018 service nova] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:28:59.060759 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4352e527-671d-4892-a0f7-39f8d681a018 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:28:59.069374 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4352e527-671d-4892-a0f7-39f8d681a018 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:28:59.070966 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4352e527-671d-4892-a0f7-39f8d681a018 service nova] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:28:59.080319 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 706/1431] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 10 05:28:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 05:28:59.955619 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebcf4f0-834c-4f4b-b65d-522eb77d9d0d None None] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:28:59.956291 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebcf4f0-834c-4f4b-b65d-522eb77d9d0d None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:28:59.956291 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebcf4f0-834c-4f4b-b65d-522eb77d9d0d None None] PATH_INFO: `/` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:28:59.957560 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 726/1432] 127.0.0.1 () {54 vars in 901 bytes} [Tue May 10 05:28:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 05:28:59.963750 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1b4f69-a86a-4b17-aaca-dfa3d06bbc41 None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:28:59.964213 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1b4f69-a86a-4b17-aaca-dfa3d06bbc41 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:28:59.964308 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1b4f69-a86a-4b17-aaca-dfa3d06bbc41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:28:59.986842 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-2b1b4f69-a86a-4b17-aaca-dfa3d06bbc41 None None] MFA Rules not processed for user `44883b22532e44049d846938dc2cf423`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:28:59.988062 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-2b1b4f69-a86a-4b17-aaca-dfa3d06bbc41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:28:59.996390 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 707/1433] 127.0.0.1 () {58 vars in 998 bytes} [Tue May 10 05:28:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 05:29:00.146928 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebcf4f0-834c-4f4b-b65d-522eb77d9d0d None None] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:29:00.169136 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebcf4f0-834c-4f4b-b65d-522eb77d9d0d None None] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:29:00.175957 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e22fd07-478c-4f09-aace-231df9333cb9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f50f224ca944983aecfde86375473da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f23435f783540199d6dcfd0417c090e', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:29:00.176594 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e22fd07-478c-4f09-aace-231df9333cb9 service nova] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:29:00.176875 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e22fd07-478c-4f09-aace-231df9333cb9 service nova] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:29:00.177149 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e22fd07-478c-4f09-aace-231df9333cb9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:29:00.185258 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e22fd07-478c-4f09-aace-231df9333cb9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:29:00.186888 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e22fd07-478c-4f09-aace-231df9333cb9 service nova] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:29:00.196317 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 727/1434] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 10 05:29:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 05:29:01.066583 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf840ac4-2f27-4831-b9aa-772237954046 None None] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:29:01.067154 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf840ac4-2f27-4831-b9aa-772237954046 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:29:01.067154 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf840ac4-2f27-4831-b9aa-772237954046 None None] PATH_INFO: `/` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:29:01.069887 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 708/1435] 127.0.0.1 () {54 vars in 901 bytes} [Tue May 10 05:29:01 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 05:29:01.078196 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b634b5b-cf60-44c4-a9be-d3869a19cd01 None None] REQUEST_METHOD: `POST` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:29:01.078614 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b634b5b-cf60-44c4-a9be-d3869a19cd01 None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:29:01.078765 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b634b5b-cf60-44c4-a9be-d3869a19cd01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:29:01.099906 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.auth.core [None req-0b634b5b-cf60-44c4-a9be-d3869a19cd01 None None] MFA Rules not processed for user `44883b22532e44049d846938dc2cf423`. Rule list: `[]` (Enabled: `True`). {{(pid=79879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:29:01.101094 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-0b634b5b-cf60-44c4-a9be-d3869a19cd01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:29:01.110431 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 728/1436] 127.0.0.1 () {58 vars in 998 bytes} [Tue May 10 05:29:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 05:29:01.259917 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf840ac4-2f27-4831-b9aa-772237954046 None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:29:01.280861 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf840ac4-2f27-4831-b9aa-772237954046 None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:29:01.287017 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931c57da-233a-46e3-9f16-ed9cadedb107 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f50f224ca944983aecfde86375473da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f23435f783540199d6dcfd0417c090e', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:29:01.287744 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931c57da-233a-46e3-9f16-ed9cadedb107 service nova] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:29:01.288053 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931c57da-233a-46e3-9f16-ed9cadedb107 service nova] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:29:01.288329 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931c57da-233a-46e3-9f16-ed9cadedb107 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:29:01.301225 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931c57da-233a-46e3-9f16-ed9cadedb107 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:29:01.304969 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931c57da-233a-46e3-9f16-ed9cadedb107 service nova] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:29:01.318274 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 709/1437] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 10 05:29:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 05:29:02.203634 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d43471-4ca9-4b39-a59f-942c28de5b3d None None] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:29:02.204225 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d43471-4ca9-4b39-a59f-942c28de5b3d None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:29:02.204225 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d43471-4ca9-4b39-a59f-942c28de5b3d None None] PATH_INFO: `/` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:29:02.205603 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 729/1438] 127.0.0.1 () {54 vars in 901 bytes} [Tue May 10 05:29:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 05:29:02.211815 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a304e3-375c-40e7-bae0-395998c7dc39 None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:29:02.212502 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a304e3-375c-40e7-bae0-395998c7dc39 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:29:02.212719 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a304e3-375c-40e7-bae0-395998c7dc39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:29:02.236649 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-c5a304e3-375c-40e7-bae0-395998c7dc39 None None] MFA Rules not processed for user `44883b22532e44049d846938dc2cf423`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:29:02.237839 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-c5a304e3-375c-40e7-bae0-395998c7dc39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:29:02.247086 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 710/1439] 127.0.0.1 () {58 vars in 998 bytes} [Tue May 10 05:29:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 05:29:02.392853 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d43471-4ca9-4b39-a59f-942c28de5b3d None None] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:29:02.412293 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d43471-4ca9-4b39-a59f-942c28de5b3d None None] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:29:02.418196 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c46bc1d-19b8-4548-b6ed-21901d1645fc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f50f224ca944983aecfde86375473da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f23435f783540199d6dcfd0417c090e', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:29:02.418825 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c46bc1d-19b8-4548-b6ed-21901d1645fc service nova] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:29:02.419100 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c46bc1d-19b8-4548-b6ed-21901d1645fc service nova] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:29:02.419370 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c46bc1d-19b8-4548-b6ed-21901d1645fc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:29:02.427291 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c46bc1d-19b8-4548-b6ed-21901d1645fc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:29:02.428970 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c46bc1d-19b8-4548-b6ed-21901d1645fc service nova] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:29:02.438062 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 730/1440] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 10 05:29:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 05:29:04.509365 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e610c8c4-4a6b-4094-9843-41373fe565e8 None None] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:29:04.509920 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e610c8c4-4a6b-4094-9843-41373fe565e8 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:29:04.509920 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e610c8c4-4a6b-4094-9843-41373fe565e8 None None] PATH_INFO: `/` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:29:04.511300 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 711/1441] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 10 05:29:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 05:29:04.517797 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3bfbea-77d4-4692-8e48-4e9a931caa73 None None] REQUEST_METHOD: `POST` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:29:04.518245 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3bfbea-77d4-4692-8e48-4e9a931caa73 None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:29:04.518348 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3bfbea-77d4-4692-8e48-4e9a931caa73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:29:04.538791 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.auth.core [None req-cb3bfbea-77d4-4692-8e48-4e9a931caa73 None None] MFA Rules not processed for user `44883b22532e44049d846938dc2cf423`. Rule list: `[]` (Enabled: `True`). {{(pid=79879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:29:04.540001 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-cb3bfbea-77d4-4692-8e48-4e9a931caa73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:29:04.548178 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 731/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 10 05:29:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 05:29:04.585578 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e610c8c4-4a6b-4094-9843-41373fe565e8 None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:29:04.597474 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e610c8c4-4a6b-4094-9843-41373fe565e8 None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:29:04.601541 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4c36e5-2aa9-4bee-96dd-fdb2e8706f99 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c8461cfdd9648b8abcaf8d34b7a102a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f23435f783540199d6dcfd0417c090e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:29:04.602180 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4c36e5-2aa9-4bee-96dd-fdb2e8706f99 service neutron] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:29:04.602457 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4c36e5-2aa9-4bee-96dd-fdb2e8706f99 service neutron] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:29:04.602760 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4c36e5-2aa9-4bee-96dd-fdb2e8706f99 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:29:04.612162 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4c36e5-2aa9-4bee-96dd-fdb2e8706f99 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:29:04.613886 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4c36e5-2aa9-4bee-96dd-fdb2e8706f99 service neutron] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:29:04.623688 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 712/1443] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 10 05:29:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 05:29:07.005294 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4130d6-402c-4a8a-a0d1-fc48103f38b4 None None] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:29:07.005924 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4130d6-402c-4a8a-a0d1-fc48103f38b4 None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:29:07.005924 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4130d6-402c-4a8a-a0d1-fc48103f38b4 None None] PATH_INFO: `/` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:29:07.007280 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 732/1444] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 10 05:29:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 05:29:07.013817 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc29c7a-da31-4603-8b28-b1194f733bf0 None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:29:07.014650 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc29c7a-da31-4603-8b28-b1194f733bf0 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:29:07.014806 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc29c7a-da31-4603-8b28-b1194f733bf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:29:07.036297 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-8fc29c7a-da31-4603-8b28-b1194f733bf0 None None] MFA Rules not processed for user `44883b22532e44049d846938dc2cf423`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:29:07.037511 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-8fc29c7a-da31-4603-8b28-b1194f733bf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:29:07.046598 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 713/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 10 05:29:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 05:29:07.084613 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4130d6-402c-4a8a-a0d1-fc48103f38b4 None None] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:29:07.095217 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4130d6-402c-4a8a-a0d1-fc48103f38b4 None None] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:29:07.098804 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c88d0c-694b-4c59-bc0b-ba56d7d7221e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c8461cfdd9648b8abcaf8d34b7a102a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f23435f783540199d6dcfd0417c090e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:29:07.099436 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c88d0c-694b-4c59-bc0b-ba56d7d7221e service neutron] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:29:07.099753 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c88d0c-694b-4c59-bc0b-ba56d7d7221e service neutron] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:29:07.100031 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c88d0c-694b-4c59-bc0b-ba56d7d7221e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:29:07.108733 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c88d0c-694b-4c59-bc0b-ba56d7d7221e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:29:07.110182 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c88d0c-694b-4c59-bc0b-ba56d7d7221e service neutron] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:29:07.119336 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 733/1446] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 10 05:29:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 05:29:09.654898 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa4d0ba-5cbb-49ad-8f10-16a3be0c9a42 None None] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:29:09.655531 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa4d0ba-5cbb-49ad-8f10-16a3be0c9a42 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:29:09.655531 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa4d0ba-5cbb-49ad-8f10-16a3be0c9a42 None None] PATH_INFO: `/` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:29:09.656805 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 714/1447] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 10 05:29:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 05:29:09.663496 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ebb999-c217-49d7-8f21-971c51e5b1ae None None] REQUEST_METHOD: `POST` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:29:09.663984 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ebb999-c217-49d7-8f21-971c51e5b1ae None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:29:09.664203 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ebb999-c217-49d7-8f21-971c51e5b1ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:29:09.693055 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.auth.core [None req-a4ebb999-c217-49d7-8f21-971c51e5b1ae None None] MFA Rules not processed for user `44883b22532e44049d846938dc2cf423`. Rule list: `[]` (Enabled: `True`). {{(pid=79879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:29:09.694572 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-a4ebb999-c217-49d7-8f21-971c51e5b1ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:29:09.704210 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 734/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 10 05:29:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 05:29:09.745071 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa4d0ba-5cbb-49ad-8f10-16a3be0c9a42 None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:29:09.761583 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa4d0ba-5cbb-49ad-8f10-16a3be0c9a42 None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:29:09.766029 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6557bf0-b941-46de-8436-e123e509978e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c8461cfdd9648b8abcaf8d34b7a102a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f23435f783540199d6dcfd0417c090e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:29:09.766674 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6557bf0-b941-46de-8436-e123e509978e service neutron] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:29:09.766979 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6557bf0-b941-46de-8436-e123e509978e service neutron] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:29:09.767204 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6557bf0-b941-46de-8436-e123e509978e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:29:09.776717 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6557bf0-b941-46de-8436-e123e509978e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:29:09.778159 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6557bf0-b941-46de-8436-e123e509978e service neutron] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:29:09.787702 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 715/1449] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 10 05:29:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 05:29:12.184865 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8c1a1e-c0af-4868-9a0e-da7f193729fc None None] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:29:12.185767 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8c1a1e-c0af-4868-9a0e-da7f193729fc None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:29:12.185767 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8c1a1e-c0af-4868-9a0e-da7f193729fc None None] PATH_INFO: `/` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:29:12.188026 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 735/1450] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 10 05:29:12 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 05:29:12.193766 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3bd54f-8109-4e99-a8c2-a6116072740d None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:29:12.194217 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3bd54f-8109-4e99-a8c2-a6116072740d None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:29:12.194320 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3bd54f-8109-4e99-a8c2-a6116072740d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:29:12.213373 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-1d3bd54f-8109-4e99-a8c2-a6116072740d None None] MFA Rules not processed for user `44883b22532e44049d846938dc2cf423`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:29:12.214563 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-1d3bd54f-8109-4e99-a8c2-a6116072740d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:29:12.222844 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 716/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 10 05:29:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 05:29:12.263260 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8c1a1e-c0af-4868-9a0e-da7f193729fc None None] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:29:12.279260 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8c1a1e-c0af-4868-9a0e-da7f193729fc None None] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:29:12.284193 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0328cfab-3301-4f87-ac1c-87ea5481cff6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c8461cfdd9648b8abcaf8d34b7a102a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f23435f783540199d6dcfd0417c090e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:29:12.284822 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0328cfab-3301-4f87-ac1c-87ea5481cff6 service neutron] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:29:12.285097 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0328cfab-3301-4f87-ac1c-87ea5481cff6 service neutron] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:29:12.285363 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0328cfab-3301-4f87-ac1c-87ea5481cff6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:29:12.296442 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0328cfab-3301-4f87-ac1c-87ea5481cff6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:29:12.297836 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0328cfab-3301-4f87-ac1c-87ea5481cff6 service neutron] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:29:12.307783 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 736/1452] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 10 05:29:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 05:29:14.632471 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6280c62-aa94-4c76-a052-dcf0c5213667 None None] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:29:14.633073 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6280c62-aa94-4c76-a052-dcf0c5213667 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:29:14.633073 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6280c62-aa94-4c76-a052-dcf0c5213667 None None] PATH_INFO: `/` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:29:14.634257 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 717/1453] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 10 05:29:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 05:29:14.640016 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8d6ef3-cba1-44a4-980f-4c273769badc None None] REQUEST_METHOD: `POST` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:29:14.640459 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8d6ef3-cba1-44a4-980f-4c273769badc None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:29:14.640563 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8d6ef3-cba1-44a4-980f-4c273769badc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:29:14.659605 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.auth.core [None req-db8d6ef3-cba1-44a4-980f-4c273769badc None None] MFA Rules not processed for user `44883b22532e44049d846938dc2cf423`. Rule list: `[]` (Enabled: `True`). {{(pid=79879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:29:14.661776 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-db8d6ef3-cba1-44a4-980f-4c273769badc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:29:14.671893 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 737/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 10 05:29:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 05:29:14.712067 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6280c62-aa94-4c76-a052-dcf0c5213667 None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:29:14.724373 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6280c62-aa94-4c76-a052-dcf0c5213667 None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:29:14.728565 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6feb2a-1077-4702-8a31-49106d4e2418 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c8461cfdd9648b8abcaf8d34b7a102a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f23435f783540199d6dcfd0417c090e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:29:14.729198 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6feb2a-1077-4702-8a31-49106d4e2418 service neutron] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:29:14.729473 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6feb2a-1077-4702-8a31-49106d4e2418 service neutron] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:29:14.729753 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6feb2a-1077-4702-8a31-49106d4e2418 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:29:14.740069 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6feb2a-1077-4702-8a31-49106d4e2418 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:29:14.741568 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6feb2a-1077-4702-8a31-49106d4e2418 service neutron] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:29:14.751637 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 718/1455] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 10 05:29:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 05:29:16.979741 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5499212e-b318-4b17-af24-856122a13098 None None] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:29:16.980327 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5499212e-b318-4b17-af24-856122a13098 None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:29:16.980327 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5499212e-b318-4b17-af24-856122a13098 None None] PATH_INFO: `/` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:29:16.981673 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 738/1456] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 10 05:29:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 05:29:16.988207 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa3f598-f2c5-495b-ab5e-ef259d912d2f None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:29:16.988935 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa3f598-f2c5-495b-ab5e-ef259d912d2f None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:29:16.989133 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa3f598-f2c5-495b-ab5e-ef259d912d2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:29:17.008684 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-2aa3f598-f2c5-495b-ab5e-ef259d912d2f None None] MFA Rules not processed for user `44883b22532e44049d846938dc2cf423`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:29:17.009878 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-2aa3f598-f2c5-495b-ab5e-ef259d912d2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:29:17.019515 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 719/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 10 05:29:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 05:29:17.066910 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5499212e-b318-4b17-af24-856122a13098 None None] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:29:17.079001 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5499212e-b318-4b17-af24-856122a13098 None None] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:29:17.083073 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a73b21-2d89-492e-ae6b-6bd5465a9d4a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c8461cfdd9648b8abcaf8d34b7a102a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f23435f783540199d6dcfd0417c090e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:29:17.083733 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a73b21-2d89-492e-ae6b-6bd5465a9d4a service neutron] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:29:17.084015 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a73b21-2d89-492e-ae6b-6bd5465a9d4a service neutron] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:29:17.084290 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a73b21-2d89-492e-ae6b-6bd5465a9d4a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:29:17.093678 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a73b21-2d89-492e-ae6b-6bd5465a9d4a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:29:17.095124 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a73b21-2d89-492e-ae6b-6bd5465a9d4a service neutron] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:29:17.104635 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 739/1458] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 10 05:29:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 05:29:19.374648 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee31a400-9c80-4f04-9441-689061ca5399 None None] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:29:19.375598 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee31a400-9c80-4f04-9441-689061ca5399 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:29:19.375598 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee31a400-9c80-4f04-9441-689061ca5399 None None] PATH_INFO: `/` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:29:19.377542 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 720/1459] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 10 05:29:19 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 05:29:19.384616 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8f82f2-a843-423c-81f8-3f74d3eb3c0d None None] REQUEST_METHOD: `POST` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:29:19.385069 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8f82f2-a843-423c-81f8-3f74d3eb3c0d None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:29:19.385183 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8f82f2-a843-423c-81f8-3f74d3eb3c0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:29:19.403855 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.auth.core [None req-8c8f82f2-a843-423c-81f8-3f74d3eb3c0d None None] MFA Rules not processed for user `44883b22532e44049d846938dc2cf423`. Rule list: `[]` (Enabled: `True`). {{(pid=79879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:29:19.405047 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-8c8f82f2-a843-423c-81f8-3f74d3eb3c0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:29:19.414179 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 740/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 10 05:29:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 05:29:19.457005 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee31a400-9c80-4f04-9441-689061ca5399 None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:29:19.471375 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee31a400-9c80-4f04-9441-689061ca5399 None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:29:19.476909 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de332338-aeb8-4a1f-9a9f-c02d315a0476 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c8461cfdd9648b8abcaf8d34b7a102a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f23435f783540199d6dcfd0417c090e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:29:19.477565 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de332338-aeb8-4a1f-9a9f-c02d315a0476 service neutron] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:29:19.477852 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de332338-aeb8-4a1f-9a9f-c02d315a0476 service neutron] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:29:19.478116 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de332338-aeb8-4a1f-9a9f-c02d315a0476 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:29:19.488412 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de332338-aeb8-4a1f-9a9f-c02d315a0476 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:29:19.489836 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de332338-aeb8-4a1f-9a9f-c02d315a0476 service neutron] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:29:19.500047 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 721/1461] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 10 05:29:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 05:29:21.733801 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990cc490-90a0-45c3-8771-5b32ca676950 None None] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:29:21.734327 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990cc490-90a0-45c3-8771-5b32ca676950 None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:29:21.734327 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990cc490-90a0-45c3-8771-5b32ca676950 None None] PATH_INFO: `/` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:29:21.735820 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 741/1462] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 10 05:29:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 05:29:21.743249 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac7f74d-3e8e-4af9-960b-13a5256a923c None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:29:21.743736 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac7f74d-3e8e-4af9-960b-13a5256a923c None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:29:21.743848 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac7f74d-3e8e-4af9-960b-13a5256a923c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:29:21.777119 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-cac7f74d-3e8e-4af9-960b-13a5256a923c None None] MFA Rules not processed for user `44883b22532e44049d846938dc2cf423`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:29:21.778862 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-cac7f74d-3e8e-4af9-960b-13a5256a923c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:29:21.790995 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 722/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 10 05:29:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 05:29:21.827501 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990cc490-90a0-45c3-8771-5b32ca676950 None None] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:29:21.840088 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990cc490-90a0-45c3-8771-5b32ca676950 None None] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:29:21.844247 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb706d6f-f8a0-4a5e-8eed-3361f65bfd16 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c8461cfdd9648b8abcaf8d34b7a102a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f23435f783540199d6dcfd0417c090e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:29:21.844890 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb706d6f-f8a0-4a5e-8eed-3361f65bfd16 service neutron] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:29:21.845176 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb706d6f-f8a0-4a5e-8eed-3361f65bfd16 service neutron] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:29:21.845449 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb706d6f-f8a0-4a5e-8eed-3361f65bfd16 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:29:21.855115 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb706d6f-f8a0-4a5e-8eed-3361f65bfd16 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:29:21.856665 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb706d6f-f8a0-4a5e-8eed-3361f65bfd16 service neutron] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:29:21.866009 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 742/1464] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 10 05:29:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 05:29:24.080504 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc61fea-025b-46fa-921e-a2caf57f508e None None] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:29:24.081050 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc61fea-025b-46fa-921e-a2caf57f508e None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:29:24.081050 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc61fea-025b-46fa-921e-a2caf57f508e None None] PATH_INFO: `/` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:29:24.082448 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 723/1465] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 10 05:29:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 05:29:24.087871 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28deb064-ea7b-408b-9df4-f7bf86de4803 None None] REQUEST_METHOD: `POST` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:29:24.088316 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28deb064-ea7b-408b-9df4-f7bf86de4803 None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:29:24.088429 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28deb064-ea7b-408b-9df4-f7bf86de4803 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:29:24.110530 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.auth.core [None req-28deb064-ea7b-408b-9df4-f7bf86de4803 None None] MFA Rules not processed for user `44883b22532e44049d846938dc2cf423`. Rule list: `[]` (Enabled: `True`). {{(pid=79879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:29:24.111778 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-28deb064-ea7b-408b-9df4-f7bf86de4803 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:29:24.121074 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 743/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 10 05:29:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 05:29:24.160282 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc61fea-025b-46fa-921e-a2caf57f508e None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:29:24.173956 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc61fea-025b-46fa-921e-a2caf57f508e None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:29:24.178872 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785ded21-7ec5-40fb-9864-6d4301e05929 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c8461cfdd9648b8abcaf8d34b7a102a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f23435f783540199d6dcfd0417c090e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:29:24.179514 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785ded21-7ec5-40fb-9864-6d4301e05929 service neutron] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:29:24.179817 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785ded21-7ec5-40fb-9864-6d4301e05929 service neutron] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:29:24.180084 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785ded21-7ec5-40fb-9864-6d4301e05929 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:29:24.189418 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785ded21-7ec5-40fb-9864-6d4301e05929 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:29:24.190864 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785ded21-7ec5-40fb-9864-6d4301e05929 service neutron] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:29:24.200127 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 724/1467] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 10 05:29:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 05:29:26.412349 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45122a9c-4292-4d50-adc9-9bdff2714349 None None] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:29:26.412890 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45122a9c-4292-4d50-adc9-9bdff2714349 None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:29:26.412890 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45122a9c-4292-4d50-adc9-9bdff2714349 None None] PATH_INFO: `/` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:29:26.414281 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 744/1468] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 10 05:29:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 05:29:26.420841 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5819161-a789-4dd6-a8ce-8987e65b2ff2 None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:29:26.421291 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5819161-a789-4dd6-a8ce-8987e65b2ff2 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:29:26.421465 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5819161-a789-4dd6-a8ce-8987e65b2ff2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:29:26.441809 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-b5819161-a789-4dd6-a8ce-8987e65b2ff2 None None] MFA Rules not processed for user `44883b22532e44049d846938dc2cf423`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:29:26.443002 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-b5819161-a789-4dd6-a8ce-8987e65b2ff2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:29:26.451521 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 725/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 10 05:29:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 05:29:26.487474 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45122a9c-4292-4d50-adc9-9bdff2714349 None None] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:29:26.500181 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45122a9c-4292-4d50-adc9-9bdff2714349 None None] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:29:26.504524 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca5d8bf-9e5f-4263-9fdc-a676f36cef6f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c8461cfdd9648b8abcaf8d34b7a102a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f23435f783540199d6dcfd0417c090e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:29:26.505164 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca5d8bf-9e5f-4263-9fdc-a676f36cef6f service neutron] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:29:26.505442 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca5d8bf-9e5f-4263-9fdc-a676f36cef6f service neutron] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:29:26.505709 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca5d8bf-9e5f-4263-9fdc-a676f36cef6f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:29:26.515230 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca5d8bf-9e5f-4263-9fdc-a676f36cef6f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:29:26.516724 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca5d8bf-9e5f-4263-9fdc-a676f36cef6f service neutron] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:29:26.526561 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 745/1470] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 10 05:29:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 05:29:59.280816 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2286f82-8bcf-4659-b9e8-6262826284d9 None None] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:29:59.281474 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2286f82-8bcf-4659-b9e8-6262826284d9 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:29:59.281474 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2286f82-8bcf-4659-b9e8-6262826284d9 None None] PATH_INFO: `/` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:29:59.282761 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 726/1471] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 10 05:29:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 05:29:59.288238 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98242ed0-9756-4dd3-a8f2-9f7c6655dc7d None None] REQUEST_METHOD: `POST` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:29:59.288702 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98242ed0-9756-4dd3-a8f2-9f7c6655dc7d None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:29:59.288806 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98242ed0-9756-4dd3-a8f2-9f7c6655dc7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:29:59.309010 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.auth.core [None req-98242ed0-9756-4dd3-a8f2-9f7c6655dc7d None None] MFA Rules not processed for user `44883b22532e44049d846938dc2cf423`. Rule list: `[]` (Enabled: `True`). {{(pid=79879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:29:59.310201 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-98242ed0-9756-4dd3-a8f2-9f7c6655dc7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:29:59.319335 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 746/1472] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 10 05:29:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 05:29:59.368416 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914ca6a3-1310-419d-ae67-a5e3eae8567a None None] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:29:59.368770 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914ca6a3-1310-419d-ae67-a5e3eae8567a None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:29:59.369128 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914ca6a3-1310-419d-ae67-a5e3eae8567a None None] PATH_INFO: `/` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:29:59.371254 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 727/1473] 10.222.0.23 () {54 vars in 962 bytes} [Tue May 10 05:29:59 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 05:29:59.378462 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b9ac89-58f6-406a-8df4-611277a4c5c0 None None] REQUEST_METHOD: `POST` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:29:59.378746 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b9ac89-58f6-406a-8df4-611277a4c5c0 None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:29:59.379016 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b9ac89-58f6-406a-8df4-611277a4c5c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:29:59.397630 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.auth.core [None req-45b9ac89-58f6-406a-8df4-611277a4c5c0 None None] MFA Rules not processed for user `a5b56aedcfd74914938b0b9cdd102f48`. Rule list: `[]` (Enabled: `True`). {{(pid=79879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:29:59.398866 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-45b9ac89-58f6-406a-8df4-611277a4c5c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:29:59.406619 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 747/1474] 10.222.0.23 () {58 vars in 1059 bytes} [Tue May 10 05:29:59 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 05:29:59.414185 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914ca6a3-1310-419d-ae67-a5e3eae8567a None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:29:59.426181 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914ca6a3-1310-419d-ae67-a5e3eae8567a None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:29:59.430115 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6093f37-c74d-4321-9427-cc97392b75f2 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5b56aedcfd74914938b0b9cdd102f48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f23435f783540199d6dcfd0417c090e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:29:59.430748 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6093f37-c74d-4321-9427-cc97392b75f2 service glance] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:29:59.431029 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6093f37-c74d-4321-9427-cc97392b75f2 service glance] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:29:59.431299 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6093f37-c74d-4321-9427-cc97392b75f2 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:29:59.440464 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6093f37-c74d-4321-9427-cc97392b75f2 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:29:59.441924 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6093f37-c74d-4321-9427-cc97392b75f2 service glance] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:29:59.451415 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 728/1475] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 10 05:29:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 05:30:01.752276 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecb8bb4-db02-4295-a136-44502edef2f6 None None] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:30:01.752890 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecb8bb4-db02-4295-a136-44502edef2f6 None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:30:01.752890 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecb8bb4-db02-4295-a136-44502edef2f6 None None] PATH_INFO: `/` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:30:01.754884 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 748/1476] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 10 05:30:01 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 05:30:01.760281 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226a6999-e0f2-4039-a634-f4efbc8e40c0 None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:30:01.760738 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226a6999-e0f2-4039-a634-f4efbc8e40c0 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:30:01.760860 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226a6999-e0f2-4039-a634-f4efbc8e40c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:30:01.778761 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-226a6999-e0f2-4039-a634-f4efbc8e40c0 None None] MFA Rules not processed for user `44883b22532e44049d846938dc2cf423`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:30:01.780004 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-226a6999-e0f2-4039-a634-f4efbc8e40c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:30:01.789488 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 729/1477] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 10 05:30:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 05:30:01.813990 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecb8bb4-db02-4295-a136-44502edef2f6 None None] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:30:01.834563 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecb8bb4-db02-4295-a136-44502edef2f6 None None] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:30:01.840246 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7feda985-dbfa-4616-bfaf-21e7494b3f67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:30:01.840883 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7feda985-dbfa-4616-bfaf-21e7494b3f67 admin admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:30:01.841161 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7feda985-dbfa-4616-bfaf-21e7494b3f67 admin admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:30:01.841426 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7feda985-dbfa-4616-bfaf-21e7494b3f67 admin admin] PATH_INFO: `/v3/projects` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:30:01.842191 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7feda985-dbfa-4616-bfaf-21e7494b3f67 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:30:01.844046 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: WARNING py.warnings [None req-7feda985-dbfa-4616-bfaf-21e7494b3f67 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 10 05:30:01.844046 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: warnings.warn(msg) May 10 05:30:01.844046 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: May 10 05:30:01.845204 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7feda985-dbfa-4616-bfaf-21e7494b3f67 admin admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:30:01.864623 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 749/1478] 10.222.0.23 () {56 vars in 1108 bytes} [Tue May 10 05:30:01 2022] GET /identity/v3/projects => generated 2553 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 05:30:04.107537 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ebd96e-1c3e-44fd-a4e5-63973fced70b None None] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:30:04.108072 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ebd96e-1c3e-44fd-a4e5-63973fced70b None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:30:04.108072 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ebd96e-1c3e-44fd-a4e5-63973fced70b None None] PATH_INFO: `/` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:30:04.109524 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 730/1479] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 10 05:30:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 05:30:04.115850 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a5851c-3015-40ee-b1c3-35281a503bb6 None None] REQUEST_METHOD: `POST` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:30:04.116324 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a5851c-3015-40ee-b1c3-35281a503bb6 None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:30:04.116431 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a5851c-3015-40ee-b1c3-35281a503bb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:30:04.136700 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.auth.core [None req-14a5851c-3015-40ee-b1c3-35281a503bb6 None None] MFA Rules not processed for user `44883b22532e44049d846938dc2cf423`. Rule list: `[]` (Enabled: `True`). {{(pid=79879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:30:04.137895 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-14a5851c-3015-40ee-b1c3-35281a503bb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:30:04.146825 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 750/1480] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 10 05:30:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 05:30:04.189286 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ebd96e-1c3e-44fd-a4e5-63973fced70b None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:30:04.211224 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ebd96e-1c3e-44fd-a4e5-63973fced70b None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:30:04.217113 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd46e912-5e9b-412b-8688-3bd279bcdec7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f50f224ca944983aecfde86375473da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f23435f783540199d6dcfd0417c090e', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:30:04.217754 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd46e912-5e9b-412b-8688-3bd279bcdec7 service nova] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:30:04.218035 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd46e912-5e9b-412b-8688-3bd279bcdec7 service nova] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:30:04.218309 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd46e912-5e9b-412b-8688-3bd279bcdec7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:30:04.227641 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd46e912-5e9b-412b-8688-3bd279bcdec7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:30:04.230020 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd46e912-5e9b-412b-8688-3bd279bcdec7 service nova] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:30:04.242842 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 731/1481] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 10 05:30:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 05:30:06.618948 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0d9115-6bcb-497a-9da3-41ab57512a93 None None] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:30:06.619605 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0d9115-6bcb-497a-9da3-41ab57512a93 None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:30:06.619605 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0d9115-6bcb-497a-9da3-41ab57512a93 None None] PATH_INFO: `/` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:30:06.620937 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 751/1482] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 10 05:30:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 05:30:06.627843 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de3b4a0-9f72-4e07-b290-307071f47be8 None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:30:06.628608 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de3b4a0-9f72-4e07-b290-307071f47be8 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:30:06.628764 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de3b4a0-9f72-4e07-b290-307071f47be8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:30:06.647611 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-2de3b4a0-9f72-4e07-b290-307071f47be8 None None] MFA Rules not processed for user `44883b22532e44049d846938dc2cf423`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:30:06.648836 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-2de3b4a0-9f72-4e07-b290-307071f47be8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:30:06.657790 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 732/1483] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 10 05:30:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 05:30:06.693588 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0d9115-6bcb-497a-9da3-41ab57512a93 None None] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:30:06.706123 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0d9115-6bcb-497a-9da3-41ab57512a93 None None] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:30:06.710681 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c13394e-fb51-4399-8bd9-a721b350a1bd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c8461cfdd9648b8abcaf8d34b7a102a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f23435f783540199d6dcfd0417c090e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:30:06.711321 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c13394e-fb51-4399-8bd9-a721b350a1bd service neutron] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:30:06.711630 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c13394e-fb51-4399-8bd9-a721b350a1bd service neutron] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:30:06.711906 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c13394e-fb51-4399-8bd9-a721b350a1bd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:30:06.722002 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c13394e-fb51-4399-8bd9-a721b350a1bd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:30:06.723507 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c13394e-fb51-4399-8bd9-a721b350a1bd service neutron] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:30:06.732855 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 752/1484] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 10 05:30:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 05:30:08.982888 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da73828-9864-4f57-9c14-9cbf97cb87f0 None None] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:30:08.983504 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da73828-9864-4f57-9c14-9cbf97cb87f0 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:30:08.983504 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da73828-9864-4f57-9c14-9cbf97cb87f0 None None] PATH_INFO: `/` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:30:08.984875 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 733/1485] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 10 05:30:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 05:30:08.990672 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd056ca-bd5d-4698-a4e5-b95a81a307af None None] REQUEST_METHOD: `POST` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:30:08.991355 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd056ca-bd5d-4698-a4e5-b95a81a307af None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:30:08.991525 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd056ca-bd5d-4698-a4e5-b95a81a307af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:30:09.014918 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.auth.core [None req-4dd056ca-bd5d-4698-a4e5-b95a81a307af None None] MFA Rules not processed for user `44883b22532e44049d846938dc2cf423`. Rule list: `[]` (Enabled: `True`). {{(pid=79879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:30:09.016135 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-4dd056ca-bd5d-4698-a4e5-b95a81a307af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:30:09.025203 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 753/1486] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 10 05:30:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 05:30:09.062903 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da73828-9864-4f57-9c14-9cbf97cb87f0 None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:30:09.081845 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da73828-9864-4f57-9c14-9cbf97cb87f0 None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:30:09.086606 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93883d85-4579-4351-9ae7-ae3a06e5ae2d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c8461cfdd9648b8abcaf8d34b7a102a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f23435f783540199d6dcfd0417c090e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:30:09.087257 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93883d85-4579-4351-9ae7-ae3a06e5ae2d service neutron] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:30:09.087540 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93883d85-4579-4351-9ae7-ae3a06e5ae2d service neutron] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:30:09.087820 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93883d85-4579-4351-9ae7-ae3a06e5ae2d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:30:09.101318 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93883d85-4579-4351-9ae7-ae3a06e5ae2d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:30:09.102806 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93883d85-4579-4351-9ae7-ae3a06e5ae2d service neutron] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:30:09.112296 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 734/1487] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 10 05:30:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 05:30:11.406295 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ba285a-79e7-4ee6-83f1-64da73a26d85 None None] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:30:11.407347 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ba285a-79e7-4ee6-83f1-64da73a26d85 None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:30:11.407347 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ba285a-79e7-4ee6-83f1-64da73a26d85 None None] PATH_INFO: `/` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:30:11.409465 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 754/1488] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 10 05:30:11 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 05:30:11.414956 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d08042-48a2-420b-b095-e654a033b2e2 None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:30:11.415434 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d08042-48a2-420b-b095-e654a033b2e2 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:30:11.415549 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d08042-48a2-420b-b095-e654a033b2e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:30:11.435011 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-b2d08042-48a2-420b-b095-e654a033b2e2 None None] MFA Rules not processed for user `44883b22532e44049d846938dc2cf423`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:30:11.436245 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-b2d08042-48a2-420b-b095-e654a033b2e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:30:11.445596 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 735/1489] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 10 05:30:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 05:30:11.485007 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ba285a-79e7-4ee6-83f1-64da73a26d85 None None] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:30:11.497725 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ba285a-79e7-4ee6-83f1-64da73a26d85 None None] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:30:11.501846 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fca1a6-b3bd-472d-bbd7-a25be528561b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c8461cfdd9648b8abcaf8d34b7a102a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f23435f783540199d6dcfd0417c090e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:30:11.502481 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fca1a6-b3bd-472d-bbd7-a25be528561b service neutron] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:30:11.502757 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fca1a6-b3bd-472d-bbd7-a25be528561b service neutron] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:30:11.503024 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fca1a6-b3bd-472d-bbd7-a25be528561b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:30:11.513473 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25fca1a6-b3bd-472d-bbd7-a25be528561b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:30:11.514899 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25fca1a6-b3bd-472d-bbd7-a25be528561b service neutron] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:30:11.524636 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 755/1490] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 10 05:30:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 05:30:13.984592 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d5743c-b913-4ca0-b7ea-51fd670e96d1 None None] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:30:13.985671 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d5743c-b913-4ca0-b7ea-51fd670e96d1 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:30:13.985671 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d5743c-b913-4ca0-b7ea-51fd670e96d1 None None] PATH_INFO: `/` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:30:13.987635 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 736/1491] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 10 05:30:13 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 05:30:13.996320 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe62b06-d1fd-46e3-a2e0-1d42b75501e0 None None] REQUEST_METHOD: `POST` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:30:13.996757 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe62b06-d1fd-46e3-a2e0-1d42b75501e0 None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:30:13.996882 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe62b06-d1fd-46e3-a2e0-1d42b75501e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:30:14.023261 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.auth.core [None req-8fe62b06-d1fd-46e3-a2e0-1d42b75501e0 None None] MFA Rules not processed for user `44883b22532e44049d846938dc2cf423`. Rule list: `[]` (Enabled: `True`). {{(pid=79879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:30:14.024503 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-8fe62b06-d1fd-46e3-a2e0-1d42b75501e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:30:14.032527 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 756/1492] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 10 05:30:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 05:30:14.071208 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d5743c-b913-4ca0-b7ea-51fd670e96d1 None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:30:14.084085 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d5743c-b913-4ca0-b7ea-51fd670e96d1 None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:30:14.088481 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092459a1-0d3a-46be-9ea1-29f742c83925 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c8461cfdd9648b8abcaf8d34b7a102a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f23435f783540199d6dcfd0417c090e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:30:14.089135 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092459a1-0d3a-46be-9ea1-29f742c83925 service neutron] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:30:14.089417 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092459a1-0d3a-46be-9ea1-29f742c83925 service neutron] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:30:14.089683 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092459a1-0d3a-46be-9ea1-29f742c83925 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:30:14.100014 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092459a1-0d3a-46be-9ea1-29f742c83925 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:30:14.101458 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092459a1-0d3a-46be-9ea1-29f742c83925 service neutron] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:30:14.110705 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 737/1493] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 10 05:30:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 05:31:40.590372 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca3eac5-ba2a-4adb-8357-8480ced61595 None None] REQUEST_METHOD: `POST` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:31:40.590981 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca3eac5-ba2a-4adb-8357-8480ced61595 None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:31:40.590981 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca3eac5-ba2a-4adb-8357-8480ced61595 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:31:40.609883 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.auth.core [None req-7ca3eac5-ba2a-4adb-8357-8480ced61595 None None] MFA Rules not processed for user `44883b22532e44049d846938dc2cf423`. Rule list: `[]` (Enabled: `True`). {{(pid=79879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:31:40.611108 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-7ca3eac5-ba2a-4adb-8357-8480ced61595 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:31:40.619531 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 757/1494] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 10 05:31:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 05:31:40.629540 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdc5dea-01a2-42e6-b287-d3dc91309eca None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:31:40.630079 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdc5dea-01a2-42e6-b287-d3dc91309eca None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:31:40.630079 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdc5dea-01a2-42e6-b287-d3dc91309eca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:31:40.648944 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-efdc5dea-01a2-42e6-b287-d3dc91309eca None None] MFA Rules not processed for user `44883b22532e44049d846938dc2cf423`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:31:40.650148 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-efdc5dea-01a2-42e6-b287-d3dc91309eca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:31:40.659962 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 738/1495] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 10 05:31:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 05:31:40.666577 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca3eac5-ba2a-4adb-8357-8480ced61595 None None] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:31:40.677001 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca3eac5-ba2a-4adb-8357-8480ced61595 None None] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:31:40.682969 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae7264a-38e0-4b28-93ce-eb3380ef3abb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:31:40.683647 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae7264a-38e0-4b28-93ce-eb3380ef3abb admin admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:31:40.683956 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae7264a-38e0-4b28-93ce-eb3380ef3abb admin admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:31:40.684219 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae7264a-38e0-4b28-93ce-eb3380ef3abb admin admin] PATH_INFO: `/v3/domains` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:31:40.684961 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae7264a-38e0-4b28-93ce-eb3380ef3abb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:31:40.685259 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae7264a-38e0-4b28-93ce-eb3380ef3abb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:31:40.686292 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: WARNING py.warnings [None req-5ae7264a-38e0-4b28-93ce-eb3380ef3abb admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 05:31:40.686292 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: warnings.warn(msg) May 10 05:31:40.686292 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: May 10 05:31:40.687177 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae7264a-38e0-4b28-93ce-eb3380ef3abb admin admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:31:40.699122 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 758/1496] 10.222.0.23 () {58 vars in 1152 bytes} [Tue May 10 05:31:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:31:40.708395 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdc5dea-01a2-42e6-b287-d3dc91309eca None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:31:40.722454 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdc5dea-01a2-42e6-b287-d3dc91309eca None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:31:40.731262 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e72be0a-2510-4f22-84f9-fe80e7298d32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:31:40.732250 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e72be0a-2510-4f22-84f9-fe80e7298d32 admin admin] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:31:40.732570 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e72be0a-2510-4f22-84f9-fe80e7298d32 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:31:40.732867 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e72be0a-2510-4f22-84f9-fe80e7298d32 admin admin] PATH_INFO: `/v3/projects` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:31:40.733925 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e72be0a-2510-4f22-84f9-fe80e7298d32 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:31:40.736679 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: WARNING py.warnings [None req-7e72be0a-2510-4f22-84f9-fe80e7298d32 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 10 05:31:40.736679 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: warnings.warn(msg) May 10 05:31:40.736679 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: May 10 05:31:40.738134 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e72be0a-2510-4f22-84f9-fe80e7298d32 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:31:40.778492 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 739/1497] 10.222.0.23 () {60 vars in 1152 bytes} [Tue May 10 05:31:40 2022] POST /identity/v3/projects => generated 379 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 05:31:40.784817 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae7264a-38e0-4b28-93ce-eb3380ef3abb admin admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:31:40.800344 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae7264a-38e0-4b28-93ce-eb3380ef3abb admin admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:31:40.857133 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e99454-f3a0-4dba-bb54-edce719724b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:31:40.857806 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e99454-f3a0-4dba-bb54-edce719724b4 admin admin] REQUEST_METHOD: `POST` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:31:40.858081 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e99454-f3a0-4dba-bb54-edce719724b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:31:40.858350 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e99454-f3a0-4dba-bb54-edce719724b4 admin admin] PATH_INFO: `/v3/users` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:31:40.859045 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e99454-f3a0-4dba-bb54-edce719724b4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:31:40.860110 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: WARNING py.warnings [None req-f7e99454-f3a0-4dba-bb54-edce719724b4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 10 05:31:40.860110 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: warnings.warn(msg) May 10 05:31:40.860110 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: May 10 05:31:40.861310 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e99454-f3a0-4dba-bb54-edce719724b4 admin admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:31:40.881748 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 759/1498] 10.222.0.23 () {60 vars in 1143 bytes} [Tue May 10 05:31:40 2022] POST /identity/v3/users => generated 290 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 05:31:40.886025 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e72be0a-2510-4f22-84f9-fe80e7298d32 admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:31:40.896369 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e72be0a-2510-4f22-84f9-fe80e7298d32 admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:31:40.901707 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8163d178-8620-4e38-9210-3cdd2f669ab7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:31:40.902373 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8163d178-8620-4e38-9210-3cdd2f669ab7 admin admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:31:40.902652 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8163d178-8620-4e38-9210-3cdd2f669ab7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:31:40.902923 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8163d178-8620-4e38-9210-3cdd2f669ab7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:31:40.903690 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8163d178-8620-4e38-9210-3cdd2f669ab7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:31:40.904721 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: WARNING py.warnings [None req-8163d178-8620-4e38-9210-3cdd2f669ab7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 05:31:40.904721 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: warnings.warn(msg) May 10 05:31:40.904721 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: May 10 05:31:40.905599 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8163d178-8620-4e38-9210-3cdd2f669ab7 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:31:40.918532 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 740/1499] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 10 05:31:40 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 05:31:40.922633 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e99454-f3a0-4dba-bb54-edce719724b4 admin admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:31:40.933250 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e99454-f3a0-4dba-bb54-edce719724b4 admin admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:31:40.938811 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cd55fd-a458-49a5-86c3-ca1ab180b6c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:31:40.939457 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cd55fd-a458-49a5-86c3-ca1ab180b6c2 admin admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:31:40.939793 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cd55fd-a458-49a5-86c3-ca1ab180b6c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:31:40.940063 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cd55fd-a458-49a5-86c3-ca1ab180b6c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:31:40.940797 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46cd55fd-a458-49a5-86c3-ca1ab180b6c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:31:40.941807 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: WARNING py.warnings [None req-46cd55fd-a458-49a5-86c3-ca1ab180b6c2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 05:31:40.941807 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: warnings.warn(msg) May 10 05:31:40.941807 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: May 10 05:31:40.942689 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46cd55fd-a458-49a5-86c3-ca1ab180b6c2 admin admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:31:40.956838 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 760/1500] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 10 05:31:40 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 05:31:40.961153 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8163d178-8620-4e38-9210-3cdd2f669ab7 admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:31:40.971065 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8163d178-8620-4e38-9210-3cdd2f669ab7 admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:31:40.976065 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf101b4-2422-4355-b391-d5e515c2bc2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:31:40.976910 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf101b4-2422-4355-b391-d5e515c2bc2c admin admin] REQUEST_METHOD: `PUT` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:31:40.977185 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf101b4-2422-4355-b391-d5e515c2bc2c admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:31:40.977460 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf101b4-2422-4355-b391-d5e515c2bc2c admin admin] PATH_INFO: `/v3/projects/8a52cc3095274a1aa849a4d8aa0157c0/users/3fe8bbf4df444429b275f0060a7500b0/roles/382636e67fc142a2b2f486340d959e11` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:31:40.993373 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf101b4-2422-4355-b391-d5e515c2bc2c admin admin] RBAC: Authorizing `identity:create_grant(project_id=8a52cc3095274a1aa849a4d8aa0157c0, user_id=3fe8bbf4df444429b275f0060a7500b0, role_id=382636e67fc142a2b2f486340d959e11)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:31:40.994428 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: WARNING py.warnings [None req-ddf101b4-2422-4355-b391-d5e515c2bc2c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 10 05:31:40.994428 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: warnings.warn(msg) May 10 05:31:40.994428 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: May 10 05:31:40.996882 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf101b4-2422-4355-b391-d5e515c2bc2c admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:31:41.012602 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 741/1501] 10.222.0.23 () {60 vars in 1482 bytes} [Tue May 10 05:31:40 2022] PUT /identity/v3/projects/8a52cc3095274a1aa849a4d8aa0157c0/users/3fe8bbf4df444429b275f0060a7500b0/roles/382636e67fc142a2b2f486340d959e11 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 05:31:41.030680 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c0c70b-5116-4e62-ae2b-aa99f95cd5f1 None None] REQUEST_METHOD: `POST` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:31:41.031059 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c0c70b-5116-4e62-ae2b-aa99f95cd5f1 None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:31:41.031450 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c0c70b-5116-4e62-ae2b-aa99f95cd5f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:31:41.059849 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.auth.core [None req-77c0c70b-5116-4e62-ae2b-aa99f95cd5f1 None None] MFA Rules not processed for user `3fe8bbf4df444429b275f0060a7500b0`. Rule list: `[]` (Enabled: `True`). {{(pid=79879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:31:41.061060 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-77c0c70b-5116-4e62-ae2b-aa99f95cd5f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:31:41.126152 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 761/1502] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 10 05:31:41 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 05:31:41.139856 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b04bfaf-2e93-4d7c-a7c2-b6c0e0e09170 None None] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:31:41.140146 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b04bfaf-2e93-4d7c-a7c2-b6c0e0e09170 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:31:41.140414 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b04bfaf-2e93-4d7c-a7c2-b6c0e0e09170 None None] PATH_INFO: `/` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:31:41.141855 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 742/1503] 10.222.0.23 () {54 vars in 963 bytes} [Tue May 10 05:31:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 05:31:41.149075 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7ec349-281b-4217-8f80-3d60242699f4 None None] REQUEST_METHOD: `POST` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:31:41.149368 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7ec349-281b-4217-8f80-3d60242699f4 None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:31:41.149649 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7ec349-281b-4217-8f80-3d60242699f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:31:41.168822 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.auth.core [None req-3e7ec349-281b-4217-8f80-3d60242699f4 None None] MFA Rules not processed for user `355be413675540a39ccb00e1a0722316`. Rule list: `[]` (Enabled: `True`). {{(pid=79879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:31:41.170038 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-3e7ec349-281b-4217-8f80-3d60242699f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:31:41.225900 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 762/1504] 10.222.0.23 () {58 vars in 1060 bytes} [Tue May 10 05:31:41 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 05:31:41.236943 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b04bfaf-2e93-4d7c-a7c2-b6c0e0e09170 None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:31:41.249651 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b04bfaf-2e93-4d7c-a7c2-b6c0e0e09170 None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:31:41.254527 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78da27d-e3f5-4c32-ba8f-8fbec78fb37e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355be413675540a39ccb00e1a0722316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f23435f783540199d6dcfd0417c090e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:31:41.255159 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78da27d-e3f5-4c32-ba8f-8fbec78fb37e service cinder] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:31:41.255432 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78da27d-e3f5-4c32-ba8f-8fbec78fb37e service cinder] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:31:41.255752 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78da27d-e3f5-4c32-ba8f-8fbec78fb37e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:31:41.264586 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78da27d-e3f5-4c32-ba8f-8fbec78fb37e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:31:41.266030 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78da27d-e3f5-4c32-ba8f-8fbec78fb37e service cinder] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:31:41.275347 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 743/1505] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 10 05:31:41 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 05:31:41.318219 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1802d7e3-041f-494e-8c6b-7f7dfdeb77a3 None None] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:31:41.318508 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1802d7e3-041f-494e-8c6b-7f7dfdeb77a3 None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:31:41.318785 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1802d7e3-041f-494e-8c6b-7f7dfdeb77a3 None None] PATH_INFO: `/` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:31:41.320155 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 763/1506] 10.222.0.23 () {52 vars in 829 bytes} [Tue May 10 05:31:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 05:31:41.324147 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78da27d-e3f5-4c32-ba8f-8fbec78fb37e service cinder] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:31:41.397920 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78da27d-e3f5-4c32-ba8f-8fbec78fb37e service cinder] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:31:41.403145 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbd8fb2-010e-4e7c-9ecb-af6ec553ef1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:31:41.404066 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbd8fb2-010e-4e7c-9ecb-af6ec553ef1d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:31:41.404349 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbd8fb2-010e-4e7c-9ecb-af6ec553ef1d admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:31:41.404619 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbd8fb2-010e-4e7c-9ecb-af6ec553ef1d admin admin] PATH_INFO: `/v3/users/3fe8bbf4df444429b275f0060a7500b0` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:31:41.405880 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbd8fb2-010e-4e7c-9ecb-af6ec553ef1d admin admin] RBAC: Authorizing `identity:delete_user(user_id=3fe8bbf4df444429b275f0060a7500b0)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:31:41.406914 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: WARNING py.warnings [None req-dfbd8fb2-010e-4e7c-9ecb-af6ec553ef1d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 10 05:31:41.406914 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: warnings.warn(msg) May 10 05:31:41.406914 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: May 10 05:31:41.408161 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbd8fb2-010e-4e7c-9ecb-af6ec553ef1d admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:31:41.474382 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-dfbd8fb2-010e-4e7c-9ecb-af6ec553ef1d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3fe8bbf4df444429b275f0060a7500b0'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:31:41.495064 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-dfbd8fb2-010e-4e7c-9ecb-af6ec553ef1d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3fe8bbf4df444429b275f0060a7500b0'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:31:41.495901 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-dfbd8fb2-010e-4e7c-9ecb-af6ec553ef1d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3fe8bbf4df444429b275f0060a7500b0'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:31:41.509376 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-dfbd8fb2-010e-4e7c-9ecb-af6ec553ef1d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3fe8bbf4df444429b275f0060a7500b0'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:31:41.510259 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-dfbd8fb2-010e-4e7c-9ecb-af6ec553ef1d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3fe8bbf4df444429b275f0060a7500b0'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:31:41.528344 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 744/1507] 10.222.0.23 () {58 vars in 1223 bytes} [Tue May 10 05:31:41 2022] DELETE /identity/v3/users/3fe8bbf4df444429b275f0060a7500b0 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 05:31:41.535305 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a119ab35-69e7-454f-a1f7-760965ae6ea0 None None] REQUEST_METHOD: `POST` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:31:41.535754 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a119ab35-69e7-454f-a1f7-760965ae6ea0 None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:31:41.536151 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a119ab35-69e7-454f-a1f7-760965ae6ea0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:31:41.558116 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.auth.core [None req-a119ab35-69e7-454f-a1f7-760965ae6ea0 None None] MFA Rules not processed for user `44883b22532e44049d846938dc2cf423`. Rule list: `[]` (Enabled: `True`). {{(pid=79879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:31:41.559331 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-a119ab35-69e7-454f-a1f7-760965ae6ea0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:31:41.637620 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 764/1508] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 10 05:31:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 05:31:41.647853 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbd8fb2-010e-4e7c-9ecb-af6ec553ef1d admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:31:41.649522 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-dfbd8fb2-010e-4e7c-9ecb-af6ec553ef1d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:31:41.709893 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbd8fb2-010e-4e7c-9ecb-af6ec553ef1d admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:31:41.713662 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce00a878-9e2d-47dd-a34e-8e3f61f52d84 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c8461cfdd9648b8abcaf8d34b7a102a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f23435f783540199d6dcfd0417c090e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:31:41.714320 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce00a878-9e2d-47dd-a34e-8e3f61f52d84 service neutron] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:31:41.714637 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce00a878-9e2d-47dd-a34e-8e3f61f52d84 service neutron] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:31:41.714916 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce00a878-9e2d-47dd-a34e-8e3f61f52d84 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:31:41.724006 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce00a878-9e2d-47dd-a34e-8e3f61f52d84 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:31:41.725484 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce00a878-9e2d-47dd-a34e-8e3f61f52d84 service neutron] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:31:41.734687 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 745/1509] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 10 05:31:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 05:31:42.075357 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a119ab35-69e7-454f-a1f7-760965ae6ea0 None None] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:31:42.076909 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-a119ab35-69e7-454f-a1f7-760965ae6ea0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:31:42.089112 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a119ab35-69e7-454f-a1f7-760965ae6ea0 None None] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:31:42.095408 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5522e0-8aa9-4b79-a73e-2503b1a36e54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:31:42.096287 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5522e0-8aa9-4b79-a73e-2503b1a36e54 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:31:42.096634 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5522e0-8aa9-4b79-a73e-2503b1a36e54 admin admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:31:42.096907 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5522e0-8aa9-4b79-a73e-2503b1a36e54 admin admin] PATH_INFO: `/v3/projects/8a52cc3095274a1aa849a4d8aa0157c0` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:31:42.098126 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5522e0-8aa9-4b79-a73e-2503b1a36e54 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8a52cc3095274a1aa849a4d8aa0157c0)` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:31:42.099193 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: WARNING py.warnings [None req-ad5522e0-8aa9-4b79-a73e-2503b1a36e54 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 10 05:31:42.099193 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: warnings.warn(msg) May 10 05:31:42.099193 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: May 10 05:31:42.100463 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5522e0-8aa9-4b79-a73e-2503b1a36e54 admin admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:31:42.158245 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-ad5522e0-8aa9-4b79-a73e-2503b1a36e54 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8a52cc3095274a1aa849a4d8aa0157c0', 'request_id': 'req-ad5522e0-8aa9-4b79-a73e-2503b1a36e54'} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:31:42.171555 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-ad5522e0-8aa9-4b79-a73e-2503b1a36e54 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8a52cc3095274a1aa849a4d8aa0157c0', 'request_id': 'req-ad5522e0-8aa9-4b79-a73e-2503b1a36e54'} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:31:42.183009 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-ad5522e0-8aa9-4b79-a73e-2503b1a36e54 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8a52cc3095274a1aa849a4d8aa0157c0', 'request_id': 'req-ad5522e0-8aa9-4b79-a73e-2503b1a36e54'} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:31:42.194173 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-ad5522e0-8aa9-4b79-a73e-2503b1a36e54 admin admin] The token cache is being invalidate because project 8a52cc3095274a1aa849a4d8aa0157c0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79879) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 05:31:42.194459 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-ad5522e0-8aa9-4b79-a73e-2503b1a36e54 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:31:42.195174 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-ad5522e0-8aa9-4b79-a73e-2503b1a36e54 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:31:42.196798 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 765/1510] 10.222.0.23 () {58 vars in 1232 bytes} [Tue May 10 05:31:42 2022] DELETE /identity/v3/projects/8a52cc3095274a1aa849a4d8aa0157c0 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 05:33:20.192662 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9af6b2-1893-4c15-810c-34c9ca258103 None None] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:33:20.193107 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9af6b2-1893-4c15-810c-34c9ca258103 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:33:20.193107 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9af6b2-1893-4c15-810c-34c9ca258103 None None] PATH_INFO: `/` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:33:20.194506 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 746/1511] 127.0.0.1 () {54 vars in 901 bytes} [Tue May 10 05:33:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 05:33:20.200827 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae92c2ff-3150-4ca8-8763-8d8d8400f1d5 None None] REQUEST_METHOD: `POST` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:33:20.201305 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae92c2ff-3150-4ca8-8763-8d8d8400f1d5 None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:33:20.201488 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae92c2ff-3150-4ca8-8763-8d8d8400f1d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:33:20.224519 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.auth.core [None req-ae92c2ff-3150-4ca8-8763-8d8d8400f1d5 None None] MFA Rules not processed for user `44883b22532e44049d846938dc2cf423`. Rule list: `[]` (Enabled: `True`). {{(pid=79879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:33:20.225711 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-ae92c2ff-3150-4ca8-8763-8d8d8400f1d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:33:20.286642 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 766/1512] 127.0.0.1 () {58 vars in 998 bytes} [Tue May 10 05:33:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 05:33:20.457096 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9af6b2-1893-4c15-810c-34c9ca258103 None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:33:20.459901 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-1b9af6b2-1893-4c15-810c-34c9ca258103 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:33:20.540054 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9af6b2-1893-4c15-810c-34c9ca258103 None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:33:20.546372 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e478243-4bfb-493a-a478-96ad7def5575 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f50f224ca944983aecfde86375473da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f23435f783540199d6dcfd0417c090e', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:33:20.547015 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e478243-4bfb-493a-a478-96ad7def5575 service nova] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:33:20.547293 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e478243-4bfb-493a-a478-96ad7def5575 service nova] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:33:20.547564 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e478243-4bfb-493a-a478-96ad7def5575 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:33:20.556094 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e478243-4bfb-493a-a478-96ad7def5575 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:33:20.557682 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e478243-4bfb-493a-a478-96ad7def5575 service nova] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:33:20.566961 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 747/1513] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 10 05:33:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 05:33:21.355218 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3827f2-1ea2-4e3f-b7b3-c7adfa88d231 None None] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:33:21.355843 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3827f2-1ea2-4e3f-b7b3-c7adfa88d231 None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:33:21.355843 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3827f2-1ea2-4e3f-b7b3-c7adfa88d231 None None] PATH_INFO: `/v3` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:33:21.357240 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 767/1514] 10.222.0.50 () {54 vars in 925 bytes} [Tue May 10 05:33:21 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:33:21.372128 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733ea7f1-5880-48ca-9c65-8dff912bd82d None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:33:21.372609 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733ea7f1-5880-48ca-9c65-8dff912bd82d None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:33:21.372718 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733ea7f1-5880-48ca-9c65-8dff912bd82d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:33:21.392232 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-733ea7f1-5880-48ca-9c65-8dff912bd82d None None] MFA Rules not processed for user `67321ca3e5624273acd5b06264738000`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:33:21.393454 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-733ea7f1-5880-48ca-9c65-8dff912bd82d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:33:21.465609 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 748/1515] 10.222.0.50 () {58 vars in 1015 bytes} [Tue May 10 05:33:21 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 05:33:21.482328 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c26aec-8739-460d-a644-c9e70d1f99b4 None None] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:33:21.482619 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c26aec-8739-460d-a644-c9e70d1f99b4 None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:33:21.482892 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c26aec-8739-460d-a644-c9e70d1f99b4 None None] PATH_INFO: `/` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:33:21.484382 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 768/1516] 127.0.0.1 () {54 vars in 901 bytes} [Tue May 10 05:33:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 05:33:21.492454 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf3a971-29b2-4d43-929f-ba41cc1c2400 None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:33:21.492685 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf3a971-29b2-4d43-929f-ba41cc1c2400 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:33:21.492958 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf3a971-29b2-4d43-929f-ba41cc1c2400 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:33:21.511980 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-fcf3a971-29b2-4d43-929f-ba41cc1c2400 None None] MFA Rules not processed for user `44883b22532e44049d846938dc2cf423`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:33:21.513177 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-fcf3a971-29b2-4d43-929f-ba41cc1c2400 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:33:21.522210 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 749/1517] 127.0.0.1 () {58 vars in 998 bytes} [Tue May 10 05:33:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 05:33:21.679297 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c26aec-8739-460d-a644-c9e70d1f99b4 None None] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:33:21.695017 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c26aec-8739-460d-a644-c9e70d1f99b4 None None] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:33:21.700834 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1604ea56-eecc-476b-bc31-bf250bdb896e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f50f224ca944983aecfde86375473da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f23435f783540199d6dcfd0417c090e', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:33:21.701465 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1604ea56-eecc-476b-bc31-bf250bdb896e service nova] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:33:21.701747 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1604ea56-eecc-476b-bc31-bf250bdb896e service nova] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:33:21.702024 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1604ea56-eecc-476b-bc31-bf250bdb896e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:33:21.710294 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1604ea56-eecc-476b-bc31-bf250bdb896e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:33:21.712074 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1604ea56-eecc-476b-bc31-bf250bdb896e service nova] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:33:21.721352 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 769/1518] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 10 05:33:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 05:33:25.406195 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5247cf6c-f7a8-48c5-b46d-d4a25ab089a5 None None] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:33:25.406739 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5247cf6c-f7a8-48c5-b46d-d4a25ab089a5 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:33:25.406739 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5247cf6c-f7a8-48c5-b46d-d4a25ab089a5 None None] PATH_INFO: `/` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:33:25.408237 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 750/1519] 10.222.0.23 () {54 vars in 960 bytes} [Tue May 10 05:33:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 05:33:25.413385 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec2a2d5-5190-4bfd-86ad-fb4e60e876aa None None] REQUEST_METHOD: `POST` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:33:25.413845 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec2a2d5-5190-4bfd-86ad-fb4e60e876aa None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:33:25.413958 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec2a2d5-5190-4bfd-86ad-fb4e60e876aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:33:25.433190 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.auth.core [None req-5ec2a2d5-5190-4bfd-86ad-fb4e60e876aa None None] MFA Rules not processed for user `67321ca3e5624273acd5b06264738000`. Rule list: `[]` (Enabled: `True`). {{(pid=79879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:33:25.434389 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-5ec2a2d5-5190-4bfd-86ad-fb4e60e876aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:33:25.449763 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 770/1520] 10.222.0.23 () {58 vars in 1057 bytes} [Tue May 10 05:33:25 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 05:33:25.457967 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5247cf6c-f7a8-48c5-b46d-d4a25ab089a5 None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:33:25.472168 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5247cf6c-f7a8-48c5-b46d-d4a25ab089a5 None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:33:25.477234 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37349146-2c1b-4eac-a860-8d73787e0559 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67321ca3e5624273acd5b06264738000', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f23435f783540199d6dcfd0417c090e', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:33:25.477873 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37349146-2c1b-4eac-a860-8d73787e0559 service placement] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:33:25.478149 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37349146-2c1b-4eac-a860-8d73787e0559 service placement] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:33:25.478412 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37349146-2c1b-4eac-a860-8d73787e0559 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:33:25.487021 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37349146-2c1b-4eac-a860-8d73787e0559 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:33:25.488648 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37349146-2c1b-4eac-a860-8d73787e0559 service placement] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:33:25.498524 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 751/1521] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 10 05:33:25 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 05:33:33.054111 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1190f6-8fa0-4e68-850b-bd2e2870b26e None None] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:33:33.054707 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1190f6-8fa0-4e68-850b-bd2e2870b26e None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:33:33.054817 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1190f6-8fa0-4e68-850b-bd2e2870b26e None None] PATH_INFO: `/` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:33:33.056321 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 771/1522] 127.0.0.1 () {54 vars in 901 bytes} [Tue May 10 05:33:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 05:33:33.061281 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e924d7-b5f9-45ce-999a-5445cb601d84 None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:33:33.061739 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e924d7-b5f9-45ce-999a-5445cb601d84 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:33:33.061838 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e924d7-b5f9-45ce-999a-5445cb601d84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:33:33.080883 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-52e924d7-b5f9-45ce-999a-5445cb601d84 None None] MFA Rules not processed for user `44883b22532e44049d846938dc2cf423`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:33:33.082095 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-52e924d7-b5f9-45ce-999a-5445cb601d84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:33:33.091054 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 752/1523] 127.0.0.1 () {58 vars in 998 bytes} [Tue May 10 05:33:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 05:33:33.242034 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1190f6-8fa0-4e68-850b-bd2e2870b26e None None] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:33:33.264169 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1190f6-8fa0-4e68-850b-bd2e2870b26e None None] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:33:33.270929 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa978bf-c8a6-4178-ac67-d6d5061e28e1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f50f224ca944983aecfde86375473da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f23435f783540199d6dcfd0417c090e', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:33:33.271566 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa978bf-c8a6-4178-ac67-d6d5061e28e1 service nova] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:33:33.271880 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa978bf-c8a6-4178-ac67-d6d5061e28e1 service nova] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:33:33.272157 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa978bf-c8a6-4178-ac67-d6d5061e28e1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:33:33.280321 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa978bf-c8a6-4178-ac67-d6d5061e28e1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:33:33.281946 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa978bf-c8a6-4178-ac67-d6d5061e28e1 service nova] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:33:33.291911 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 772/1524] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 10 05:33:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 05:33:34.183376 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71909a91-b13c-4a77-9bda-66f739258335 None None] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:33:34.184016 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71909a91-b13c-4a77-9bda-66f739258335 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:33:34.184016 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71909a91-b13c-4a77-9bda-66f739258335 None None] PATH_INFO: `/` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:33:34.185379 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 753/1525] 127.0.0.1 () {54 vars in 901 bytes} [Tue May 10 05:33:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 05:33:34.190521 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c3d04c-1677-4f4e-80c0-3ef0dcf670af None None] REQUEST_METHOD: `POST` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:33:34.190969 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c3d04c-1677-4f4e-80c0-3ef0dcf670af None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:33:34.191077 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c3d04c-1677-4f4e-80c0-3ef0dcf670af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:33:34.210759 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.auth.core [None req-b8c3d04c-1677-4f4e-80c0-3ef0dcf670af None None] MFA Rules not processed for user `44883b22532e44049d846938dc2cf423`. Rule list: `[]` (Enabled: `True`). {{(pid=79879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:33:34.212006 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-b8c3d04c-1677-4f4e-80c0-3ef0dcf670af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:33:34.220612 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 773/1526] 127.0.0.1 () {58 vars in 998 bytes} [Tue May 10 05:33:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 05:33:34.370453 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71909a91-b13c-4a77-9bda-66f739258335 None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:33:34.388758 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71909a91-b13c-4a77-9bda-66f739258335 None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:33:34.400263 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8644d30-8ab9-426c-aa71-97ea7edf4464 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f50f224ca944983aecfde86375473da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f23435f783540199d6dcfd0417c090e', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:33:34.401284 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8644d30-8ab9-426c-aa71-97ea7edf4464 service nova] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:33:34.401765 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8644d30-8ab9-426c-aa71-97ea7edf4464 service nova] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:33:34.402045 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8644d30-8ab9-426c-aa71-97ea7edf4464 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:33:34.410843 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8644d30-8ab9-426c-aa71-97ea7edf4464 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:33:34.412480 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8644d30-8ab9-426c-aa71-97ea7edf4464 service nova] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:33:34.422715 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 754/1527] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 10 05:33:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 05:33:38.590851 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c524f78-3d7b-4151-8dae-1f698cc30981 None None] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:33:38.591451 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c524f78-3d7b-4151-8dae-1f698cc30981 None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:33:38.591451 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c524f78-3d7b-4151-8dae-1f698cc30981 None None] PATH_INFO: `/` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:33:38.592887 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 774/1528] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 10 05:33:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 05:33:38.598731 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738551dc-817d-4a01-b09d-4db5eed92712 None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:33:38.599224 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738551dc-817d-4a01-b09d-4db5eed92712 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:33:38.599224 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738551dc-817d-4a01-b09d-4db5eed92712 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:33:38.624331 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-738551dc-817d-4a01-b09d-4db5eed92712 None None] MFA Rules not processed for user `44883b22532e44049d846938dc2cf423`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:33:38.625541 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-738551dc-817d-4a01-b09d-4db5eed92712 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:33:38.634673 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 755/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 10 05:33:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 05:33:38.671283 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c524f78-3d7b-4151-8dae-1f698cc30981 None None] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:33:38.673288 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-3c524f78-3d7b-4151-8dae-1f698cc30981 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:33:38.736864 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c524f78-3d7b-4151-8dae-1f698cc30981 None None] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:33:38.743359 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cde2e3d-a9a4-4e52-a7d2-e2ddc1f589a3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c8461cfdd9648b8abcaf8d34b7a102a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f23435f783540199d6dcfd0417c090e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:33:38.744321 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cde2e3d-a9a4-4e52-a7d2-e2ddc1f589a3 service neutron] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:33:38.744678 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cde2e3d-a9a4-4e52-a7d2-e2ddc1f589a3 service neutron] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:33:38.745037 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cde2e3d-a9a4-4e52-a7d2-e2ddc1f589a3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:33:38.755598 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cde2e3d-a9a4-4e52-a7d2-e2ddc1f589a3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:33:38.757060 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cde2e3d-a9a4-4e52-a7d2-e2ddc1f589a3 service neutron] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:33:38.766784 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 775/1530] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 10 05:33:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 05:33:40.970101 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8711aa0a-b6e2-49ee-89c1-8f72c4dd89d9 None None] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:33:40.970718 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8711aa0a-b6e2-49ee-89c1-8f72c4dd89d9 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:33:40.970718 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8711aa0a-b6e2-49ee-89c1-8f72c4dd89d9 None None] PATH_INFO: `/` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:33:40.972911 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 756/1531] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 10 05:33:40 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 05:33:40.981949 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e2569f-86cf-4b79-ae65-47140770ed11 None None] REQUEST_METHOD: `POST` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:33:40.982384 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e2569f-86cf-4b79-ae65-47140770ed11 None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:33:40.982565 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e2569f-86cf-4b79-ae65-47140770ed11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:33:41.005765 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.auth.core [None req-b0e2569f-86cf-4b79-ae65-47140770ed11 None None] MFA Rules not processed for user `44883b22532e44049d846938dc2cf423`. Rule list: `[]` (Enabled: `True`). {{(pid=79879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:33:41.006964 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-b0e2569f-86cf-4b79-ae65-47140770ed11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:33:41.015608 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 776/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 10 05:33:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 05:33:41.053592 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8711aa0a-b6e2-49ee-89c1-8f72c4dd89d9 None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:33:41.067265 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8711aa0a-b6e2-49ee-89c1-8f72c4dd89d9 None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:33:41.071706 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd76fb73-8ba9-4e8f-837c-afb4b04aeb8e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c8461cfdd9648b8abcaf8d34b7a102a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f23435f783540199d6dcfd0417c090e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:33:41.072356 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd76fb73-8ba9-4e8f-837c-afb4b04aeb8e service neutron] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:33:41.072639 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd76fb73-8ba9-4e8f-837c-afb4b04aeb8e service neutron] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:33:41.072915 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd76fb73-8ba9-4e8f-837c-afb4b04aeb8e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:33:41.081958 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd76fb73-8ba9-4e8f-837c-afb4b04aeb8e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:33:41.083410 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd76fb73-8ba9-4e8f-837c-afb4b04aeb8e service neutron] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:33:41.092881 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 757/1533] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 10 05:33:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 05:33:44.764745 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906609c4-0e14-4968-a15d-da1358743204 None None] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:33:44.765322 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906609c4-0e14-4968-a15d-da1358743204 None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:33:44.765322 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906609c4-0e14-4968-a15d-da1358743204 None None] PATH_INFO: `/` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:33:44.767190 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 777/1534] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 10 05:33:44 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 05:33:44.773503 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c032f03c-135a-47ac-b046-7f8c320ffa0f None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:33:44.774220 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c032f03c-135a-47ac-b046-7f8c320ffa0f None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:33:44.774337 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c032f03c-135a-47ac-b046-7f8c320ffa0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:33:44.800705 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-c032f03c-135a-47ac-b046-7f8c320ffa0f None None] MFA Rules not processed for user `44883b22532e44049d846938dc2cf423`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:33:44.801923 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-c032f03c-135a-47ac-b046-7f8c320ffa0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:33:44.811134 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 758/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 10 05:33:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 05:33:45.082931 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906609c4-0e14-4968-a15d-da1358743204 None None] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:33:45.085028 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-906609c4-0e14-4968-a15d-da1358743204 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:33:45.147392 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906609c4-0e14-4968-a15d-da1358743204 None None] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:33:45.151497 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317a5888-9d75-498e-bd7e-d816da47e543 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355be413675540a39ccb00e1a0722316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f23435f783540199d6dcfd0417c090e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:33:45.152162 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317a5888-9d75-498e-bd7e-d816da47e543 service cinder] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:33:45.152447 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317a5888-9d75-498e-bd7e-d816da47e543 service cinder] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:33:45.152722 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317a5888-9d75-498e-bd7e-d816da47e543 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:33:45.161948 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317a5888-9d75-498e-bd7e-d816da47e543 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:33:45.163386 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317a5888-9d75-498e-bd7e-d816da47e543 service cinder] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:33:45.172702 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 778/1536] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 10 05:33:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 05:33:47.445959 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4c3d53-638e-44eb-a364-bda3ee756d9b None None] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:33:47.446871 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4c3d53-638e-44eb-a364-bda3ee756d9b None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:33:47.446871 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4c3d53-638e-44eb-a364-bda3ee756d9b None None] PATH_INFO: `/` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:33:47.449601 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 759/1537] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 10 05:33:47 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 05:33:47.458709 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e37fd71-4f72-48aa-abe0-c6684f198697 None None] REQUEST_METHOD: `POST` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:33:47.459193 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e37fd71-4f72-48aa-abe0-c6684f198697 None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:33:47.459295 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e37fd71-4f72-48aa-abe0-c6684f198697 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:33:47.479025 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.auth.core [None req-6e37fd71-4f72-48aa-abe0-c6684f198697 None None] MFA Rules not processed for user `44883b22532e44049d846938dc2cf423`. Rule list: `[]` (Enabled: `True`). {{(pid=79879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:33:47.480284 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-6e37fd71-4f72-48aa-abe0-c6684f198697 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:33:47.488849 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 779/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 10 05:33:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 05:33:47.761892 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4c3d53-638e-44eb-a364-bda3ee756d9b None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:33:47.765282 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-ba4c3d53-638e-44eb-a364-bda3ee756d9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:33:47.788858 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4c3d53-638e-44eb-a364-bda3ee756d9b None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:33:47.795216 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb697b2f-d831-4771-9b67-e421103a6a33 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355be413675540a39ccb00e1a0722316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f23435f783540199d6dcfd0417c090e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:33:47.795889 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb697b2f-d831-4771-9b67-e421103a6a33 service cinder] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:33:47.796198 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb697b2f-d831-4771-9b67-e421103a6a33 service cinder] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:33:47.796472 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb697b2f-d831-4771-9b67-e421103a6a33 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:33:47.805815 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb697b2f-d831-4771-9b67-e421103a6a33 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:33:47.807247 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb697b2f-d831-4771-9b67-e421103a6a33 service cinder] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:33:47.816976 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 760/1539] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 10 05:33:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 05:35:18.356959 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85476be-a110-403d-b1cb-e7e3d821f79c None None] REQUEST_METHOD: `POST` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:35:18.357599 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85476be-a110-403d-b1cb-e7e3d821f79c None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:35:18.357599 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85476be-a110-403d-b1cb-e7e3d821f79c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:35:18.388405 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.auth.core [None req-d85476be-a110-403d-b1cb-e7e3d821f79c None None] MFA Rules not processed for user `44883b22532e44049d846938dc2cf423`. Rule list: `[]` (Enabled: `True`). {{(pid=79879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:35:18.389612 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-d85476be-a110-403d-b1cb-e7e3d821f79c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:35:18.402454 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 780/1540] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 10 05:35:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 05:35:18.414256 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d02cce2-b85f-4510-97d8-8749f6538903 None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:35:18.414860 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d02cce2-b85f-4510-97d8-8749f6538903 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:35:18.414860 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d02cce2-b85f-4510-97d8-8749f6538903 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:35:18.440163 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-9d02cce2-b85f-4510-97d8-8749f6538903 None None] MFA Rules not processed for user `44883b22532e44049d846938dc2cf423`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:35:18.441545 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-9d02cce2-b85f-4510-97d8-8749f6538903 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:35:18.456196 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 761/1541] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 10 05:35:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 05:35:18.460704 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85476be-a110-403d-b1cb-e7e3d821f79c None None] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:35:18.482611 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85476be-a110-403d-b1cb-e7e3d821f79c None None] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:35:18.493542 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7446435-ccaa-4533-9ae3-f2125b7efe64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:35:18.494248 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7446435-ccaa-4533-9ae3-f2125b7efe64 admin admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:35:18.494531 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7446435-ccaa-4533-9ae3-f2125b7efe64 admin admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:35:18.494805 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7446435-ccaa-4533-9ae3-f2125b7efe64 admin admin] PATH_INFO: `/v3/domains` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:35:18.495559 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7446435-ccaa-4533-9ae3-f2125b7efe64 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:35:18.495885 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7446435-ccaa-4533-9ae3-f2125b7efe64 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:35:18.497901 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7446435-ccaa-4533-9ae3-f2125b7efe64 admin admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:35:18.514142 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 781/1542] 10.222.0.23 () {58 vars in 1152 bytes} [Tue May 10 05:35:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:35:18.520204 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7c428e-22c9-4726-8565-3a73f7d4cca4 None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:35:18.520630 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7c428e-22c9-4726-8565-3a73f7d4cca4 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:35:18.521004 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7c428e-22c9-4726-8565-3a73f7d4cca4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:35:18.522126 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7446435-ccaa-4533-9ae3-f2125b7efe64 admin admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:35:18.541574 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7446435-ccaa-4533-9ae3-f2125b7efe64 admin admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:35:18.553867 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-6b7c428e-22c9-4726-8565-3a73f7d4cca4 None None] MFA Rules not processed for user `44883b22532e44049d846938dc2cf423`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:35:18.555273 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-6b7c428e-22c9-4726-8565-3a73f7d4cca4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:35:18.556028 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca48957-f64e-4a37-b38b-6bd1c105ae82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:35:18.557186 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca48957-f64e-4a37-b38b-6bd1c105ae82 admin admin] REQUEST_METHOD: `POST` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:35:18.557624 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca48957-f64e-4a37-b38b-6bd1c105ae82 admin admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:35:18.558013 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca48957-f64e-4a37-b38b-6bd1c105ae82 admin admin] PATH_INFO: `/v3/projects` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:35:18.558783 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca48957-f64e-4a37-b38b-6bd1c105ae82 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:35:18.559898 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: WARNING py.warnings [None req-0ca48957-f64e-4a37-b38b-6bd1c105ae82 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 10 05:35:18.559898 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: warnings.warn(msg) May 10 05:35:18.559898 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: May 10 05:35:18.561231 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca48957-f64e-4a37-b38b-6bd1c105ae82 admin admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:35:18.570404 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 762/1543] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 10 05:35:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 05:35:18.582439 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15085cf-0477-4df6-9acc-f0e2f4fea077 None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:35:18.582755 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15085cf-0477-4df6-9acc-f0e2f4fea077 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:35:18.583157 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15085cf-0477-4df6-9acc-f0e2f4fea077 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:35:18.614583 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-f15085cf-0477-4df6-9acc-f0e2f4fea077 None None] MFA Rules not processed for user `44883b22532e44049d846938dc2cf423`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:35:18.615961 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-f15085cf-0477-4df6-9acc-f0e2f4fea077 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:35:18.620659 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 782/1544] 10.222.0.23 () {60 vars in 1152 bytes} [Tue May 10 05:35:18 2022] POST /identity/v3/projects => generated 375 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 05:35:18.625327 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca48957-f64e-4a37-b38b-6bd1c105ae82 admin admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:35:18.697425 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 763/1545] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 10 05:35:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 05:35:18.702929 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15085cf-0477-4df6-9acc-f0e2f4fea077 None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:35:18.712575 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15085cf-0477-4df6-9acc-f0e2f4fea077 None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:35:18.729653 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1510f1e4-7821-420b-bfd9-e6206be1962a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:35:18.730500 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1510f1e4-7821-420b-bfd9-e6206be1962a admin admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:35:18.730789 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1510f1e4-7821-420b-bfd9-e6206be1962a admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:35:18.731218 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1510f1e4-7821-420b-bfd9-e6206be1962a admin admin] PATH_INFO: `/v3/domains` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:35:18.731996 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1510f1e4-7821-420b-bfd9-e6206be1962a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:35:18.732309 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1510f1e4-7821-420b-bfd9-e6206be1962a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:35:18.733349 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: WARNING py.warnings [None req-1510f1e4-7821-420b-bfd9-e6206be1962a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 05:35:18.733349 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: warnings.warn(msg) May 10 05:35:18.733349 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: May 10 05:35:18.734303 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1510f1e4-7821-420b-bfd9-e6206be1962a admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:35:18.753843 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca48957-f64e-4a37-b38b-6bd1c105ae82 admin admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:35:18.755886 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 764/1546] 10.222.0.23 () {58 vars in 1152 bytes} [Tue May 10 05:35:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 05:35:18.759219 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccf8c82-518b-4897-88a0-b28ecfab6d87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:35:18.760491 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1510f1e4-7821-420b-bfd9-e6206be1962a admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:35:18.764269 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccf8c82-518b-4897-88a0-b28ecfab6d87 admin admin] REQUEST_METHOD: `POST` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:35:18.764526 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccf8c82-518b-4897-88a0-b28ecfab6d87 admin admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:35:18.764775 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccf8c82-518b-4897-88a0-b28ecfab6d87 admin admin] PATH_INFO: `/v3/users` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:35:18.765527 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ccf8c82-518b-4897-88a0-b28ecfab6d87 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:35:18.767721 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ccf8c82-518b-4897-88a0-b28ecfab6d87 admin admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:35:18.775538 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1510f1e4-7821-420b-bfd9-e6206be1962a admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:35:18.789706 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5301e744-a701-44ba-8e07-c577c1e3ca67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:35:18.790408 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5301e744-a701-44ba-8e07-c577c1e3ca67 admin admin] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:35:18.790707 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5301e744-a701-44ba-8e07-c577c1e3ca67 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:35:18.790997 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5301e744-a701-44ba-8e07-c577c1e3ca67 admin admin] PATH_INFO: `/v3/projects` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:35:18.791760 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5301e744-a701-44ba-8e07-c577c1e3ca67 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:35:18.793741 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5301e744-a701-44ba-8e07-c577c1e3ca67 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:35:18.807847 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 783/1547] 10.222.0.23 () {60 vars in 1143 bytes} [Tue May 10 05:35:18 2022] POST /identity/v3/users => generated 288 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 05:35:18.811926 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccf8c82-518b-4897-88a0-b28ecfab6d87 admin admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:35:18.831753 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccf8c82-518b-4897-88a0-b28ecfab6d87 admin admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:35:18.836783 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c9df4c-eaf9-4509-a9ae-d54842d7048d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:35:18.837543 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c9df4c-eaf9-4509-a9ae-d54842d7048d admin admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:35:18.837856 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c9df4c-eaf9-4509-a9ae-d54842d7048d admin admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:35:18.838400 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c9df4c-eaf9-4509-a9ae-d54842d7048d admin admin] PATH_INFO: `/v3/roles` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:35:18.839232 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c9df4c-eaf9-4509-a9ae-d54842d7048d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:35:18.840981 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c9df4c-eaf9-4509-a9ae-d54842d7048d admin admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:35:18.849152 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 765/1548] 10.222.0.23 () {60 vars in 1152 bytes} [Tue May 10 05:35:18 2022] POST /identity/v3/projects => generated 375 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 05:35:18.850693 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b986df0-88e1-4491-8f2d-26830d0891eb None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:35:18.850987 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b986df0-88e1-4491-8f2d-26830d0891eb None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:35:18.851270 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b986df0-88e1-4491-8f2d-26830d0891eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:35:18.859638 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 784/1549] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 10 05:35:18 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 05:35:18.860375 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c9df4c-eaf9-4509-a9ae-d54842d7048d admin admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:35:18.882638 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c9df4c-eaf9-4509-a9ae-d54842d7048d admin admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:35:18.884820 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-0b986df0-88e1-4491-8f2d-26830d0891eb None None] MFA Rules not processed for user `44883b22532e44049d846938dc2cf423`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:35:18.886234 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-0b986df0-88e1-4491-8f2d-26830d0891eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:35:18.961738 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b6e70b-e903-4429-8806-e69d6616dc54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:35:18.962431 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b6e70b-e903-4429-8806-e69d6616dc54 admin admin] REQUEST_METHOD: `POST` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:35:18.962746 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b6e70b-e903-4429-8806-e69d6616dc54 admin admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:35:18.963017 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b6e70b-e903-4429-8806-e69d6616dc54 admin admin] PATH_INFO: `/v3/users` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:35:18.965812 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b6e70b-e903-4429-8806-e69d6616dc54 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:35:18.968209 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b6e70b-e903-4429-8806-e69d6616dc54 admin admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:35:18.985194 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 766/1550] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 10 05:35:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 05:35:18.989875 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539baf90-686b-4a48-b014-e6ad1c99c862 None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:35:18.989875 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539baf90-686b-4a48-b014-e6ad1c99c862 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:35:18.989875 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539baf90-686b-4a48-b014-e6ad1c99c862 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:35:19.002605 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 785/1551] 10.222.0.23 () {60 vars in 1143 bytes} [Tue May 10 05:35:18 2022] POST /identity/v3/users => generated 288 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 05:35:19.003661 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b6e70b-e903-4429-8806-e69d6616dc54 admin admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:35:19.008626 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-539baf90-686b-4a48-b014-e6ad1c99c862 None None] MFA Rules not processed for user `44883b22532e44049d846938dc2cf423`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:35:19.009831 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-539baf90-686b-4a48-b014-e6ad1c99c862 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:35:19.013763 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b6e70b-e903-4429-8806-e69d6616dc54 admin admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:35:19.018094 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 767/1552] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 10 05:35:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 05:35:19.018296 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5144a54-5230-4916-abb2-dae64f1f104f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:35:19.018944 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5144a54-5230-4916-abb2-dae64f1f104f admin admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:35:19.019222 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5144a54-5230-4916-abb2-dae64f1f104f admin admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:35:19.019410 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60924e9f-4d17-4ec7-b485-a7d80703f508 None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:35:19.019523 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5144a54-5230-4916-abb2-dae64f1f104f admin admin] PATH_INFO: `/v3/roles` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:35:19.020250 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5144a54-5230-4916-abb2-dae64f1f104f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:35:19.020368 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60924e9f-4d17-4ec7-b485-a7d80703f508 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:35:19.020607 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60924e9f-4d17-4ec7-b485-a7d80703f508 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:35:19.021864 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5144a54-5230-4916-abb2-dae64f1f104f admin admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:35:19.032903 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 786/1553] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 10 05:35:19 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 05:35:19.034249 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972bc1d6-4def-4ebe-ab1c-f379f6e382e8 None None] REQUEST_METHOD: `POST` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:35:19.034542 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972bc1d6-4def-4ebe-ab1c-f379f6e382e8 None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:35:19.034839 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972bc1d6-4def-4ebe-ab1c-f379f6e382e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:35:19.040261 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-60924e9f-4d17-4ec7-b485-a7d80703f508 None None] MFA Rules not processed for user `44883b22532e44049d846938dc2cf423`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:35:19.041442 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-60924e9f-4d17-4ec7-b485-a7d80703f508 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:35:19.049139 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 768/1554] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 10 05:35:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 05:35:19.051813 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.auth.core [None req-972bc1d6-4def-4ebe-ab1c-f379f6e382e8 None None] MFA Rules not processed for user `44883b22532e44049d846938dc2cf423`. Rule list: `[]` (Enabled: `True`). {{(pid=79879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:35:19.053066 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-972bc1d6-4def-4ebe-ab1c-f379f6e382e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:35:19.054545 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339cb6ef-4a20-4a39-8f4b-59e094ab6799 None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:35:19.055006 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339cb6ef-4a20-4a39-8f4b-59e094ab6799 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:35:19.055323 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339cb6ef-4a20-4a39-8f4b-59e094ab6799 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:35:19.061083 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 787/1555] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 10 05:35:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 05:35:19.062363 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66473302-c4a7-4e4d-8165-961582b7cfdf None None] REQUEST_METHOD: `POST` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:35:19.062654 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66473302-c4a7-4e4d-8165-961582b7cfdf None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:35:19.062937 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66473302-c4a7-4e4d-8165-961582b7cfdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:35:19.073991 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-339cb6ef-4a20-4a39-8f4b-59e094ab6799 None None] MFA Rules not processed for user `44883b22532e44049d846938dc2cf423`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:35:19.075177 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-339cb6ef-4a20-4a39-8f4b-59e094ab6799 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:35:19.080407 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.auth.core [None req-66473302-c4a7-4e4d-8165-961582b7cfdf None None] MFA Rules not processed for user `44883b22532e44049d846938dc2cf423`. Rule list: `[]` (Enabled: `True`). {{(pid=79879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:35:19.081564 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-66473302-c4a7-4e4d-8165-961582b7cfdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:35:19.083345 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 769/1556] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 10 05:35:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 05:35:19.084576 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6ef09a-effe-4b44-a3af-93405450bb9c None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:35:19.084855 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6ef09a-effe-4b44-a3af-93405450bb9c None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:35:19.085122 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6ef09a-effe-4b44-a3af-93405450bb9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:35:19.097489 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 788/1557] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 10 05:35:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 05:35:19.098606 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66473302-c4a7-4e4d-8165-961582b7cfdf None None] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:35:19.102253 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-2b6ef09a-effe-4b44-a3af-93405450bb9c None None] MFA Rules not processed for user `44883b22532e44049d846938dc2cf423`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:35:19.103425 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-2b6ef09a-effe-4b44-a3af-93405450bb9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:35:19.109242 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66473302-c4a7-4e4d-8165-961582b7cfdf None None] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:35:19.111449 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 770/1558] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 10 05:35:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 05:35:19.112682 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c368fe3d-43f0-4934-8b7b-f9d27cc94fe9 None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:35:19.112960 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c368fe3d-43f0-4934-8b7b-f9d27cc94fe9 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:35:19.113230 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c368fe3d-43f0-4934-8b7b-f9d27cc94fe9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:35:19.115092 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7f921e-73c8-4933-ae9e-bdaa1c492548 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:35:19.115802 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7f921e-73c8-4933-ae9e-bdaa1c492548 admin admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:35:19.116094 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7f921e-73c8-4933-ae9e-bdaa1c492548 admin admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:35:19.116370 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7f921e-73c8-4933-ae9e-bdaa1c492548 admin admin] PATH_INFO: `/v3/roles` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:35:19.117115 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7f921e-73c8-4933-ae9e-bdaa1c492548 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:35:19.118724 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7f921e-73c8-4933-ae9e-bdaa1c492548 admin admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:35:19.132596 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 789/1559] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 10 05:35:19 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 05:35:19.132596 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7f921e-73c8-4933-ae9e-bdaa1c492548 admin admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:35:19.133910 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-c368fe3d-43f0-4934-8b7b-f9d27cc94fe9 None None] MFA Rules not processed for user `44883b22532e44049d846938dc2cf423`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:35:19.135077 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-c368fe3d-43f0-4934-8b7b-f9d27cc94fe9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:35:19.141692 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7f921e-73c8-4933-ae9e-bdaa1c492548 admin admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:35:19.143293 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 771/1560] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 10 05:35:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 05:35:19.147161 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe1afa6-bd54-463b-a3b1-e464947f864c None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:35:19.147161 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe1afa6-bd54-463b-a3b1-e464947f864c None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:35:19.147161 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe1afa6-bd54-463b-a3b1-e464947f864c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:35:19.149987 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae200ef-4165-4fe8-b9f1-91f6a4dc3374 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:35:19.150856 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae200ef-4165-4fe8-b9f1-91f6a4dc3374 admin admin] REQUEST_METHOD: `PUT` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:35:19.151139 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae200ef-4165-4fe8-b9f1-91f6a4dc3374 admin admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:35:19.151417 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae200ef-4165-4fe8-b9f1-91f6a4dc3374 admin admin] PATH_INFO: `/v3/projects/9a950288ff0b408ea461a2206204f2e6/users/1fa3b659464a49ef863e2e398aadf22a/roles/382636e67fc142a2b2f486340d959e11` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:35:19.163108 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-bbe1afa6-bd54-463b-a3b1-e464947f864c None None] MFA Rules not processed for user `44883b22532e44049d846938dc2cf423`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:35:19.164355 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-bbe1afa6-bd54-463b-a3b1-e464947f864c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:35:19.166011 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae200ef-4165-4fe8-b9f1-91f6a4dc3374 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9a950288ff0b408ea461a2206204f2e6, user_id=1fa3b659464a49ef863e2e398aadf22a, role_id=382636e67fc142a2b2f486340d959e11)` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:35:19.167100 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: WARNING py.warnings [None req-dae200ef-4165-4fe8-b9f1-91f6a4dc3374 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 10 05:35:19.167100 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: warnings.warn(msg) May 10 05:35:19.167100 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: May 10 05:35:19.169152 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae200ef-4165-4fe8-b9f1-91f6a4dc3374 admin admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:35:19.172224 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 772/1561] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 10 05:35:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 05:35:19.173450 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd318c35-4104-45ac-8dd3-dc6c6083b175 None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:35:19.173729 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd318c35-4104-45ac-8dd3-dc6c6083b175 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:35:19.174001 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd318c35-4104-45ac-8dd3-dc6c6083b175 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:35:19.186163 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 790/1562] 10.222.0.23 () {60 vars in 1482 bytes} [Tue May 10 05:35:19 2022] PUT /identity/v3/projects/9a950288ff0b408ea461a2206204f2e6/users/1fa3b659464a49ef863e2e398aadf22a/roles/382636e67fc142a2b2f486340d959e11 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 05:35:19.187544 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba631898-3e01-4142-a12f-b7fa3022d4f1 None None] REQUEST_METHOD: `POST` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:35:19.187869 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba631898-3e01-4142-a12f-b7fa3022d4f1 None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:35:19.188171 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba631898-3e01-4142-a12f-b7fa3022d4f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:35:19.196500 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-bd318c35-4104-45ac-8dd3-dc6c6083b175 None None] MFA Rules not processed for user `44883b22532e44049d846938dc2cf423`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:35:19.197705 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-bd318c35-4104-45ac-8dd3-dc6c6083b175 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:35:19.204865 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.auth.core [None req-ba631898-3e01-4142-a12f-b7fa3022d4f1 None None] MFA Rules not processed for user `44883b22532e44049d846938dc2cf423`. Rule list: `[]` (Enabled: `True`). {{(pid=79879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:35:19.206078 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-ba631898-3e01-4142-a12f-b7fa3022d4f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:35:19.256395 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 773/1563] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 10 05:35:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 05:35:19.258099 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708acaf6-30ad-406b-b39b-2f534669577c None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:35:19.258392 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708acaf6-30ad-406b-b39b-2f534669577c None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:35:19.258669 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708acaf6-30ad-406b-b39b-2f534669577c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:35:19.264770 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 791/1564] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 10 05:35:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 05:35:19.265629 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba631898-3e01-4142-a12f-b7fa3022d4f1 None None] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:35:19.274892 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba631898-3e01-4142-a12f-b7fa3022d4f1 None None] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:35:19.276762 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-708acaf6-30ad-406b-b39b-2f534669577c None None] MFA Rules not processed for user `44883b22532e44049d846938dc2cf423`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:35:19.277970 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-708acaf6-30ad-406b-b39b-2f534669577c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:35:19.280077 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07564cb-29fa-4b65-8d8a-d1bdd350ddd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:35:19.280723 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07564cb-29fa-4b65-8d8a-d1bdd350ddd3 admin admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:35:19.280998 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07564cb-29fa-4b65-8d8a-d1bdd350ddd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:35:19.281266 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07564cb-29fa-4b65-8d8a-d1bdd350ddd3 admin admin] PATH_INFO: `/v3/domains` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:35:19.282018 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07564cb-29fa-4b65-8d8a-d1bdd350ddd3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:35:19.282289 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07564cb-29fa-4b65-8d8a-d1bdd350ddd3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:35:19.284039 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07564cb-29fa-4b65-8d8a-d1bdd350ddd3 admin admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:35:19.285883 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 774/1565] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 10 05:35:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 05:35:19.286660 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708acaf6-30ad-406b-b39b-2f534669577c None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:35:19.295928 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 792/1566] 10.222.0.23 () {58 vars in 1152 bytes} [Tue May 10 05:35:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:35:19.296093 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708acaf6-30ad-406b-b39b-2f534669577c None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:35:19.296689 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07564cb-29fa-4b65-8d8a-d1bdd350ddd3 admin admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:35:19.300501 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cad1522-0805-446c-86df-0167e4a11064 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:35:19.301269 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cad1522-0805-446c-86df-0167e4a11064 admin admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:35:19.301548 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cad1522-0805-446c-86df-0167e4a11064 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:35:19.301823 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cad1522-0805-446c-86df-0167e4a11064 admin admin] PATH_INFO: `/v3/roles` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:35:19.302559 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cad1522-0805-446c-86df-0167e4a11064 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:35:19.304207 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cad1522-0805-446c-86df-0167e4a11064 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:35:19.306624 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07564cb-29fa-4b65-8d8a-d1bdd350ddd3 admin admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:35:19.311185 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc7537a-2389-4649-8dc3-f70c6058dc71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:35:19.311866 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc7537a-2389-4649-8dc3-f70c6058dc71 admin admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:35:19.312147 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc7537a-2389-4649-8dc3-f70c6058dc71 admin admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:35:19.312419 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc7537a-2389-4649-8dc3-f70c6058dc71 admin admin] PATH_INFO: `/v3/domains` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:35:19.313130 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc7537a-2389-4649-8dc3-f70c6058dc71 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:35:19.313433 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc7537a-2389-4649-8dc3-f70c6058dc71 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:35:19.317223 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 775/1567] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 10 05:35:19 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 05:35:19.317223 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cad1522-0805-446c-86df-0167e4a11064 admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:35:19.317460 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc7537a-2389-4649-8dc3-f70c6058dc71 admin admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:35:19.323788 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cad1522-0805-446c-86df-0167e4a11064 admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:35:19.333836 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 793/1568] 10.222.0.23 () {58 vars in 1152 bytes} [Tue May 10 05:35:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:35:19.333836 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7684f393-e621-4eb2-af46-acf5cc56778f None None] REQUEST_METHOD: `POST` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:35:19.334097 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0ce1fd-fa90-4866-a05d-63d7046e332f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:35:19.334234 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7684f393-e621-4eb2-af46-acf5cc56778f None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:35:19.334234 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7684f393-e621-4eb2-af46-acf5cc56778f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:35:19.334404 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0ce1fd-fa90-4866-a05d-63d7046e332f admin admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:35:19.334404 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0ce1fd-fa90-4866-a05d-63d7046e332f admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:35:19.334404 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0ce1fd-fa90-4866-a05d-63d7046e332f admin admin] PATH_INFO: `/v3/domains` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:35:19.334404 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0ce1fd-fa90-4866-a05d-63d7046e332f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:35:19.334404 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0ce1fd-fa90-4866-a05d-63d7046e332f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:35:19.334404 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0ce1fd-fa90-4866-a05d-63d7046e332f admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:35:19.344192 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 776/1569] 10.222.0.23 () {58 vars in 1152 bytes} [Tue May 10 05:35:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:35:19.345417 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0ce1fd-fa90-4866-a05d-63d7046e332f admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:35:19.348560 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.auth.core [None req-7684f393-e621-4eb2-af46-acf5cc56778f None None] MFA Rules not processed for user `44883b22532e44049d846938dc2cf423`. Rule list: `[]` (Enabled: `True`). {{(pid=79879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:35:19.349844 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-7684f393-e621-4eb2-af46-acf5cc56778f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:35:19.354558 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0ce1fd-fa90-4866-a05d-63d7046e332f admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:35:19.358299 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 794/1570] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 10 05:35:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 05:35:19.359099 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7684f393-e621-4eb2-af46-acf5cc56778f None None] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:35:19.360302 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91429b89-2a70-4465-afb7-5774365b77e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:35:19.361041 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91429b89-2a70-4465-afb7-5774365b77e3 admin admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:35:19.361325 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91429b89-2a70-4465-afb7-5774365b77e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:35:19.361602 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91429b89-2a70-4465-afb7-5774365b77e3 admin admin] PATH_INFO: `/v3/domains` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:35:19.362670 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91429b89-2a70-4465-afb7-5774365b77e3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:35:19.362670 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91429b89-2a70-4465-afb7-5774365b77e3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:35:19.364237 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91429b89-2a70-4465-afb7-5774365b77e3 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:35:19.368866 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7684f393-e621-4eb2-af46-acf5cc56778f None None] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:35:19.374246 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f820112c-c584-4a4d-bcc1-3124680988bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:35:19.374903 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f820112c-c584-4a4d-bcc1-3124680988bd admin admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:35:19.375178 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f820112c-c584-4a4d-bcc1-3124680988bd admin admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:35:19.375449 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f820112c-c584-4a4d-bcc1-3124680988bd admin admin] PATH_INFO: `/v3/domains` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:35:19.376088 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 777/1571] 10.222.0.23 () {58 vars in 1152 bytes} [Tue May 10 05:35:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:35:19.382087 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f820112c-c584-4a4d-bcc1-3124680988bd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:35:19.382087 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f820112c-c584-4a4d-bcc1-3124680988bd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:35:19.382283 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91429b89-2a70-4465-afb7-5774365b77e3 admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:35:19.382364 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f820112c-c584-4a4d-bcc1-3124680988bd admin admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:35:19.390635 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91429b89-2a70-4465-afb7-5774365b77e3 admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:35:19.390789 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 795/1572] 10.222.0.23 () {58 vars in 1152 bytes} [Tue May 10 05:35:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:35:19.391513 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f820112c-c584-4a4d-bcc1-3124680988bd admin admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:35:19.397609 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f11a2d9-d510-40bb-a5d8-2722c9cec4e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:35:19.398687 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f11a2d9-d510-40bb-a5d8-2722c9cec4e2 admin admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:35:19.398974 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f11a2d9-d510-40bb-a5d8-2722c9cec4e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:35:19.399254 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f11a2d9-d510-40bb-a5d8-2722c9cec4e2 admin admin] PATH_INFO: `/v3/domains` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:35:19.400070 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f11a2d9-d510-40bb-a5d8-2722c9cec4e2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:35:19.400377 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f11a2d9-d510-40bb-a5d8-2722c9cec4e2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:35:19.401988 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f11a2d9-d510-40bb-a5d8-2722c9cec4e2 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:35:19.402532 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f820112c-c584-4a4d-bcc1-3124680988bd admin admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:35:19.407009 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d43a293-e3b8-4081-a927-50845db4e4aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:35:19.407707 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d43a293-e3b8-4081-a927-50845db4e4aa admin admin] REQUEST_METHOD: `POST` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:35:19.407988 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d43a293-e3b8-4081-a927-50845db4e4aa admin admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:35:19.408261 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d43a293-e3b8-4081-a927-50845db4e4aa admin admin] PATH_INFO: `/v3/projects` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:35:19.408944 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d43a293-e3b8-4081-a927-50845db4e4aa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:35:19.410821 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d43a293-e3b8-4081-a927-50845db4e4aa admin admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:35:19.413964 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 778/1573] 10.222.0.23 () {58 vars in 1152 bytes} [Tue May 10 05:35:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:35:19.415534 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f11a2d9-d510-40bb-a5d8-2722c9cec4e2 admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:35:19.429185 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f11a2d9-d510-40bb-a5d8-2722c9cec4e2 admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:35:19.433800 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c755d1e5-59ff-486f-8576-4b743b34673b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:35:19.434705 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c755d1e5-59ff-486f-8576-4b743b34673b admin admin] REQUEST_METHOD: `PUT` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:35:19.435019 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c755d1e5-59ff-486f-8576-4b743b34673b admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:35:19.435385 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c755d1e5-59ff-486f-8576-4b743b34673b admin admin] PATH_INFO: `/v3/projects/f0601882561a4a7585c340a4a86fc72e/users/942bd02110634928972b9af6e10157e8/roles/382636e67fc142a2b2f486340d959e11` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:35:19.442648 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 796/1574] 10.222.0.23 () {60 vars in 1152 bytes} [Tue May 10 05:35:19 2022] POST /identity/v3/projects => generated 381 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 05:35:19.442648 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d43a293-e3b8-4081-a927-50845db4e4aa admin admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:35:19.454063 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c755d1e5-59ff-486f-8576-4b743b34673b admin admin] RBAC: Authorizing `identity:create_grant(project_id=f0601882561a4a7585c340a4a86fc72e, user_id=942bd02110634928972b9af6e10157e8, role_id=382636e67fc142a2b2f486340d959e11)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:35:19.456876 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c755d1e5-59ff-486f-8576-4b743b34673b admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:35:19.471855 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 779/1575] 10.222.0.23 () {60 vars in 1482 bytes} [Tue May 10 05:35:19 2022] PUT /identity/v3/projects/f0601882561a4a7585c340a4a86fc72e/users/942bd02110634928972b9af6e10157e8/roles/382636e67fc142a2b2f486340d959e11 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 05:35:19.473231 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c755d1e5-59ff-486f-8576-4b743b34673b admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:35:19.512772 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d43a293-e3b8-4081-a927-50845db4e4aa admin admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:35:19.535098 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c755d1e5-59ff-486f-8576-4b743b34673b admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:35:19.539762 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abba06a-d0bf-43ed-a7e8-e138e3303aa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:35:19.540423 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abba06a-d0bf-43ed-a7e8-e138e3303aa6 admin admin] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:35:19.540703 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abba06a-d0bf-43ed-a7e8-e138e3303aa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:35:19.540940 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abba06a-d0bf-43ed-a7e8-e138e3303aa6 admin admin] PATH_INFO: `/v3/projects` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:35:19.541668 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abba06a-d0bf-43ed-a7e8-e138e3303aa6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:35:19.543614 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abba06a-d0bf-43ed-a7e8-e138e3303aa6 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:35:19.567732 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c96965-c96c-42b7-8748-1b17f3f87a0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:35:19.568414 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c96965-c96c-42b7-8748-1b17f3f87a0f admin admin] REQUEST_METHOD: `POST` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:35:19.568688 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c96965-c96c-42b7-8748-1b17f3f87a0f admin admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:35:19.568964 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c96965-c96c-42b7-8748-1b17f3f87a0f admin admin] PATH_INFO: `/v3/projects` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:35:19.569694 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c96965-c96c-42b7-8748-1b17f3f87a0f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:35:19.571325 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 780/1576] 10.222.0.23 () {60 vars in 1152 bytes} [Tue May 10 05:35:19 2022] POST /identity/v3/projects => generated 369 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 05:35:19.571722 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c96965-c96c-42b7-8748-1b17f3f87a0f admin admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:35:19.572089 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abba06a-d0bf-43ed-a7e8-e138e3303aa6 admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:35:19.597663 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 797/1577] 10.222.0.23 () {60 vars in 1152 bytes} [Tue May 10 05:35:19 2022] POST /identity/v3/projects => generated 391 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 05:35:19.598452 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c96965-c96c-42b7-8748-1b17f3f87a0f admin admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:35:19.626992 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abba06a-d0bf-43ed-a7e8-e138e3303aa6 admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:35:19.655595 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c96965-c96c-42b7-8748-1b17f3f87a0f admin admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:35:19.660238 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a9143e-a814-468c-8533-cddca755cb17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:35:19.660899 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a9143e-a814-468c-8533-cddca755cb17 admin admin] REQUEST_METHOD: `POST` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:35:19.661180 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a9143e-a814-468c-8533-cddca755cb17 admin admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:35:19.661458 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a9143e-a814-468c-8533-cddca755cb17 admin admin] PATH_INFO: `/v3/projects` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:35:19.662149 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a9143e-a814-468c-8533-cddca755cb17 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:35:19.664127 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a9143e-a814-468c-8533-cddca755cb17 admin admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:35:19.674633 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842d139d-dce2-4a75-a12d-fc4840b61604 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c8461cfdd9648b8abcaf8d34b7a102a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f23435f783540199d6dcfd0417c090e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:35:19.675286 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842d139d-dce2-4a75-a12d-fc4840b61604 service neutron] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:35:19.675587 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842d139d-dce2-4a75-a12d-fc4840b61604 service neutron] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:35:19.675862 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842d139d-dce2-4a75-a12d-fc4840b61604 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:35:19.685110 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842d139d-dce2-4a75-a12d-fc4840b61604 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:35:19.686534 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842d139d-dce2-4a75-a12d-fc4840b61604 service neutron] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:35:19.689497 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 798/1578] 10.222.0.23 () {60 vars in 1152 bytes} [Tue May 10 05:35:19 2022] POST /identity/v3/projects => generated 377 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 05:35:19.690323 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a9143e-a814-468c-8533-cddca755cb17 admin admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:35:19.696932 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 781/1579] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 10 05:35:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 05:35:19.697833 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842d139d-dce2-4a75-a12d-fc4840b61604 service neutron] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:35:19.706540 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842d139d-dce2-4a75-a12d-fc4840b61604 service neutron] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:35:19.754440 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a9143e-a814-468c-8533-cddca755cb17 admin admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:35:19.759729 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21339782-be26-4461-9173-237700b10df6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:35:19.760399 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21339782-be26-4461-9173-237700b10df6 admin admin] REQUEST_METHOD: `POST` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:35:19.760725 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21339782-be26-4461-9173-237700b10df6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:35:19.761002 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21339782-be26-4461-9173-237700b10df6 admin admin] PATH_INFO: `/v3/projects` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:35:19.761733 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21339782-be26-4461-9173-237700b10df6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:35:19.763687 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21339782-be26-4461-9173-237700b10df6 admin admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:35:19.764391 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e8436e-c5cd-4958-a800-03ac36a6b139 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:35:19.765179 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e8436e-c5cd-4958-a800-03ac36a6b139 admin admin] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:35:19.765465 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e8436e-c5cd-4958-a800-03ac36a6b139 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:35:19.765739 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e8436e-c5cd-4958-a800-03ac36a6b139 admin admin] PATH_INFO: `/v3/projects` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:35:19.766435 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e8436e-c5cd-4958-a800-03ac36a6b139 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:35:19.768519 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e8436e-c5cd-4958-a800-03ac36a6b139 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:35:19.790192 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 799/1580] 10.222.0.23 () {60 vars in 1152 bytes} [Tue May 10 05:35:19 2022] POST /identity/v3/projects => generated 371 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 05:35:19.791508 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21339782-be26-4461-9173-237700b10df6 admin admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:35:19.801471 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 782/1581] 10.222.0.23 () {60 vars in 1152 bytes} [Tue May 10 05:35:19 2022] POST /identity/v3/projects => generated 389 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 05:35:19.803280 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac35a47-2a4c-4917-8fc6-138bafdc9ddc None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:35:19.803696 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac35a47-2a4c-4917-8fc6-138bafdc9ddc None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:35:19.804037 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac35a47-2a4c-4917-8fc6-138bafdc9ddc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:35:19.833555 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-dac35a47-2a4c-4917-8fc6-138bafdc9ddc None None] MFA Rules not processed for user `942bd02110634928972b9af6e10157e8`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:35:19.834971 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-dac35a47-2a4c-4917-8fc6-138bafdc9ddc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:35:19.858927 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21339782-be26-4461-9173-237700b10df6 admin admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:35:19.910793 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 783/1582] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 10 05:35:19 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 05:35:19.910793 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac35a47-2a4c-4917-8fc6-138bafdc9ddc None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:35:19.932228 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223bd35e-dc49-4565-aad4-8172753b8700 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:35:19.932926 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223bd35e-dc49-4565-aad4-8172753b8700 admin admin] REQUEST_METHOD: `POST` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:35:19.933188 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223bd35e-dc49-4565-aad4-8172753b8700 admin admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:35:19.933726 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223bd35e-dc49-4565-aad4-8172753b8700 admin admin] PATH_INFO: `/v3/users` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:35:19.934180 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223bd35e-dc49-4565-aad4-8172753b8700 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:35:19.936833 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223bd35e-dc49-4565-aad4-8172753b8700 admin admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:35:19.958220 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 800/1583] 10.222.0.23 () {60 vars in 1143 bytes} [Tue May 10 05:35:19 2022] POST /identity/v3/users => generated 291 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 05:35:19.959459 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223bd35e-dc49-4565-aad4-8172753b8700 admin admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:35:19.970805 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223bd35e-dc49-4565-aad4-8172753b8700 admin admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:35:19.976300 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b28ed0d-b588-4c90-a41f-8304d27fb1e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:35:19.977379 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b28ed0d-b588-4c90-a41f-8304d27fb1e9 admin admin] REQUEST_METHOD: `POST` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:35:19.977506 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b28ed0d-b588-4c90-a41f-8304d27fb1e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:35:19.977689 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b28ed0d-b588-4c90-a41f-8304d27fb1e9 admin admin] PATH_INFO: `/v3/users` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:35:19.978369 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b28ed0d-b588-4c90-a41f-8304d27fb1e9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:35:19.980350 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b28ed0d-b588-4c90-a41f-8304d27fb1e9 admin admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:35:19.980474 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac35a47-2a4c-4917-8fc6-138bafdc9ddc None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:35:19.985150 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfec3ca2-9f7e-49a4-8f1d-ee946e83f39d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:35:19.985870 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfec3ca2-9f7e-49a4-8f1d-ee946e83f39d admin admin] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:35:19.986280 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfec3ca2-9f7e-49a4-8f1d-ee946e83f39d admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:35:19.986563 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfec3ca2-9f7e-49a4-8f1d-ee946e83f39d admin admin] PATH_INFO: `/v3/users` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:35:19.987262 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfec3ca2-9f7e-49a4-8f1d-ee946e83f39d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:35:19.988328 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: WARNING py.warnings [None req-dfec3ca2-9f7e-49a4-8f1d-ee946e83f39d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 10 05:35:19.988328 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: warnings.warn(msg) May 10 05:35:19.988328 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: May 10 05:35:19.989532 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfec3ca2-9f7e-49a4-8f1d-ee946e83f39d admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:35:20.003902 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 801/1584] 10.222.0.23 () {60 vars in 1143 bytes} [Tue May 10 05:35:19 2022] POST /identity/v3/users => generated 296 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 05:35:20.004721 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b28ed0d-b588-4c90-a41f-8304d27fb1e9 admin admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:35:20.014296 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b28ed0d-b588-4c90-a41f-8304d27fb1e9 admin admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:35:20.015297 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 784/1585] 10.222.0.23 () {60 vars in 1143 bytes} [Tue May 10 05:35:19 2022] POST /identity/v3/users => generated 285 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 05:35:20.016572 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfec3ca2-9f7e-49a4-8f1d-ee946e83f39d admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:35:20.022195 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70726287-3190-4256-86e2-8013101698b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:35:20.022886 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70726287-3190-4256-86e2-8013101698b9 admin admin] REQUEST_METHOD: `POST` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:35:20.023165 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70726287-3190-4256-86e2-8013101698b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:35:20.023444 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70726287-3190-4256-86e2-8013101698b9 admin admin] PATH_INFO: `/v3/users` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:35:20.024175 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70726287-3190-4256-86e2-8013101698b9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:35:20.026118 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70726287-3190-4256-86e2-8013101698b9 admin admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:35:20.031627 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfec3ca2-9f7e-49a4-8f1d-ee946e83f39d admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:35:20.041664 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f35eba-7181-4a57-95ec-8477a024f7aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:35:20.048512 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f35eba-7181-4a57-95ec-8477a024f7aa admin admin] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:35:20.049052 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f35eba-7181-4a57-95ec-8477a024f7aa admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:35:20.049529 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f35eba-7181-4a57-95ec-8477a024f7aa admin admin] PATH_INFO: `/v3/users` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:35:20.051203 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f35eba-7181-4a57-95ec-8477a024f7aa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:35:20.053412 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f35eba-7181-4a57-95ec-8477a024f7aa admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:35:20.055504 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 802/1586] 10.222.0.23 () {60 vars in 1143 bytes} [Tue May 10 05:35:20 2022] POST /identity/v3/users => generated 289 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 05:35:20.056442 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70726287-3190-4256-86e2-8013101698b9 admin admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:35:20.068476 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70726287-3190-4256-86e2-8013101698b9 admin admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:35:20.074126 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0bd1a7-1f2c-40f4-b570-cbaacd1860ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:35:20.075090 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0bd1a7-1f2c-40f4-b570-cbaacd1860ba admin admin] REQUEST_METHOD: `POST` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:35:20.075640 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0bd1a7-1f2c-40f4-b570-cbaacd1860ba admin admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:35:20.076114 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0bd1a7-1f2c-40f4-b570-cbaacd1860ba admin admin] PATH_INFO: `/v3/users` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:35:20.079454 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 785/1587] 10.222.0.23 () {60 vars in 1143 bytes} [Tue May 10 05:35:20 2022] POST /identity/v3/users => generated 286 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 05:35:20.079454 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd97bfe-8a00-435d-b241-a2f0ab6a5ffa None None] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:35:20.079454 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd97bfe-8a00-435d-b241-a2f0ab6a5ffa None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:35:20.079454 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd97bfe-8a00-435d-b241-a2f0ab6a5ffa None None] PATH_INFO: `/` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:35:20.080624 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 786/1588] 10.222.0.23 () {54 vars in 961 bytes} [Tue May 10 05:35:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 05:35:20.081148 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0bd1a7-1f2c-40f4-b570-cbaacd1860ba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:35:20.081354 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd97bfe-8a00-435d-b241-a2f0ab6a5ffa None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:35:20.083664 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0bd1a7-1f2c-40f4-b570-cbaacd1860ba admin admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:35:20.094477 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd97bfe-8a00-435d-b241-a2f0ab6a5ffa None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:35:20.100505 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c531ae0c-b853-4f11-9dd5-e7d0ff68f431 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:35:20.101213 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c531ae0c-b853-4f11-9dd5-e7d0ff68f431 admin admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:35:20.101485 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c531ae0c-b853-4f11-9dd5-e7d0ff68f431 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:35:20.101753 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c531ae0c-b853-4f11-9dd5-e7d0ff68f431 admin admin] PATH_INFO: `/v3/roles` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:35:20.102485 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c531ae0c-b853-4f11-9dd5-e7d0ff68f431 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:35:20.104196 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c531ae0c-b853-4f11-9dd5-e7d0ff68f431 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:35:20.114804 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 803/1589] 10.222.0.23 () {60 vars in 1143 bytes} [Tue May 10 05:35:20 2022] POST /identity/v3/users => generated 295 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 05:35:20.115899 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0bd1a7-1f2c-40f4-b570-cbaacd1860ba admin admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:35:20.116885 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 787/1590] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 10 05:35:20 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 05:35:20.117722 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c531ae0c-b853-4f11-9dd5-e7d0ff68f431 admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:35:20.130102 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c531ae0c-b853-4f11-9dd5-e7d0ff68f431 admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:35:20.136200 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0bd1a7-1f2c-40f4-b570-cbaacd1860ba admin admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:35:20.137493 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa12620-c151-459e-af6d-ef4f0f5262ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:35:20.138899 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa12620-c151-459e-af6d-ef4f0f5262ba admin admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:35:20.139167 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa12620-c151-459e-af6d-ef4f0f5262ba admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:35:20.139524 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa12620-c151-459e-af6d-ef4f0f5262ba admin admin] PATH_INFO: `/v3/roles` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:35:20.140406 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa12620-c151-459e-af6d-ef4f0f5262ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:35:20.142099 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a78e718-0818-4d55-8762-f5cce623a94d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:35:20.142238 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa12620-c151-459e-af6d-ef4f0f5262ba admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:35:20.142989 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a78e718-0818-4d55-8762-f5cce623a94d admin admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:35:20.143451 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a78e718-0818-4d55-8762-f5cce623a94d admin admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:35:20.143839 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a78e718-0818-4d55-8762-f5cce623a94d admin admin] PATH_INFO: `/v3/roles` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:35:20.144936 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a78e718-0818-4d55-8762-f5cce623a94d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:35:20.146455 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a78e718-0818-4d55-8762-f5cce623a94d admin admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:35:20.154251 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 788/1591] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 10 05:35:20 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 05:35:20.155400 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa12620-c151-459e-af6d-ef4f0f5262ba admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:35:20.158534 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 804/1592] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 10 05:35:20 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 05:35:20.159430 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a78e718-0818-4d55-8762-f5cce623a94d admin admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:35:20.166285 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa12620-c151-459e-af6d-ef4f0f5262ba admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:35:20.172162 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cdd712-d005-49ce-b54e-1f73ccfbf697 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:35:20.172442 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a78e718-0818-4d55-8762-f5cce623a94d admin admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:35:20.172834 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cdd712-d005-49ce-b54e-1f73ccfbf697 admin admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:35:20.173175 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cdd712-d005-49ce-b54e-1f73ccfbf697 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:35:20.173515 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cdd712-d005-49ce-b54e-1f73ccfbf697 admin admin] PATH_INFO: `/v3/roles` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:35:20.174186 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07cdd712-d005-49ce-b54e-1f73ccfbf697 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:35:20.175839 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07cdd712-d005-49ce-b54e-1f73ccfbf697 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:35:20.177711 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956d3821-0741-445f-aa3c-783136e0be72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:35:20.178429 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956d3821-0741-445f-aa3c-783136e0be72 admin admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:35:20.178709 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956d3821-0741-445f-aa3c-783136e0be72 admin admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:35:20.178984 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956d3821-0741-445f-aa3c-783136e0be72 admin admin] PATH_INFO: `/v3/roles` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:35:20.179876 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956d3821-0741-445f-aa3c-783136e0be72 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:35:20.181766 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956d3821-0741-445f-aa3c-783136e0be72 admin admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:35:20.186571 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 789/1593] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 10 05:35:20 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 05:35:20.187924 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bfe3f9-64ab-4a9e-93b1-cf0e907cf9f9 None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:35:20.188278 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bfe3f9-64ab-4a9e-93b1-cf0e907cf9f9 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:35:20.188655 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bfe3f9-64ab-4a9e-93b1-cf0e907cf9f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:35:20.196591 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 805/1594] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 10 05:35:20 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 05:35:20.197679 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956d3821-0741-445f-aa3c-783136e0be72 admin admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:35:20.207701 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956d3821-0741-445f-aa3c-783136e0be72 admin admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:35:20.210510 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-51bfe3f9-64ab-4a9e-93b1-cf0e907cf9f9 None None] MFA Rules not processed for user `7f50f224ca944983aecfde86375473da`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:35:20.211848 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-51bfe3f9-64ab-4a9e-93b1-cf0e907cf9f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:35:20.212391 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bc3bfd-042e-43c7-8c97-adccaad9deff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:35:20.213086 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bc3bfd-042e-43c7-8c97-adccaad9deff admin admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:35:20.213370 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bc3bfd-042e-43c7-8c97-adccaad9deff admin admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:35:20.213644 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bc3bfd-042e-43c7-8c97-adccaad9deff admin admin] PATH_INFO: `/v3/roles` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:35:20.214375 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1bc3bfd-042e-43c7-8c97-adccaad9deff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:35:20.216042 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1bc3bfd-042e-43c7-8c97-adccaad9deff admin admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:35:20.226461 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 806/1595] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 10 05:35:20 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 05:35:20.227275 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bc3bfd-042e-43c7-8c97-adccaad9deff admin admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:35:20.239376 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bc3bfd-042e-43c7-8c97-adccaad9deff admin admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:35:20.245045 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc1c47c-3bc8-4d9f-b401-47a9af8d087b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:35:20.245708 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc1c47c-3bc8-4d9f-b401-47a9af8d087b admin admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:35:20.245990 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc1c47c-3bc8-4d9f-b401-47a9af8d087b admin admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:35:20.246269 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc1c47c-3bc8-4d9f-b401-47a9af8d087b admin admin] PATH_INFO: `/v3/roles` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:35:20.247002 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc1c47c-3bc8-4d9f-b401-47a9af8d087b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:35:20.249024 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc1c47c-3bc8-4d9f-b401-47a9af8d087b admin admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:35:20.259385 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 807/1596] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 10 05:35:20 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 05:35:20.260083 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc1c47c-3bc8-4d9f-b401-47a9af8d087b admin admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:35:20.274508 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc1c47c-3bc8-4d9f-b401-47a9af8d087b admin admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:35:20.279671 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d752596-e087-4f6a-966e-907f4b978827 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:35:20.280333 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d752596-e087-4f6a-966e-907f4b978827 admin admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:35:20.280617 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d752596-e087-4f6a-966e-907f4b978827 admin admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:35:20.280895 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d752596-e087-4f6a-966e-907f4b978827 admin admin] PATH_INFO: `/v3/roles` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:35:20.281631 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d752596-e087-4f6a-966e-907f4b978827 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:35:20.283283 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d752596-e087-4f6a-966e-907f4b978827 admin admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:35:20.291087 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 790/1597] 10.222.0.23 () {58 vars in 1058 bytes} [Tue May 10 05:35:20 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 05:35:20.291854 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bfe3f9-64ab-4a9e-93b1-cf0e907cf9f9 None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:35:20.293629 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 808/1598] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 10 05:35:20 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 05:35:20.294464 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d752596-e087-4f6a-966e-907f4b978827 admin admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:35:20.303234 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bfe3f9-64ab-4a9e-93b1-cf0e907cf9f9 None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:35:20.304145 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d752596-e087-4f6a-966e-907f4b978827 admin admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:35:20.308424 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba9f1d8-cd3b-4023-96c8-0b107b6e1c03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:35:20.309070 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca99825f-0f6a-49bb-ba55-3c16d530ddc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:35:20.309218 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba9f1d8-cd3b-4023-96c8-0b107b6e1c03 admin admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:35:20.309509 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba9f1d8-cd3b-4023-96c8-0b107b6e1c03 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:35:20.309720 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca99825f-0f6a-49bb-ba55-3c16d530ddc4 admin admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:35:20.309832 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba9f1d8-cd3b-4023-96c8-0b107b6e1c03 admin admin] PATH_INFO: `/v3/roles` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:35:20.310005 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca99825f-0f6a-49bb-ba55-3c16d530ddc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:35:20.310263 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca99825f-0f6a-49bb-ba55-3c16d530ddc4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:35:20.310508 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba9f1d8-cd3b-4023-96c8-0b107b6e1c03 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:35:20.310993 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca99825f-0f6a-49bb-ba55-3c16d530ddc4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:35:20.312139 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba9f1d8-cd3b-4023-96c8-0b107b6e1c03 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:35:20.312604 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca99825f-0f6a-49bb-ba55-3c16d530ddc4 admin admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:35:20.325883 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 791/1599] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 10 05:35:20 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 05:35:20.326796 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba9f1d8-cd3b-4023-96c8-0b107b6e1c03 admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:35:20.331354 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 809/1600] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 10 05:35:20 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 05:35:20.332594 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca99825f-0f6a-49bb-ba55-3c16d530ddc4 admin admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:35:20.337566 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba9f1d8-cd3b-4023-96c8-0b107b6e1c03 admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:35:20.342521 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca99825f-0f6a-49bb-ba55-3c16d530ddc4 admin admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:35:20.342723 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82849f22-7203-409e-951c-bc7b1dba6e83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:35:20.343427 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82849f22-7203-409e-951c-bc7b1dba6e83 admin admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:35:20.343743 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82849f22-7203-409e-951c-bc7b1dba6e83 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:35:20.344021 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82849f22-7203-409e-951c-bc7b1dba6e83 admin admin] PATH_INFO: `/v3/roles` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:35:20.345020 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82849f22-7203-409e-951c-bc7b1dba6e83 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:35:20.346750 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82849f22-7203-409e-951c-bc7b1dba6e83 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:35:20.348629 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20876a0d-c03c-4d7c-b824-8a6a06e56c8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:35:20.349435 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20876a0d-c03c-4d7c-b824-8a6a06e56c8c admin admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:35:20.349717 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20876a0d-c03c-4d7c-b824-8a6a06e56c8c admin admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:35:20.350034 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20876a0d-c03c-4d7c-b824-8a6a06e56c8c admin admin] PATH_INFO: `/v3/roles` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:35:20.350770 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20876a0d-c03c-4d7c-b824-8a6a06e56c8c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:35:20.352846 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20876a0d-c03c-4d7c-b824-8a6a06e56c8c admin admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:35:20.360867 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 792/1601] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 10 05:35:20 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 05:35:20.360867 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82849f22-7203-409e-951c-bc7b1dba6e83 admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:35:20.364277 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 810/1602] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 10 05:35:20 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 05:35:20.365238 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20876a0d-c03c-4d7c-b824-8a6a06e56c8c admin admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:35:20.376064 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20876a0d-c03c-4d7c-b824-8a6a06e56c8c admin admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:35:20.379702 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82849f22-7203-409e-951c-bc7b1dba6e83 admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:35:20.381208 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6225435-547e-415a-a3c9-2ee81272b2db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:35:20.382205 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6225435-547e-415a-a3c9-2ee81272b2db admin admin] REQUEST_METHOD: `PUT` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:35:20.382555 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6225435-547e-415a-a3c9-2ee81272b2db admin admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:35:20.382904 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6225435-547e-415a-a3c9-2ee81272b2db admin admin] PATH_INFO: `/v3/projects/5a4aa3a0761d4d33a27ce242ed9122c0/users/8c1575be137f44adb18c8fc396e74b91/roles/382636e67fc142a2b2f486340d959e11` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:35:20.385040 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45edfadf-6ec5-4fe8-ad96-6c083b4826e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:35:20.385621 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45edfadf-6ec5-4fe8-ad96-6c083b4826e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:35:20.385898 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45edfadf-6ec5-4fe8-ad96-6c083b4826e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:35:20.386173 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45edfadf-6ec5-4fe8-ad96-6c083b4826e2 admin admin] PATH_INFO: `/v3/projects/c2c10c7658e84389ad835bc83c0b40c8/users/2479ea7b255f41ef8f154b173c616bdb/roles/382636e67fc142a2b2f486340d959e11` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:35:20.406031 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6225435-547e-415a-a3c9-2ee81272b2db admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a4aa3a0761d4d33a27ce242ed9122c0, user_id=8c1575be137f44adb18c8fc396e74b91, role_id=382636e67fc142a2b2f486340d959e11)` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:35:20.409550 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6225435-547e-415a-a3c9-2ee81272b2db admin admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:35:20.412770 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45edfadf-6ec5-4fe8-ad96-6c083b4826e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c2c10c7658e84389ad835bc83c0b40c8, user_id=2479ea7b255f41ef8f154b173c616bdb, role_id=382636e67fc142a2b2f486340d959e11)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:35:20.416882 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45edfadf-6ec5-4fe8-ad96-6c083b4826e2 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:35:20.431075 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 811/1603] 10.222.0.23 () {60 vars in 1482 bytes} [Tue May 10 05:35:20 2022] PUT /identity/v3/projects/5a4aa3a0761d4d33a27ce242ed9122c0/users/8c1575be137f44adb18c8fc396e74b91/roles/382636e67fc142a2b2f486340d959e11 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 05:35:20.431794 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6225435-547e-415a-a3c9-2ee81272b2db admin admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:35:20.443729 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 793/1604] 10.222.0.23 () {60 vars in 1482 bytes} [Tue May 10 05:35:20 2022] PUT /identity/v3/projects/c2c10c7658e84389ad835bc83c0b40c8/users/2479ea7b255f41ef8f154b173c616bdb/roles/382636e67fc142a2b2f486340d959e11 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 05:35:20.455895 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45edfadf-6ec5-4fe8-ad96-6c083b4826e2 admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:35:20.527489 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45edfadf-6ec5-4fe8-ad96-6c083b4826e2 admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:35:20.533324 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6850f7-02ab-438b-a0e6-861c9c039f16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:35:20.534292 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6850f7-02ab-438b-a0e6-861c9c039f16 admin admin] REQUEST_METHOD: `PUT` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:35:20.534576 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6850f7-02ab-438b-a0e6-861c9c039f16 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:35:20.534898 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6850f7-02ab-438b-a0e6-861c9c039f16 admin admin] PATH_INFO: `/v3/projects/5655a11bb4d94e7fb7186eb1bec105cb/users/952c90085aff498d9aca46518d272553/roles/382636e67fc142a2b2f486340d959e11` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:35:20.538351 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6225435-547e-415a-a3c9-2ee81272b2db admin admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:35:20.552377 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6850f7-02ab-438b-a0e6-861c9c039f16 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5655a11bb4d94e7fb7186eb1bec105cb, user_id=952c90085aff498d9aca46518d272553, role_id=382636e67fc142a2b2f486340d959e11)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:35:20.555426 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6850f7-02ab-438b-a0e6-861c9c039f16 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:35:20.577591 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 794/1605] 10.222.0.23 () {60 vars in 1482 bytes} [Tue May 10 05:35:20 2022] PUT /identity/v3/projects/5655a11bb4d94e7fb7186eb1bec105cb/users/952c90085aff498d9aca46518d272553/roles/382636e67fc142a2b2f486340d959e11 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 05:35:20.578509 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6850f7-02ab-438b-a0e6-861c9c039f16 admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:35:20.619352 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683e93ff-1da7-4fd0-9e6d-dcee64df1abf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f50f224ca944983aecfde86375473da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f23435f783540199d6dcfd0417c090e', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:35:20.620097 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683e93ff-1da7-4fd0-9e6d-dcee64df1abf service nova] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:35:20.620543 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683e93ff-1da7-4fd0-9e6d-dcee64df1abf service nova] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:35:20.620822 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683e93ff-1da7-4fd0-9e6d-dcee64df1abf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:35:20.646949 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6850f7-02ab-438b-a0e6-861c9c039f16 admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:35:20.652807 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9183a0ce-a39f-447b-946c-ade886ee520e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:35:20.654175 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9183a0ce-a39f-447b-946c-ade886ee520e admin admin] REQUEST_METHOD: `PUT` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:35:20.654459 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9183a0ce-a39f-447b-946c-ade886ee520e admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:35:20.654730 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9183a0ce-a39f-447b-946c-ade886ee520e admin admin] PATH_INFO: `/v3/projects/a4b426f4da354914ab7f6f98d583f557/users/194e94adb54944e39abb66f98be657c6/roles/382636e67fc142a2b2f486340d959e11` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:35:20.674444 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9183a0ce-a39f-447b-946c-ade886ee520e admin admin] RBAC: Authorizing `identity:create_grant(project_id=a4b426f4da354914ab7f6f98d583f557, user_id=194e94adb54944e39abb66f98be657c6, role_id=382636e67fc142a2b2f486340d959e11)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:35:20.677129 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9183a0ce-a39f-447b-946c-ade886ee520e admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:35:20.692821 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683e93ff-1da7-4fd0-9e6d-dcee64df1abf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:35:20.694932 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683e93ff-1da7-4fd0-9e6d-dcee64df1abf service nova] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:35:20.697254 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 795/1606] 10.222.0.23 () {60 vars in 1482 bytes} [Tue May 10 05:35:20 2022] PUT /identity/v3/projects/a4b426f4da354914ab7f6f98d583f557/users/194e94adb54944e39abb66f98be657c6/roles/382636e67fc142a2b2f486340d959e11 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 05:35:20.698157 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9183a0ce-a39f-447b-946c-ade886ee520e admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:35:20.709913 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 812/1607] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 10 05:35:20 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 279 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 05:35:20.713597 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683e93ff-1da7-4fd0-9e6d-dcee64df1abf service nova] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:35:20.727126 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683e93ff-1da7-4fd0-9e6d-dcee64df1abf service nova] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:35:20.814478 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6679a64c-c969-4b58-b2dc-36e5e978dd5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:35:20.815985 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6679a64c-c969-4b58-b2dc-36e5e978dd5a admin admin] REQUEST_METHOD: `PUT` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:35:20.816384 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6679a64c-c969-4b58-b2dc-36e5e978dd5a admin admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:35:20.816965 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6679a64c-c969-4b58-b2dc-36e5e978dd5a admin admin] PATH_INFO: `/v3/projects/946af2825477481298bcaa8f04b345d2/users/5fd529982ab24820826d466e4d13a07d/roles/382636e67fc142a2b2f486340d959e11` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:35:20.820888 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9183a0ce-a39f-447b-946c-ade886ee520e admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:35:20.827352 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd125548-b061-4eb2-9c4d-11a1bca1d211 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:35:20.828351 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd125548-b061-4eb2-9c4d-11a1bca1d211 admin admin] REQUEST_METHOD: `PUT` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:35:20.828628 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd125548-b061-4eb2-9c4d-11a1bca1d211 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:35:20.828904 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd125548-b061-4eb2-9c4d-11a1bca1d211 admin admin] PATH_INFO: `/v3/projects/dec6ff999ecd4bf1bd6ee50f996d9c06/users/ba6670133c3b4a3fbe68779c411ddb86/roles/382636e67fc142a2b2f486340d959e11` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:35:20.837341 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6679a64c-c969-4b58-b2dc-36e5e978dd5a admin admin] RBAC: Authorizing `identity:create_grant(project_id=946af2825477481298bcaa8f04b345d2, user_id=5fd529982ab24820826d466e4d13a07d, role_id=382636e67fc142a2b2f486340d959e11)` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:35:20.840434 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6679a64c-c969-4b58-b2dc-36e5e978dd5a admin admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:35:20.854186 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd125548-b061-4eb2-9c4d-11a1bca1d211 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dec6ff999ecd4bf1bd6ee50f996d9c06, user_id=ba6670133c3b4a3fbe68779c411ddb86, role_id=382636e67fc142a2b2f486340d959e11)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:35:20.857096 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd125548-b061-4eb2-9c4d-11a1bca1d211 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:35:20.861804 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 813/1608] 10.222.0.23 () {60 vars in 1482 bytes} [Tue May 10 05:35:20 2022] PUT /identity/v3/projects/946af2825477481298bcaa8f04b345d2/users/5fd529982ab24820826d466e4d13a07d/roles/382636e67fc142a2b2f486340d959e11 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 05:35:20.866292 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b82d81d-7ea0-4d0c-b6a0-5ffb19ba0fd0 None None] REQUEST_METHOD: `POST` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:35:20.866711 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b82d81d-7ea0-4d0c-b6a0-5ffb19ba0fd0 None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:35:20.867105 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b82d81d-7ea0-4d0c-b6a0-5ffb19ba0fd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:35:20.880886 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 796/1609] 10.222.0.23 () {60 vars in 1482 bytes} [Tue May 10 05:35:20 2022] PUT /identity/v3/projects/dec6ff999ecd4bf1bd6ee50f996d9c06/users/ba6670133c3b4a3fbe68779c411ddb86/roles/382636e67fc142a2b2f486340d959e11 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 05:35:20.883152 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51be383-36fc-4704-a4f6-8d04d912fa8f None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:35:20.884012 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51be383-36fc-4704-a4f6-8d04d912fa8f None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:35:20.884337 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51be383-36fc-4704-a4f6-8d04d912fa8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:35:20.925148 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.auth.core [None req-1b82d81d-7ea0-4d0c-b6a0-5ffb19ba0fd0 None None] MFA Rules not processed for user `8c1575be137f44adb18c8fc396e74b91`. Rule list: `[]` (Enabled: `True`). {{(pid=79879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:35:20.927473 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-1b82d81d-7ea0-4d0c-b6a0-5ffb19ba0fd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:35:20.947788 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-d51be383-36fc-4704-a4f6-8d04d912fa8f None None] MFA Rules not processed for user `2479ea7b255f41ef8f154b173c616bdb`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:35:20.950854 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-d51be383-36fc-4704-a4f6-8d04d912fa8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:35:21.059760 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 814/1610] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 10 05:35:20 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 05:35:21.063387 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22b16b9-cb76-4e66-8619-2c63a06b44a9 None None] REQUEST_METHOD: `POST` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:35:21.063387 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22b16b9-cb76-4e66-8619-2c63a06b44a9 None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:35:21.063961 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22b16b9-cb76-4e66-8619-2c63a06b44a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:35:21.077140 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 797/1611] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 10 05:35:20 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 05:35:21.078557 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc35aea5-3871-4ede-a13a-19b5e40ea6e1 None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:35:21.078845 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc35aea5-3871-4ede-a13a-19b5e40ea6e1 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:35:21.079148 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc35aea5-3871-4ede-a13a-19b5e40ea6e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:35:21.101380 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.auth.core [None req-e22b16b9-cb76-4e66-8619-2c63a06b44a9 None None] MFA Rules not processed for user `44883b22532e44049d846938dc2cf423`. Rule list: `[]` (Enabled: `True`). {{(pid=79879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:35:21.102377 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-e22b16b9-cb76-4e66-8619-2c63a06b44a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:35:21.107794 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-bc35aea5-3871-4ede-a13a-19b5e40ea6e1 None None] MFA Rules not processed for user `44883b22532e44049d846938dc2cf423`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:35:21.112570 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-bc35aea5-3871-4ede-a13a-19b5e40ea6e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:35:21.190309 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 798/1612] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 10 05:35:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 05:35:21.194778 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3967ef8-e40f-47e6-be3d-a31a9e3a3dd1 None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:35:21.195077 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3967ef8-e40f-47e6-be3d-a31a9e3a3dd1 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:35:21.195362 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3967ef8-e40f-47e6-be3d-a31a9e3a3dd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:35:21.210755 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 815/1613] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 10 05:35:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 05:35:21.213113 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc9a9b2-8d6f-473a-a2e6-5fa7fcb17724 None None] REQUEST_METHOD: `POST` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:35:21.214413 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-e3967ef8-e40f-47e6-be3d-a31a9e3a3dd1 None None] MFA Rules not processed for user `44883b22532e44049d846938dc2cf423`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:35:21.215684 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-e3967ef8-e40f-47e6-be3d-a31a9e3a3dd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:35:21.221736 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc9a9b2-8d6f-473a-a2e6-5fa7fcb17724 None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:35:21.222391 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc9a9b2-8d6f-473a-a2e6-5fa7fcb17724 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:35:21.226984 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 799/1614] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 10 05:35:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 05:35:21.226984 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3967ef8-e40f-47e6-be3d-a31a9e3a3dd1 None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:35:21.235310 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3967ef8-e40f-47e6-be3d-a31a9e3a3dd1 None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:35:21.240884 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3bdf66-86ba-4bc9-bd2b-21faced59391 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:35:21.241588 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3bdf66-86ba-4bc9-bd2b-21faced59391 admin admin] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:35:21.241902 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3bdf66-86ba-4bc9-bd2b-21faced59391 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:35:21.242263 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3bdf66-86ba-4bc9-bd2b-21faced59391 admin admin] PATH_INFO: `/v3/projects` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:35:21.243035 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3bdf66-86ba-4bc9-bd2b-21faced59391 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:35:21.245131 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3bdf66-86ba-4bc9-bd2b-21faced59391 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:35:21.264895 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.auth.core [None req-7dc9a9b2-8d6f-473a-a2e6-5fa7fcb17724 None None] MFA Rules not processed for user `ba6670133c3b4a3fbe68779c411ddb86`. Rule list: `[]` (Enabled: `True`). {{(pid=79879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:35:21.266587 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-7dc9a9b2-8d6f-473a-a2e6-5fa7fcb17724 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:35:21.299246 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 800/1615] 10.222.0.23 () {60 vars in 1152 bytes} [Tue May 10 05:35:21 2022] POST /identity/v3/projects => generated 367 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 05:35:21.302756 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3bdf66-86ba-4bc9-bd2b-21faced59391 admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:35:21.358503 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 816/1616] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 10 05:35:21 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 05:35:21.359543 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc9a9b2-8d6f-473a-a2e6-5fa7fcb17724 None None] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:35:21.363547 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-7dc9a9b2-8d6f-473a-a2e6-5fa7fcb17724 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:35:21.420614 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3bdf66-86ba-4bc9-bd2b-21faced59391 admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:35:21.427590 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6997df96-d3c0-4895-992c-d0d980417d41 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f50f224ca944983aecfde86375473da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f23435f783540199d6dcfd0417c090e', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:35:21.428941 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6997df96-d3c0-4895-992c-d0d980417d41 service nova] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:35:21.428941 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6997df96-d3c0-4895-992c-d0d980417d41 service nova] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:35:21.429164 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6997df96-d3c0-4895-992c-d0d980417d41 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:35:21.433988 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc9a9b2-8d6f-473a-a2e6-5fa7fcb17724 None None] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:35:21.497461 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6997df96-d3c0-4895-992c-d0d980417d41 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:35:21.499872 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d536c7-0508-41ea-96c5-e6f27a4a8002 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c8461cfdd9648b8abcaf8d34b7a102a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f23435f783540199d6dcfd0417c090e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:35:21.500553 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6997df96-d3c0-4895-992c-d0d980417d41 service nova] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:35:21.500673 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d536c7-0508-41ea-96c5-e6f27a4a8002 service neutron] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:35:21.500935 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d536c7-0508-41ea-96c5-e6f27a4a8002 service neutron] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:35:21.501314 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d536c7-0508-41ea-96c5-e6f27a4a8002 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:35:21.511275 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 801/1617] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 10 05:35:21 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 05:35:21.512376 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6997df96-d3c0-4895-992c-d0d980417d41 service nova] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:35:21.529931 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6997df96-d3c0-4895-992c-d0d980417d41 service nova] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:35:21.536913 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1217a1a-9655-4ad4-b2e8-671ba7f88e22 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c8461cfdd9648b8abcaf8d34b7a102a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f23435f783540199d6dcfd0417c090e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:35:21.537986 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1217a1a-9655-4ad4-b2e8-671ba7f88e22 service neutron] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:35:21.538343 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1217a1a-9655-4ad4-b2e8-671ba7f88e22 service neutron] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:35:21.538948 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1217a1a-9655-4ad4-b2e8-671ba7f88e22 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:35:21.606827 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d536c7-0508-41ea-96c5-e6f27a4a8002 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:35:21.626552 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d536c7-0508-41ea-96c5-e6f27a4a8002 service neutron] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:35:21.656156 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 817/1618] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 10 05:35:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 05:35:21.657244 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d536c7-0508-41ea-96c5-e6f27a4a8002 service neutron] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:35:21.659196 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1217a1a-9655-4ad4-b2e8-671ba7f88e22 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:35:21.661505 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1217a1a-9655-4ad4-b2e8-671ba7f88e22 service neutron] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:35:21.674891 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 802/1619] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 10 05:35:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 05:35:21.675773 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d536c7-0508-41ea-96c5-e6f27a4a8002 service neutron] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:35:21.676355 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1217a1a-9655-4ad4-b2e8-671ba7f88e22 service neutron] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:35:21.686294 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47db142-f702-4dd6-8c9e-c60466fd163d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c8461cfdd9648b8abcaf8d34b7a102a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f23435f783540199d6dcfd0417c090e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:35:21.687211 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47db142-f702-4dd6-8c9e-c60466fd163d service neutron] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:35:21.687728 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47db142-f702-4dd6-8c9e-c60466fd163d service neutron] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:35:21.688192 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47db142-f702-4dd6-8c9e-c60466fd163d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:35:21.688329 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1217a1a-9655-4ad4-b2e8-671ba7f88e22 service neutron] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:35:21.693816 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472eaf23-51ea-462d-ba84-22fc79873920 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:35:21.694705 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472eaf23-51ea-462d-ba84-22fc79873920 admin admin] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:35:21.694978 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472eaf23-51ea-462d-ba84-22fc79873920 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:35:21.695248 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472eaf23-51ea-462d-ba84-22fc79873920 admin admin] PATH_INFO: `/v3/users` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:35:21.696532 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472eaf23-51ea-462d-ba84-22fc79873920 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:35:21.699361 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472eaf23-51ea-462d-ba84-22fc79873920 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:35:21.712310 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47db142-f702-4dd6-8c9e-c60466fd163d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:35:21.714066 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47db142-f702-4dd6-8c9e-c60466fd163d service neutron] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:35:21.725636 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 818/1620] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 10 05:35:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 05:35:21.727057 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36885db-26bc-49bc-9182-664bcae909c7 None None] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:35:21.727440 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36885db-26bc-49bc-9182-664bcae909c7 None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:35:21.727816 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36885db-26bc-49bc-9182-664bcae909c7 None None] PATH_INFO: `/` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:35:21.729407 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 819/1621] 10.222.0.23 () {54 vars in 961 bytes} [Tue May 10 05:35:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 05:35:21.731517 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5a8ef4-9e79-4d76-acd5-2cde3c5a7d3b None None] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:35:21.734012 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5a8ef4-9e79-4d76-acd5-2cde3c5a7d3b None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:35:21.734616 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5a8ef4-9e79-4d76-acd5-2cde3c5a7d3b None None] PATH_INFO: `/` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:35:21.737150 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 820/1622] 10.222.0.23 () {54 vars in 912 bytes} [Tue May 10 05:35:21 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 05:35:21.738896 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53838334-180d-43e7-bbf4-abb81319af68 None None] REQUEST_METHOD: `POST` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:35:21.738896 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53838334-180d-43e7-bbf4-abb81319af68 None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:35:21.739094 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53838334-180d-43e7-bbf4-abb81319af68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:35:21.745356 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 803/1623] 10.222.0.23 () {60 vars in 1143 bytes} [Tue May 10 05:35:21 2022] POST /identity/v3/users => generated 290 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 05:35:21.748891 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554a62d5-73ef-4189-b717-a5c5294d5cc8 None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:35:21.750375 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554a62d5-73ef-4189-b717-a5c5294d5cc8 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:35:21.750681 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554a62d5-73ef-4189-b717-a5c5294d5cc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:35:21.766503 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.auth.core [None req-53838334-180d-43e7-bbf4-abb81319af68 None None] MFA Rules not processed for user `7f50f224ca944983aecfde86375473da`. Rule list: `[]` (Enabled: `True`). {{(pid=79879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:35:21.768231 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-53838334-180d-43e7-bbf4-abb81319af68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:35:21.781752 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 821/1624] 10.222.0.23 () {58 vars in 1058 bytes} [Tue May 10 05:35:21 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 05:35:21.782892 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53838334-180d-43e7-bbf4-abb81319af68 None None] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:35:21.796314 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-554a62d5-73ef-4189-b717-a5c5294d5cc8 None None] MFA Rules not processed for user `7f50f224ca944983aecfde86375473da`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:35:21.797462 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53838334-180d-43e7-bbf4-abb81319af68 None None] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:35:21.797603 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-554a62d5-73ef-4189-b717-a5c5294d5cc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:35:21.806021 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7638609d-144a-435d-b4ef-a828c923278e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:35:21.809615 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7638609d-144a-435d-b4ef-a828c923278e admin admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:35:21.810156 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7638609d-144a-435d-b4ef-a828c923278e admin admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:35:21.810352 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7638609d-144a-435d-b4ef-a828c923278e admin admin] PATH_INFO: `/v3/roles` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:35:21.811286 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7638609d-144a-435d-b4ef-a828c923278e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:35:21.813355 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7638609d-144a-435d-b4ef-a828c923278e admin admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:35:21.815059 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 804/1625] 10.222.0.23 () {58 vars in 1009 bytes} [Tue May 10 05:35:21 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 05:35:21.823346 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554a62d5-73ef-4189-b717-a5c5294d5cc8 None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:35:21.825594 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 822/1626] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 10 05:35:21 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 05:35:21.829914 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7638609d-144a-435d-b4ef-a828c923278e admin admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:35:21.843862 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7638609d-144a-435d-b4ef-a828c923278e admin admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:35:21.845795 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554a62d5-73ef-4189-b717-a5c5294d5cc8 None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:35:21.850742 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7aa48d9-b742-4cc9-933a-a358d28a491c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:35:21.851863 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7aa48d9-b742-4cc9-933a-a358d28a491c admin admin] REQUEST_METHOD: `PUT` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:35:21.852270 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7aa48d9-b742-4cc9-933a-a358d28a491c admin admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:35:21.852534 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3dfe0f-ef4b-4f11-94ae-abff3b031954 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f50f224ca944983aecfde86375473da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f23435f783540199d6dcfd0417c090e', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:35:21.852754 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7aa48d9-b742-4cc9-933a-a358d28a491c admin admin] PATH_INFO: `/v3/projects/64e569311d8d43d7a746a9848b96c223/users/40d668450e0f49dd8fc8a7aff6b8061d/roles/199ac1dd842441d7913c6ee89d8fbecc` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:35:21.853244 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3dfe0f-ef4b-4f11-94ae-abff3b031954 service nova] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:35:21.853602 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3dfe0f-ef4b-4f11-94ae-abff3b031954 service nova] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:35:21.854447 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3dfe0f-ef4b-4f11-94ae-abff3b031954 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:35:21.871510 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7aa48d9-b742-4cc9-933a-a358d28a491c admin admin] RBAC: Authorizing `identity:create_grant(project_id=64e569311d8d43d7a746a9848b96c223, user_id=40d668450e0f49dd8fc8a7aff6b8061d, role_id=199ac1dd842441d7913c6ee89d8fbecc)` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:35:21.876363 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7aa48d9-b742-4cc9-933a-a358d28a491c admin admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:35:21.900049 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 823/1627] 10.222.0.23 () {60 vars in 1482 bytes} [Tue May 10 05:35:21 2022] PUT /identity/v3/projects/64e569311d8d43d7a746a9848b96c223/users/40d668450e0f49dd8fc8a7aff6b8061d/roles/199ac1dd842441d7913c6ee89d8fbecc => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 05:35:21.901780 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7aa48d9-b742-4cc9-933a-a358d28a491c admin admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:35:21.968102 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3dfe0f-ef4b-4f11-94ae-abff3b031954 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:35:21.970347 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3dfe0f-ef4b-4f11-94ae-abff3b031954 service nova] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:35:21.992337 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 805/1628] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 10 05:35:21 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 05:35:21.994694 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3dfe0f-ef4b-4f11-94ae-abff3b031954 service nova] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:35:22.001497 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7aa48d9-b742-4cc9-933a-a358d28a491c admin admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:35:22.005636 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45aac9c3-7237-4f37-ad20-0d88caa50d68 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355be413675540a39ccb00e1a0722316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f23435f783540199d6dcfd0417c090e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:35:22.006417 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45aac9c3-7237-4f37-ad20-0d88caa50d68 service cinder] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:35:22.006762 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45aac9c3-7237-4f37-ad20-0d88caa50d68 service cinder] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:35:22.007035 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45aac9c3-7237-4f37-ad20-0d88caa50d68 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:35:22.023540 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3dfe0f-ef4b-4f11-94ae-abff3b031954 service nova] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:35:22.129639 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45aac9c3-7237-4f37-ad20-0d88caa50d68 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:35:22.132892 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45aac9c3-7237-4f37-ad20-0d88caa50d68 service cinder] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:35:22.137656 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144d29b3-1db7-40c1-9282-5a97fb541770 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:35:22.138761 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144d29b3-1db7-40c1-9282-5a97fb541770 admin admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:35:22.139084 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144d29b3-1db7-40c1-9282-5a97fb541770 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:35:22.139402 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144d29b3-1db7-40c1-9282-5a97fb541770 admin admin] PATH_INFO: `/v3/roles` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:35:22.140269 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144d29b3-1db7-40c1-9282-5a97fb541770 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:35:22.142459 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144d29b3-1db7-40c1-9282-5a97fb541770 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:35:22.159859 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 806/1629] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 10 05:35:21 2022] GET /identity/v3/roles => generated 1420 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 05:35:22.161817 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c867ad6-884d-40b7-bf14-b1d9575c92b1 None None] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:35:22.162221 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c867ad6-884d-40b7-bf14-b1d9575c92b1 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:35:22.162425 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c867ad6-884d-40b7-bf14-b1d9575c92b1 None None] PATH_INFO: `/` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:35:22.162967 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 824/1630] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 10 05:35:21 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 262 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 05:35:22.164433 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 807/1631] 10.222.0.23 () {54 vars in 912 bytes} [Tue May 10 05:35:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 05:35:22.171413 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45aac9c3-7237-4f37-ad20-0d88caa50d68 service cinder] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:35:22.174358 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9da98f-b765-4d9a-95f1-fe73737e227d None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:35:22.174858 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9da98f-b765-4d9a-95f1-fe73737e227d None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:35:22.175246 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9da98f-b765-4d9a-95f1-fe73737e227d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:35:22.199699 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-6b9da98f-b765-4d9a-95f1-fe73737e227d None None] MFA Rules not processed for user `7f50f224ca944983aecfde86375473da`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:35:22.199968 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45aac9c3-7237-4f37-ad20-0d88caa50d68 service cinder] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:35:22.201201 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-6b9da98f-b765-4d9a-95f1-fe73737e227d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:35:22.213049 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e0ed50-a760-4d00-ad54-4c8b397cf987 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:35:22.214943 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e0ed50-a760-4d00-ad54-4c8b397cf987 admin admin] REQUEST_METHOD: `PUT` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:35:22.215223 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e0ed50-a760-4d00-ad54-4c8b397cf987 admin admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:35:22.215498 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e0ed50-a760-4d00-ad54-4c8b397cf987 admin admin] PATH_INFO: `/v3/projects/64e569311d8d43d7a746a9848b96c223/users/40d668450e0f49dd8fc8a7aff6b8061d/roles/199ac1dd842441d7913c6ee89d8fbecc` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:35:22.223651 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e0ed50-a760-4d00-ad54-4c8b397cf987 admin admin] RBAC: Authorizing `identity:create_grant(project_id=64e569311d8d43d7a746a9848b96c223, user_id=40d668450e0f49dd8fc8a7aff6b8061d, role_id=199ac1dd842441d7913c6ee89d8fbecc)` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:35:22.226323 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e0ed50-a760-4d00-ad54-4c8b397cf987 admin admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:35:22.228139 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 808/1632] 10.222.0.23 () {58 vars in 1009 bytes} [Tue May 10 05:35:22 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 05:35:22.243524 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9da98f-b765-4d9a-95f1-fe73737e227d None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:35:22.258693 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 825/1633] 10.222.0.23 () {60 vars in 1482 bytes} [Tue May 10 05:35:22 2022] PUT /identity/v3/projects/64e569311d8d43d7a746a9848b96c223/users/40d668450e0f49dd8fc8a7aff6b8061d/roles/199ac1dd842441d7913c6ee89d8fbecc => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 05:35:22.264599 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9da98f-b765-4d9a-95f1-fe73737e227d None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:35:22.270818 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8998d4ed-a590-4cec-9ecb-7fa30dcad337 None None] REQUEST_METHOD: `POST` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:35:22.271165 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8998d4ed-a590-4cec-9ecb-7fa30dcad337 None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:35:22.272542 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8998d4ed-a590-4cec-9ecb-7fa30dcad337 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:35:22.329988 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.auth.core [None req-8998d4ed-a590-4cec-9ecb-7fa30dcad337 None None] MFA Rules not processed for user `40d668450e0f49dd8fc8a7aff6b8061d`. Rule list: `[]` (Enabled: `True`). {{(pid=79879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:35:22.331688 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-8998d4ed-a590-4cec-9ecb-7fa30dcad337 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:35:22.404444 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfcba2a-0d69-48cf-9890-e70a9996550f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355be413675540a39ccb00e1a0722316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f23435f783540199d6dcfd0417c090e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:35:22.405121 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfcba2a-0d69-48cf-9890-e70a9996550f service cinder] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:35:22.405401 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfcba2a-0d69-48cf-9890-e70a9996550f service cinder] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:35:22.405676 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfcba2a-0d69-48cf-9890-e70a9996550f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:35:22.500807 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 826/1634] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 10 05:35:22 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 05:35:22.578206 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfcba2a-0d69-48cf-9890-e70a9996550f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:35:22.579905 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfcba2a-0d69-48cf-9890-e70a9996550f service cinder] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:35:22.629494 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 809/1635] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 10 05:35:22 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 05:35:23.172343 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8998d4ed-a590-4cec-9ecb-7fa30dcad337 None None] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:35:23.183293 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8998d4ed-a590-4cec-9ecb-7fa30dcad337 None None] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:35:23.196445 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd7857c-20cf-4376-aa62-ec6c621b311f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355be413675540a39ccb00e1a0722316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f23435f783540199d6dcfd0417c090e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:35:23.197213 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd7857c-20cf-4376-aa62-ec6c621b311f service cinder] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:35:23.197584 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd7857c-20cf-4376-aa62-ec6c621b311f service cinder] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:35:23.197921 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd7857c-20cf-4376-aa62-ec6c621b311f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:35:23.218149 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd7857c-20cf-4376-aa62-ec6c621b311f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:35:23.221233 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd7857c-20cf-4376-aa62-ec6c621b311f service cinder] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:35:23.248146 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 827/1636] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 10 05:35:23 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 76 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 05:35:23.936688 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4e1ec6-afd4-4246-9626-3eab933fb384 None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:35:23.937949 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4e1ec6-afd4-4246-9626-3eab933fb384 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:35:23.938381 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4e1ec6-afd4-4246-9626-3eab933fb384 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:35:24.026080 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-ca4e1ec6-afd4-4246-9626-3eab933fb384 None None] MFA Rules not processed for user `194e94adb54944e39abb66f98be657c6`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:35:24.027328 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-ca4e1ec6-afd4-4246-9626-3eab933fb384 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:35:24.063341 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd7857c-20cf-4376-aa62-ec6c621b311f service cinder] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:35:24.209615 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 810/1637] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 10 05:35:23 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 05:35:24.212033 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b26343-ec35-422b-a40e-e7dfc1a03644 None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:35:24.212608 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b26343-ec35-422b-a40e-e7dfc1a03644 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:35:24.213193 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b26343-ec35-422b-a40e-e7dfc1a03644 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:35:24.234143 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-e5b26343-ec35-422b-a40e-e7dfc1a03644 None None] MFA Rules not processed for user `194e94adb54944e39abb66f98be657c6`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:35:24.235777 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-e5b26343-ec35-422b-a40e-e7dfc1a03644 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:35:24.256655 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 811/1638] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 10 05:35:24 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 05:35:24.265461 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd7857c-20cf-4376-aa62-ec6c621b311f service cinder] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:35:24.268012 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b26343-ec35-422b-a40e-e7dfc1a03644 None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:35:24.285226 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b26343-ec35-422b-a40e-e7dfc1a03644 None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:35:24.286725 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e33339-4564-43a1-ab01-a91b249a29e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:35:24.290793 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e33339-4564-43a1-ab01-a91b249a29e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:35:24.291747 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e33339-4564-43a1-ab01-a91b249a29e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:35:24.293184 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5433444-5b7d-4315-99f0-e09b8bbfca00 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f50f224ca944983aecfde86375473da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f23435f783540199d6dcfd0417c090e', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:35:24.293748 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e33339-4564-43a1-ab01-a91b249a29e4 admin admin] PATH_INFO: `/v3/users/942bd02110634928972b9af6e10157e8` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:35:24.294513 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5433444-5b7d-4315-99f0-e09b8bbfca00 service nova] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:35:24.295018 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5433444-5b7d-4315-99f0-e09b8bbfca00 service nova] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:35:24.295547 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5433444-5b7d-4315-99f0-e09b8bbfca00 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:35:24.295989 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e33339-4564-43a1-ab01-a91b249a29e4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=942bd02110634928972b9af6e10157e8)` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:35:24.298402 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: WARNING py.warnings [None req-37e33339-4564-43a1-ab01-a91b249a29e4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 10 05:35:24.298402 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: warnings.warn(msg) May 10 05:35:24.298402 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: May 10 05:35:24.303684 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e33339-4564-43a1-ab01-a91b249a29e4 admin admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:35:24.314466 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5433444-5b7d-4315-99f0-e09b8bbfca00 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:35:24.319406 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5433444-5b7d-4315-99f0-e09b8bbfca00 service nova] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:35:24.342316 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 812/1639] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 10 05:35:24 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 75 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 05:35:24.458775 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-37e33339-4564-43a1-ab01-a91b249a29e4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '942bd02110634928972b9af6e10157e8'} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:35:24.474987 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-37e33339-4564-43a1-ab01-a91b249a29e4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '942bd02110634928972b9af6e10157e8'} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:35:24.475527 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-37e33339-4564-43a1-ab01-a91b249a29e4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '942bd02110634928972b9af6e10157e8'} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:35:24.528932 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-37e33339-4564-43a1-ab01-a91b249a29e4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '942bd02110634928972b9af6e10157e8'} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:35:24.558828 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-37e33339-4564-43a1-ab01-a91b249a29e4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '942bd02110634928972b9af6e10157e8'} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:35:24.576281 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adecda61-b17b-4738-af03-3a1ebf548c7c None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:35:24.577130 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adecda61-b17b-4738-af03-3a1ebf548c7c None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:35:24.577609 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adecda61-b17b-4738-af03-3a1ebf548c7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:35:24.582875 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 828/1640] 10.222.0.23 () {58 vars in 1223 bytes} [Tue May 10 05:35:24 2022] DELETE /identity/v3/users/942bd02110634928972b9af6e10157e8 => generated 0 bytes in 510 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 05:35:24.625181 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-adecda61-b17b-4738-af03-3a1ebf548c7c None None] MFA Rules not processed for user `44883b22532e44049d846938dc2cf423`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:35:24.626901 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-adecda61-b17b-4738-af03-3a1ebf548c7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:35:24.763758 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 813/1641] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 10 05:35:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 05:35:24.827370 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e33339-4564-43a1-ab01-a91b249a29e4 admin admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:35:24.828877 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-37e33339-4564-43a1-ab01-a91b249a29e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:35:24.978597 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e33339-4564-43a1-ab01-a91b249a29e4 admin admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:35:24.989665 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368d3b9a-01ec-4d47-8769-f8334a713e98 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c8461cfdd9648b8abcaf8d34b7a102a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f23435f783540199d6dcfd0417c090e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:35:24.991418 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368d3b9a-01ec-4d47-8769-f8334a713e98 service neutron] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:35:24.991418 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368d3b9a-01ec-4d47-8769-f8334a713e98 service neutron] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:35:24.996329 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368d3b9a-01ec-4d47-8769-f8334a713e98 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:35:25.018383 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368d3b9a-01ec-4d47-8769-f8334a713e98 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:35:25.022638 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368d3b9a-01ec-4d47-8769-f8334a713e98 service neutron] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:35:25.052105 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 829/1642] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 10 05:35:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 05:35:25.541966 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170bf0d6-c047-4088-905b-a6067d7e5189 None None] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:35:25.542619 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170bf0d6-c047-4088-905b-a6067d7e5189 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:35:25.543089 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170bf0d6-c047-4088-905b-a6067d7e5189 None None] PATH_INFO: `/` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:35:25.545478 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 814/1643] 10.222.0.23 () {54 vars in 912 bytes} [Tue May 10 05:35:25 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 05:35:25.553538 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2a89e3-0900-4bd5-810e-d6454d511eaa None None] REQUEST_METHOD: `POST` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:35:25.554824 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2a89e3-0900-4bd5-810e-d6454d511eaa None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:35:25.555359 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2a89e3-0900-4bd5-810e-d6454d511eaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:35:25.631914 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.auth.core [None req-8d2a89e3-0900-4bd5-810e-d6454d511eaa None None] MFA Rules not processed for user `3c8461cfdd9648b8abcaf8d34b7a102a`. Rule list: `[]` (Enabled: `True`). {{(pid=79879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:35:25.633631 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-8d2a89e3-0900-4bd5-810e-d6454d511eaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:35:25.671447 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 830/1644] 10.222.0.23 () {58 vars in 1009 bytes} [Tue May 10 05:35:25 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 05:35:25.722054 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170bf0d6-c047-4088-905b-a6067d7e5189 None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:35:25.755469 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170bf0d6-c047-4088-905b-a6067d7e5189 None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:35:25.773036 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e974b4-3224-4f77-b149-29eae4d605d3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c8461cfdd9648b8abcaf8d34b7a102a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f23435f783540199d6dcfd0417c090e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:35:25.773777 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e974b4-3224-4f77-b149-29eae4d605d3 service neutron] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:35:25.774065 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e974b4-3224-4f77-b149-29eae4d605d3 service neutron] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:35:25.774341 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e974b4-3224-4f77-b149-29eae4d605d3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:35:25.796074 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e974b4-3224-4f77-b149-29eae4d605d3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:35:25.797964 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e974b4-3224-4f77-b149-29eae4d605d3 service neutron] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:35:25.829208 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 815/1645] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 10 05:35:25 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 05:35:26.399709 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2a89e3-0900-4bd5-810e-d6454d511eaa None None] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:35:26.401415 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-8d2a89e3-0900-4bd5-810e-d6454d511eaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:35:26.433790 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2a89e3-0900-4bd5-810e-d6454d511eaa None None] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:35:26.445377 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfd62a6-edac-4fc2-8eb4-1db736d5277f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:35:26.448956 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfd62a6-edac-4fc2-8eb4-1db736d5277f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:35:26.449706 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfd62a6-edac-4fc2-8eb4-1db736d5277f admin admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:35:26.450097 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfd62a6-edac-4fc2-8eb4-1db736d5277f admin admin] PATH_INFO: `/v3/users/8c1575be137f44adb18c8fc396e74b91` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:35:26.453388 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdfd62a6-edac-4fc2-8eb4-1db736d5277f admin admin] RBAC: Authorizing `identity:delete_user(user_id=8c1575be137f44adb18c8fc396e74b91)` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:35:26.456848 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdfd62a6-edac-4fc2-8eb4-1db736d5277f admin admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:35:26.582878 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-fdfd62a6-edac-4fc2-8eb4-1db736d5277f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8c1575be137f44adb18c8fc396e74b91'} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:35:26.606420 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-fdfd62a6-edac-4fc2-8eb4-1db736d5277f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8c1575be137f44adb18c8fc396e74b91'} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:35:26.607419 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-fdfd62a6-edac-4fc2-8eb4-1db736d5277f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8c1575be137f44adb18c8fc396e74b91'} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:35:26.624164 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-fdfd62a6-edac-4fc2-8eb4-1db736d5277f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8c1575be137f44adb18c8fc396e74b91'} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:35:26.642625 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-fdfd62a6-edac-4fc2-8eb4-1db736d5277f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8c1575be137f44adb18c8fc396e74b91'} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:35:26.663107 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 831/1646] 10.222.0.23 () {58 vars in 1223 bytes} [Tue May 10 05:35:26 2022] DELETE /identity/v3/users/8c1575be137f44adb18c8fc396e74b91 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 05:35:26.670464 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6507bf23-6160-48a7-b666-b5c2efd1ac2e None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:35:26.670977 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6507bf23-6160-48a7-b666-b5c2efd1ac2e None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:35:26.671243 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6507bf23-6160-48a7-b666-b5c2efd1ac2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:35:26.719367 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-6507bf23-6160-48a7-b666-b5c2efd1ac2e None None] MFA Rules not processed for user `44883b22532e44049d846938dc2cf423`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:35:26.720924 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-6507bf23-6160-48a7-b666-b5c2efd1ac2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:35:26.867534 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 816/1647] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 10 05:35:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 05:35:26.902885 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfd62a6-edac-4fc2-8eb4-1db736d5277f admin admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:35:26.904454 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-fdfd62a6-edac-4fc2-8eb4-1db736d5277f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:35:27.038770 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfd62a6-edac-4fc2-8eb4-1db736d5277f admin admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:35:27.045382 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94eb78e5-72a4-4043-bc12-da0e6e4a56c8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c8461cfdd9648b8abcaf8d34b7a102a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f23435f783540199d6dcfd0417c090e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:35:27.046843 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94eb78e5-72a4-4043-bc12-da0e6e4a56c8 service neutron] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:35:27.047270 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94eb78e5-72a4-4043-bc12-da0e6e4a56c8 service neutron] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:35:27.047720 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94eb78e5-72a4-4043-bc12-da0e6e4a56c8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:35:27.061219 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94eb78e5-72a4-4043-bc12-da0e6e4a56c8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:35:27.065487 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94eb78e5-72a4-4043-bc12-da0e6e4a56c8 service neutron] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:35:27.104580 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 832/1648] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 10 05:35:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 05:35:27.347962 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6507bf23-6160-48a7-b666-b5c2efd1ac2e None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:35:27.349564 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-6507bf23-6160-48a7-b666-b5c2efd1ac2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:35:27.371329 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6507bf23-6160-48a7-b666-b5c2efd1ac2e None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:35:27.396936 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0ab665-bad0-4bac-8fb4-ef7a435e678a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:35:27.400392 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0ab665-bad0-4bac-8fb4-ef7a435e678a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:35:27.403797 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0ab665-bad0-4bac-8fb4-ef7a435e678a admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:35:27.404237 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0ab665-bad0-4bac-8fb4-ef7a435e678a admin admin] PATH_INFO: `/v3/projects/f0601882561a4a7585c340a4a86fc72e` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:35:27.405771 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0ab665-bad0-4bac-8fb4-ef7a435e678a admin admin] RBAC: Authorizing `identity:delete_project(project_id=f0601882561a4a7585c340a4a86fc72e)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:35:27.426996 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: WARNING py.warnings [None req-de0ab665-bad0-4bac-8fb4-ef7a435e678a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 10 05:35:27.426996 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: warnings.warn(msg) May 10 05:35:27.426996 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: May 10 05:35:27.431218 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0ab665-bad0-4bac-8fb4-ef7a435e678a admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:35:27.589793 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-de0ab665-bad0-4bac-8fb4-ef7a435e678a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f0601882561a4a7585c340a4a86fc72e', 'request_id': 'req-de0ab665-bad0-4bac-8fb4-ef7a435e678a'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:35:27.641329 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-de0ab665-bad0-4bac-8fb4-ef7a435e678a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f0601882561a4a7585c340a4a86fc72e', 'request_id': 'req-de0ab665-bad0-4bac-8fb4-ef7a435e678a'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:35:27.654950 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-de0ab665-bad0-4bac-8fb4-ef7a435e678a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f0601882561a4a7585c340a4a86fc72e', 'request_id': 'req-de0ab665-bad0-4bac-8fb4-ef7a435e678a'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:35:27.700294 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-de0ab665-bad0-4bac-8fb4-ef7a435e678a admin admin] The token cache is being invalidate because project f0601882561a4a7585c340a4a86fc72e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79880) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 05:35:27.700813 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-de0ab665-bad0-4bac-8fb4-ef7a435e678a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:35:27.701325 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-de0ab665-bad0-4bac-8fb4-ef7a435e678a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:35:27.703318 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 817/1649] 10.222.0.23 () {58 vars in 1232 bytes} [Tue May 10 05:35:27 2022] DELETE /identity/v3/projects/f0601882561a4a7585c340a4a86fc72e => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 05:35:27.708625 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66583a98-5fa5-4119-8476-db75238a1384 None None] REQUEST_METHOD: `POST` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:35:27.709521 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66583a98-5fa5-4119-8476-db75238a1384 None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:35:27.709959 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66583a98-5fa5-4119-8476-db75238a1384 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:35:27.749275 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.auth.core [None req-66583a98-5fa5-4119-8476-db75238a1384 None None] MFA Rules not processed for user `44883b22532e44049d846938dc2cf423`. Rule list: `[]` (Enabled: `True`). {{(pid=79879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:35:27.757433 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-66583a98-5fa5-4119-8476-db75238a1384 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:35:27.907384 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 833/1650] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 10 05:35:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 05:35:27.909708 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ac8590-d895-4b3d-87bc-806953c1acf5 None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:35:27.910226 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ac8590-d895-4b3d-87bc-806953c1acf5 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:35:27.910575 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ac8590-d895-4b3d-87bc-806953c1acf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:35:27.949454 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e02b7f-fe87-4021-8e3b-34f4d3a91907 None None] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:35:27.949937 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e02b7f-fe87-4021-8e3b-34f4d3a91907 None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:35:27.952292 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-12ac8590-d895-4b3d-87bc-806953c1acf5 None None] MFA Rules not processed for user `44883b22532e44049d846938dc2cf423`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:35:27.954018 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-12ac8590-d895-4b3d-87bc-806953c1acf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:35:27.954946 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e02b7f-fe87-4021-8e3b-34f4d3a91907 None None] PATH_INFO: `/` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:35:27.958558 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 834/1651] 10.222.0.23 () {54 vars in 960 bytes} [Tue May 10 05:35:27 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 05:35:27.965098 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932b7f7c-5e9a-4ece-ad7a-3bb747ed45b1 None None] REQUEST_METHOD: `POST` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:35:27.965740 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932b7f7c-5e9a-4ece-ad7a-3bb747ed45b1 None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:35:27.966212 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932b7f7c-5e9a-4ece-ad7a-3bb747ed45b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:35:27.975914 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 818/1652] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 10 05:35:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 05:35:27.979834 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ac8590-d895-4b3d-87bc-806953c1acf5 None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:35:27.995896 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ac8590-d895-4b3d-87bc-806953c1acf5 None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:35:28.010085 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e08936d-ce2e-44dd-b74f-d4d55a7dcae3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:35:28.010934 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e08936d-ce2e-44dd-b74f-d4d55a7dcae3 admin admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:35:28.011043 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.auth.core [None req-932b7f7c-5e9a-4ece-ad7a-3bb747ed45b1 None None] MFA Rules not processed for user `67321ca3e5624273acd5b06264738000`. Rule list: `[]` (Enabled: `True`). {{(pid=79879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:35:28.011472 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e08936d-ce2e-44dd-b74f-d4d55a7dcae3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:35:28.011920 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e08936d-ce2e-44dd-b74f-d4d55a7dcae3 admin admin] PATH_INFO: `/v3/domains` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:35:28.012836 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e08936d-ce2e-44dd-b74f-d4d55a7dcae3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:35:28.013273 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e08936d-ce2e-44dd-b74f-d4d55a7dcae3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:35:28.013874 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-932b7f7c-5e9a-4ece-ad7a-3bb747ed45b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:35:28.015359 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e08936d-ce2e-44dd-b74f-d4d55a7dcae3 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:35:28.051262 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 819/1653] 10.222.0.23 () {58 vars in 1152 bytes} [Tue May 10 05:35:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:35:28.055508 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e08936d-ce2e-44dd-b74f-d4d55a7dcae3 admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:35:28.072271 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e08936d-ce2e-44dd-b74f-d4d55a7dcae3 admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:35:28.086239 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9c005e-1577-4587-a539-bea721abc819 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:35:28.086932 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9c005e-1577-4587-a539-bea721abc819 admin admin] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:35:28.087221 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9c005e-1577-4587-a539-bea721abc819 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:35:28.087500 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9c005e-1577-4587-a539-bea721abc819 admin admin] PATH_INFO: `/v3/projects` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:35:28.090820 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9c005e-1577-4587-a539-bea721abc819 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:35:28.090820 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9c005e-1577-4587-a539-bea721abc819 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:35:28.113163 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 835/1654] 10.222.0.23 () {58 vars in 1057 bytes} [Tue May 10 05:35:27 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 05:35:28.124099 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932b7f7c-5e9a-4ece-ad7a-3bb747ed45b1 None None] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:35:28.131603 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 820/1655] 10.222.0.23 () {60 vars in 1152 bytes} [Tue May 10 05:35:28 2022] POST /identity/v3/projects => generated 367 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 05:35:28.136502 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9c005e-1577-4587-a539-bea721abc819 admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:35:28.146759 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932b7f7c-5e9a-4ece-ad7a-3bb747ed45b1 None None] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:35:28.219064 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9c005e-1577-4587-a539-bea721abc819 admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:35:28.228243 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3563d28-869e-43de-879b-f112740c612f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:35:28.229682 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3563d28-869e-43de-879b-f112740c612f admin admin] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:35:28.230372 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3563d28-869e-43de-879b-f112740c612f admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:35:28.230792 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3563d28-869e-43de-879b-f112740c612f admin admin] PATH_INFO: `/v3/users` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:35:28.231822 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3563d28-869e-43de-879b-f112740c612f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:35:28.234300 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3563d28-869e-43de-879b-f112740c612f admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:35:28.236643 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b65118-e315-4754-8d4e-35bd2f1148cb service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67321ca3e5624273acd5b06264738000', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f23435f783540199d6dcfd0417c090e', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:35:28.237503 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b65118-e315-4754-8d4e-35bd2f1148cb service placement] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:35:28.237784 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b65118-e315-4754-8d4e-35bd2f1148cb service placement] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:35:28.238064 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b65118-e315-4754-8d4e-35bd2f1148cb service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:35:28.240525 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-47b65118-e315-4754-8d4e-35bd2f1148cb service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:35:28.269249 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 821/1656] 10.222.0.23 () {60 vars in 1143 bytes} [Tue May 10 05:35:28 2022] POST /identity/v3/users => generated 284 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 05:35:28.270482 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3563d28-869e-43de-879b-f112740c612f admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:35:28.286789 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b65118-e315-4754-8d4e-35bd2f1148cb service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:35:28.286910 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3563d28-869e-43de-879b-f112740c612f admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:35:28.288994 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b65118-e315-4754-8d4e-35bd2f1148cb service placement] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:35:28.292357 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b15ce8f-471f-4717-a0fd-4a3c6ef6f8a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:35:28.293212 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b15ce8f-471f-4717-a0fd-4a3c6ef6f8a8 admin admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:35:28.293636 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b15ce8f-471f-4717-a0fd-4a3c6ef6f8a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:35:28.294073 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b15ce8f-471f-4717-a0fd-4a3c6ef6f8a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:35:28.295109 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b15ce8f-471f-4717-a0fd-4a3c6ef6f8a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:35:28.296905 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b15ce8f-471f-4717-a0fd-4a3c6ef6f8a8 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:35:28.313339 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 822/1657] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 10 05:35:28 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 05:35:28.314780 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b15ce8f-471f-4717-a0fd-4a3c6ef6f8a8 admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:35:28.327744 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 836/1658] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 10 05:35:28 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 05:35:28.331722 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b15ce8f-471f-4717-a0fd-4a3c6ef6f8a8 admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:35:28.359530 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbaa00d-3d29-4de5-89b8-e80ebc38456f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:35:28.360841 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbaa00d-3d29-4de5-89b8-e80ebc38456f admin admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:35:28.361287 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbaa00d-3d29-4de5-89b8-e80ebc38456f admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:35:28.361757 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbaa00d-3d29-4de5-89b8-e80ebc38456f admin admin] PATH_INFO: `/v3/roles` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:35:28.363502 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbaa00d-3d29-4de5-89b8-e80ebc38456f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:35:28.367050 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbaa00d-3d29-4de5-89b8-e80ebc38456f admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:35:28.408751 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 823/1659] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 10 05:35:28 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 05:35:28.409901 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b65118-e315-4754-8d4e-35bd2f1148cb service placement] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:35:28.426705 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b65118-e315-4754-8d4e-35bd2f1148cb service placement] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:35:28.443974 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eebb76d-29e8-4170-9d3c-c3d4f9875915 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:35:28.446634 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eebb76d-29e8-4170-9d3c-c3d4f9875915 admin admin] REQUEST_METHOD: `PUT` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:35:28.451421 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eebb76d-29e8-4170-9d3c-c3d4f9875915 admin admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:35:28.451421 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eebb76d-29e8-4170-9d3c-c3d4f9875915 admin admin] PATH_INFO: `/v3/projects/98a7307423ff415b82a03968b17cb6c9/users/840b4b80d94f44e3a9a1c33b7c29bd57/roles/382636e67fc142a2b2f486340d959e11` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:35:28.496623 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eebb76d-29e8-4170-9d3c-c3d4f9875915 admin admin] RBAC: Authorizing `identity:create_grant(project_id=98a7307423ff415b82a03968b17cb6c9, user_id=840b4b80d94f44e3a9a1c33b7c29bd57, role_id=382636e67fc142a2b2f486340d959e11)` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:35:28.500184 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eebb76d-29e8-4170-9d3c-c3d4f9875915 admin admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:35:28.551694 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 837/1660] 10.222.0.23 () {60 vars in 1482 bytes} [Tue May 10 05:35:28 2022] PUT /identity/v3/projects/98a7307423ff415b82a03968b17cb6c9/users/840b4b80d94f44e3a9a1c33b7c29bd57/roles/382636e67fc142a2b2f486340d959e11 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 05:35:28.553768 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953f6382-7a2b-4894-bb23-ae5425688cee None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:35:28.554960 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953f6382-7a2b-4894-bb23-ae5425688cee None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:35:28.555314 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953f6382-7a2b-4894-bb23-ae5425688cee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:35:28.606573 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-953f6382-7a2b-4894-bb23-ae5425688cee None None] MFA Rules not processed for user `840b4b80d94f44e3a9a1c33b7c29bd57`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:35:28.608029 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-953f6382-7a2b-4894-bb23-ae5425688cee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:35:28.760344 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eebb76d-29e8-4170-9d3c-c3d4f9875915 admin admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:35:28.762179 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-6eebb76d-29e8-4170-9d3c-c3d4f9875915 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:35:28.776055 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 824/1661] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 10 05:35:28 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 05:35:28.799921 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953f6382-7a2b-4894-bb23-ae5425688cee None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:35:28.947979 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eebb76d-29e8-4170-9d3c-c3d4f9875915 admin admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:35:28.960543 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c595830e-99aa-47e4-9fe3-7c97188ab492 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:35:28.961898 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c595830e-99aa-47e4-9fe3-7c97188ab492 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:35:28.962321 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c595830e-99aa-47e4-9fe3-7c97188ab492 admin admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:35:28.962766 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c595830e-99aa-47e4-9fe3-7c97188ab492 admin admin] PATH_INFO: `/v3/projects/5a4aa3a0761d4d33a27ce242ed9122c0` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:35:28.964271 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c595830e-99aa-47e4-9fe3-7c97188ab492 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5a4aa3a0761d4d33a27ce242ed9122c0)` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:35:28.966507 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c595830e-99aa-47e4-9fe3-7c97188ab492 admin admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:35:28.989625 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953f6382-7a2b-4894-bb23-ae5425688cee None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:35:28.999051 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d4559a-41e2-4bc6-97b8-91f14006301a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:35:29.000505 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d4559a-41e2-4bc6-97b8-91f14006301a admin admin] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:35:29.000676 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d4559a-41e2-4bc6-97b8-91f14006301a admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:35:29.000852 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d4559a-41e2-4bc6-97b8-91f14006301a admin admin] PATH_INFO: `/v3/projects` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:35:29.002067 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d4559a-41e2-4bc6-97b8-91f14006301a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:35:29.012779 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d4559a-41e2-4bc6-97b8-91f14006301a admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:35:29.029845 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-c595830e-99aa-47e4-9fe3-7c97188ab492 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5a4aa3a0761d4d33a27ce242ed9122c0', 'request_id': 'req-c595830e-99aa-47e4-9fe3-7c97188ab492'} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:35:29.041523 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-c595830e-99aa-47e4-9fe3-7c97188ab492 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5a4aa3a0761d4d33a27ce242ed9122c0', 'request_id': 'req-c595830e-99aa-47e4-9fe3-7c97188ab492'} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:35:29.054258 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-c595830e-99aa-47e4-9fe3-7c97188ab492 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5a4aa3a0761d4d33a27ce242ed9122c0', 'request_id': 'req-c595830e-99aa-47e4-9fe3-7c97188ab492'} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:35:29.083089 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-c595830e-99aa-47e4-9fe3-7c97188ab492 admin admin] The token cache is being invalidate because project 5a4aa3a0761d4d33a27ce242ed9122c0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79879) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 05:35:29.083824 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-c595830e-99aa-47e4-9fe3-7c97188ab492 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:35:29.085978 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-c595830e-99aa-47e4-9fe3-7c97188ab492 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:35:29.088212 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 825/1662] 10.222.0.23 () {60 vars in 1152 bytes} [Tue May 10 05:35:28 2022] POST /identity/v3/projects => generated 367 bytes in 308 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 05:35:29.092230 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d4559a-41e2-4bc6-97b8-91f14006301a admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:35:29.095349 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 838/1663] 10.222.0.23 () {58 vars in 1232 bytes} [Tue May 10 05:35:28 2022] DELETE /identity/v3/projects/5a4aa3a0761d4d33a27ce242ed9122c0 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 05:35:29.096558 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c595830e-99aa-47e4-9fe3-7c97188ab492 admin admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:35:29.098926 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-c595830e-99aa-47e4-9fe3-7c97188ab492 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:35:29.099208 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-48d4559a-41e2-4bc6-97b8-91f14006301a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:35:29.316438 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c595830e-99aa-47e4-9fe3-7c97188ab492 admin admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:35:29.334104 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d4559a-41e2-4bc6-97b8-91f14006301a admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:35:29.335388 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a79271e-b736-42f7-9f2c-5167563d9c0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:35:29.336402 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a79271e-b736-42f7-9f2c-5167563d9c0d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:35:29.336685 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a79271e-b736-42f7-9f2c-5167563d9c0d admin admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:35:29.336960 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a79271e-b736-42f7-9f2c-5167563d9c0d admin admin] PATH_INFO: `/v3/users/40d668450e0f49dd8fc8a7aff6b8061d` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:35:29.340076 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a79271e-b736-42f7-9f2c-5167563d9c0d admin admin] RBAC: Authorizing `identity:delete_user(user_id=40d668450e0f49dd8fc8a7aff6b8061d)` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:35:29.342660 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a79271e-b736-42f7-9f2c-5167563d9c0d admin admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:35:29.349438 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fbe602-4ae6-46ff-927c-8233ea624ec7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:35:29.352650 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fbe602-4ae6-46ff-927c-8233ea624ec7 admin admin] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:35:29.354687 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fbe602-4ae6-46ff-927c-8233ea624ec7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:35:29.355474 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fbe602-4ae6-46ff-927c-8233ea624ec7 admin admin] PATH_INFO: `/v3/users` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:35:29.358186 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43fbe602-4ae6-46ff-927c-8233ea624ec7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:35:29.367183 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43fbe602-4ae6-46ff-927c-8233ea624ec7 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:35:29.438404 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 826/1664] 10.222.0.23 () {60 vars in 1143 bytes} [Tue May 10 05:35:29 2022] POST /identity/v3/users => generated 290 bytes in 347 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 05:35:29.442255 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fbe602-4ae6-46ff-927c-8233ea624ec7 admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:35:29.449372 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-43fbe602-4ae6-46ff-927c-8233ea624ec7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:35:29.464880 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-2a79271e-b736-42f7-9f2c-5167563d9c0d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '40d668450e0f49dd8fc8a7aff6b8061d'} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:35:29.489230 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-2a79271e-b736-42f7-9f2c-5167563d9c0d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '40d668450e0f49dd8fc8a7aff6b8061d'} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:35:29.490834 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-2a79271e-b736-42f7-9f2c-5167563d9c0d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '40d668450e0f49dd8fc8a7aff6b8061d'} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:35:29.511204 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fbe602-4ae6-46ff-927c-8233ea624ec7 admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:35:29.515195 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-2a79271e-b736-42f7-9f2c-5167563d9c0d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '40d668450e0f49dd8fc8a7aff6b8061d'} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:35:29.526293 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-2a79271e-b736-42f7-9f2c-5167563d9c0d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '40d668450e0f49dd8fc8a7aff6b8061d'} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:35:29.541914 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 839/1665] 10.222.0.23 () {58 vars in 1223 bytes} [Tue May 10 05:35:29 2022] DELETE /identity/v3/users/40d668450e0f49dd8fc8a7aff6b8061d => generated 0 bytes in 441 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 05:35:29.542917 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37dd567a-c92e-4e00-a1fb-93ebd48d45b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:35:29.543301 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dd567a-c92e-4e00-a1fb-93ebd48d45b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:35:29.543684 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dd567a-c92e-4e00-a1fb-93ebd48d45b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:35:29.543908 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dd567a-c92e-4e00-a1fb-93ebd48d45b9 admin admin] PATH_INFO: `/v3/users/ba6670133c3b4a3fbe68779c411ddb86` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:35:29.546837 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a79271e-b736-42f7-9f2c-5167563d9c0d admin admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:35:29.547055 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37dd567a-c92e-4e00-a1fb-93ebd48d45b9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ba6670133c3b4a3fbe68779c411ddb86)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:35:29.548707 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-2a79271e-b736-42f7-9f2c-5167563d9c0d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:35:29.549252 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37dd567a-c92e-4e00-a1fb-93ebd48d45b9 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:35:29.651794 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a79271e-b736-42f7-9f2c-5167563d9c0d admin admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:35:29.658707 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2dd6f3b-beab-44e8-bcf0-d5b0fc8577bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:35:29.659506 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dd6f3b-beab-44e8-bcf0-d5b0fc8577bb admin admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:35:29.662488 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dd6f3b-beab-44e8-bcf0-d5b0fc8577bb admin admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:35:29.662893 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dd6f3b-beab-44e8-bcf0-d5b0fc8577bb admin admin] PATH_INFO: `/v3/roles` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:35:29.664523 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2dd6f3b-beab-44e8-bcf0-d5b0fc8577bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:35:29.665556 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-37dd567a-c92e-4e00-a1fb-93ebd48d45b9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ba6670133c3b4a3fbe68779c411ddb86'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:35:29.667097 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2dd6f3b-beab-44e8-bcf0-d5b0fc8577bb admin admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:35:29.681680 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 840/1666] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 10 05:35:29 2022] GET /identity/v3/roles => generated 1420 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 05:35:29.683223 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a63257-6736-4dab-af2c-f52eb9745301 None None] REQUEST_METHOD: `POST` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:35:29.683660 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a63257-6736-4dab-af2c-f52eb9745301 None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:35:29.683967 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a63257-6736-4dab-af2c-f52eb9745301 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:35:29.698784 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-37dd567a-c92e-4e00-a1fb-93ebd48d45b9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ba6670133c3b4a3fbe68779c411ddb86'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:35:29.699957 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-37dd567a-c92e-4e00-a1fb-93ebd48d45b9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ba6670133c3b4a3fbe68779c411ddb86'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:35:29.722196 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-37dd567a-c92e-4e00-a1fb-93ebd48d45b9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ba6670133c3b4a3fbe68779c411ddb86'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:35:29.723264 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-37dd567a-c92e-4e00-a1fb-93ebd48d45b9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ba6670133c3b4a3fbe68779c411ddb86'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:35:29.747969 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 827/1667] 10.222.0.23 () {58 vars in 1223 bytes} [Tue May 10 05:35:29 2022] DELETE /identity/v3/users/ba6670133c3b4a3fbe68779c411ddb86 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 05:35:29.749398 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37dd567a-c92e-4e00-a1fb-93ebd48d45b9 admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:35:29.751405 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-37dd567a-c92e-4e00-a1fb-93ebd48d45b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:35:29.765218 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.auth.core [None req-86a63257-6736-4dab-af2c-f52eb9745301 None None] MFA Rules not processed for user `1fa3b659464a49ef863e2e398aadf22a`. Rule list: `[]` (Enabled: `True`). {{(pid=79879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:35:29.766443 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-86a63257-6736-4dab-af2c-f52eb9745301 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:35:29.873346 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37dd567a-c92e-4e00-a1fb-93ebd48d45b9 admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:35:29.880820 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47155d39-9d44-4559-946d-70eb7c018256 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:35:29.882167 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47155d39-9d44-4559-946d-70eb7c018256 admin admin] REQUEST_METHOD: `PUT` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:35:29.882519 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47155d39-9d44-4559-946d-70eb7c018256 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:35:29.882804 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47155d39-9d44-4559-946d-70eb7c018256 admin admin] PATH_INFO: `/v3/projects/0143eaf3ed9c4e079a010035ab06ede9/users/b97cdc7b19c049c8b1fe23ef986c16d3/roles/199ac1dd842441d7913c6ee89d8fbecc` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:35:29.910312 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47155d39-9d44-4559-946d-70eb7c018256 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0143eaf3ed9c4e079a010035ab06ede9, user_id=b97cdc7b19c049c8b1fe23ef986c16d3, role_id=199ac1dd842441d7913c6ee89d8fbecc)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:35:29.916181 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47155d39-9d44-4559-946d-70eb7c018256 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:35:29.945876 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 841/1668] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 10 05:35:29 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 05:35:29.947353 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04fc324-edb7-46a3-96d0-1fc59d6c951a None None] REQUEST_METHOD: `POST` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:35:29.947686 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04fc324-edb7-46a3-96d0-1fc59d6c951a None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:35:29.947969 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04fc324-edb7-46a3-96d0-1fc59d6c951a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:35:29.972346 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 828/1669] 10.222.0.23 () {60 vars in 1482 bytes} [Tue May 10 05:35:29 2022] PUT /identity/v3/projects/0143eaf3ed9c4e079a010035ab06ede9/users/b97cdc7b19c049c8b1fe23ef986c16d3/roles/199ac1dd842441d7913c6ee89d8fbecc => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 05:35:29.974052 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47155d39-9d44-4559-946d-70eb7c018256 admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:35:29.978306 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-47155d39-9d44-4559-946d-70eb7c018256 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:35:29.991632 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.auth.core [None req-c04fc324-edb7-46a3-96d0-1fc59d6c951a None None] MFA Rules not processed for user `44883b22532e44049d846938dc2cf423`. Rule list: `[]` (Enabled: `True`). {{(pid=79879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:35:29.993514 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-c04fc324-edb7-46a3-96d0-1fc59d6c951a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:35:30.093735 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 842/1670] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 10 05:35:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 05:35:30.094830 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04fc324-edb7-46a3-96d0-1fc59d6c951a None None] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:35:30.119916 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04fc324-edb7-46a3-96d0-1fc59d6c951a None None] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:35:30.120321 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47155d39-9d44-4559-946d-70eb7c018256 admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:35:30.126740 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba962dd-6384-49a6-b903-ca9db17195f9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f50f224ca944983aecfde86375473da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f23435f783540199d6dcfd0417c090e', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:35:30.128152 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba962dd-6384-49a6-b903-ca9db17195f9 service nova] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:35:30.128628 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba962dd-6384-49a6-b903-ca9db17195f9 service nova] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:35:30.128971 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba962dd-6384-49a6-b903-ca9db17195f9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:35:30.130248 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb9d80d-67b4-4d8c-beae-0fa59ea030e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:35:30.131084 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb9d80d-67b4-4d8c-beae-0fa59ea030e1 admin admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:35:30.131505 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb9d80d-67b4-4d8c-beae-0fa59ea030e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:35:30.131958 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb9d80d-67b4-4d8c-beae-0fa59ea030e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:35:30.132853 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb9d80d-67b4-4d8c-beae-0fa59ea030e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:35:30.134622 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb9d80d-67b4-4d8c-beae-0fa59ea030e1 admin admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:35:30.156632 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 843/1671] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 10 05:35:30 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 05:35:30.161358 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb9d80d-67b4-4d8c-beae-0fa59ea030e1 admin admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:35:30.182966 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb9d80d-67b4-4d8c-beae-0fa59ea030e1 admin admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:35:30.193680 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003255c5-ad79-4a7f-8b16-7354830e3da9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:35:30.194808 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003255c5-ad79-4a7f-8b16-7354830e3da9 admin admin] REQUEST_METHOD: `PUT` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:35:30.195217 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003255c5-ad79-4a7f-8b16-7354830e3da9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:35:30.195653 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003255c5-ad79-4a7f-8b16-7354830e3da9 admin admin] PATH_INFO: `/v3/projects/0143eaf3ed9c4e079a010035ab06ede9/users/b97cdc7b19c049c8b1fe23ef986c16d3/roles/199ac1dd842441d7913c6ee89d8fbecc` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:35:30.202484 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003255c5-ad79-4a7f-8b16-7354830e3da9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0143eaf3ed9c4e079a010035ab06ede9, user_id=b97cdc7b19c049c8b1fe23ef986c16d3, role_id=199ac1dd842441d7913c6ee89d8fbecc)` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:35:30.205501 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003255c5-ad79-4a7f-8b16-7354830e3da9 admin admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:35:30.222529 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba962dd-6384-49a6-b903-ca9db17195f9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:35:30.226165 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba962dd-6384-49a6-b903-ca9db17195f9 service nova] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:35:30.229585 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 844/1672] 10.222.0.23 () {60 vars in 1482 bytes} [Tue May 10 05:35:30 2022] PUT /identity/v3/projects/0143eaf3ed9c4e079a010035ab06ede9/users/b97cdc7b19c049c8b1fe23ef986c16d3/roles/199ac1dd842441d7913c6ee89d8fbecc => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 05:35:30.230603 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003255c5-ad79-4a7f-8b16-7354830e3da9 admin admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:35:30.236627 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-003255c5-ad79-4a7f-8b16-7354830e3da9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:35:30.252794 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 829/1673] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 10 05:35:29 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 279 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 05:35:30.256835 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4522bc3f-3a33-48d1-a0be-bf027b061e68 None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:35:30.257298 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4522bc3f-3a33-48d1-a0be-bf027b061e68 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:35:30.259666 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4522bc3f-3a33-48d1-a0be-bf027b061e68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:35:30.384079 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003255c5-ad79-4a7f-8b16-7354830e3da9 admin admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:35:30.384866 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-4522bc3f-3a33-48d1-a0be-bf027b061e68 None None] MFA Rules not processed for user `b97cdc7b19c049c8b1fe23ef986c16d3`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:35:30.386211 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-4522bc3f-3a33-48d1-a0be-bf027b061e68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:35:30.397239 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877bcb58-49ea-40db-87e7-52ca8249a509 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c8461cfdd9648b8abcaf8d34b7a102a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f23435f783540199d6dcfd0417c090e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:35:30.397915 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877bcb58-49ea-40db-87e7-52ca8249a509 service neutron] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:35:30.398193 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877bcb58-49ea-40db-87e7-52ca8249a509 service neutron] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:35:30.398464 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877bcb58-49ea-40db-87e7-52ca8249a509 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:35:30.540489 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877bcb58-49ea-40db-87e7-52ca8249a509 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:35:30.546645 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877bcb58-49ea-40db-87e7-52ca8249a509 service neutron] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:35:30.573276 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 845/1674] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 10 05:35:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 05:35:30.669182 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 830/1675] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 10 05:35:30 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 416 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 05:35:30.684007 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877bcb58-49ea-40db-87e7-52ca8249a509 service neutron] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:35:30.685372 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-877bcb58-49ea-40db-87e7-52ca8249a509 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:35:30.847806 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877bcb58-49ea-40db-87e7-52ca8249a509 service neutron] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:35:30.858253 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446a767e-add9-4cc3-a941-390eda7f28f7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355be413675540a39ccb00e1a0722316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f23435f783540199d6dcfd0417c090e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:35:30.858944 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446a767e-add9-4cc3-a941-390eda7f28f7 service cinder] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:35:30.859227 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446a767e-add9-4cc3-a941-390eda7f28f7 service cinder] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:35:30.862877 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446a767e-add9-4cc3-a941-390eda7f28f7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:35:30.892967 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446a767e-add9-4cc3-a941-390eda7f28f7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:35:30.896299 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446a767e-add9-4cc3-a941-390eda7f28f7 service cinder] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:35:30.918749 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 846/1676] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 10 05:35:30 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 05:35:30.972657 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4522bc3f-3a33-48d1-a0be-bf027b061e68 None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:35:30.974181 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-4522bc3f-3a33-48d1-a0be-bf027b061e68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:35:30.991421 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4522bc3f-3a33-48d1-a0be-bf027b061e68 None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:35:31.005977 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0039f027-a263-4bcf-9d9f-16bae173b021 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355be413675540a39ccb00e1a0722316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f23435f783540199d6dcfd0417c090e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:35:31.006712 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0039f027-a263-4bcf-9d9f-16bae173b021 service cinder] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:35:31.006999 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0039f027-a263-4bcf-9d9f-16bae173b021 service cinder] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:35:31.007287 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0039f027-a263-4bcf-9d9f-16bae173b021 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:35:31.010965 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-0039f027-a263-4bcf-9d9f-16bae173b021 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:35:31.159999 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0039f027-a263-4bcf-9d9f-16bae173b021 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:35:31.161899 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0039f027-a263-4bcf-9d9f-16bae173b021 service cinder] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:35:31.177636 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 831/1677] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 10 05:35:30 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 05:35:31.577711 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446a767e-add9-4cc3-a941-390eda7f28f7 service cinder] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:35:31.579386 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-446a767e-add9-4cc3-a941-390eda7f28f7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:35:31.613149 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446a767e-add9-4cc3-a941-390eda7f28f7 service cinder] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:35:31.634581 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0681ae26-49fb-46a3-ba57-a6a5549309b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:35:31.636491 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0681ae26-49fb-46a3-ba57-a6a5549309b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:35:31.637058 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0681ae26-49fb-46a3-ba57-a6a5549309b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:35:31.638185 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0681ae26-49fb-46a3-ba57-a6a5549309b6 admin admin] PATH_INFO: `/v3/projects/64e569311d8d43d7a746a9848b96c223` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:35:31.646947 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0681ae26-49fb-46a3-ba57-a6a5549309b6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=64e569311d8d43d7a746a9848b96c223)` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:35:31.651352 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0681ae26-49fb-46a3-ba57-a6a5549309b6 admin admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:35:31.730423 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79847cb-61e5-4ccb-84bc-a6b84250e2f1 None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:35:31.731019 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79847cb-61e5-4ccb-84bc-a6b84250e2f1 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:35:31.731489 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79847cb-61e5-4ccb-84bc-a6b84250e2f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:35:31.803612 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-e79847cb-61e5-4ccb-84bc-a6b84250e2f1 None None] MFA Rules not processed for user `c5281b2a1c9a461995653be826207db4`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:35:31.811001 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-e79847cb-61e5-4ccb-84bc-a6b84250e2f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:35:31.875711 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-0681ae26-49fb-46a3-ba57-a6a5549309b6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '64e569311d8d43d7a746a9848b96c223', 'request_id': 'req-0681ae26-49fb-46a3-ba57-a6a5549309b6'} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:35:31.893471 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-0681ae26-49fb-46a3-ba57-a6a5549309b6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '64e569311d8d43d7a746a9848b96c223', 'request_id': 'req-0681ae26-49fb-46a3-ba57-a6a5549309b6'} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:35:31.919642 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-0681ae26-49fb-46a3-ba57-a6a5549309b6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '64e569311d8d43d7a746a9848b96c223', 'request_id': 'req-0681ae26-49fb-46a3-ba57-a6a5549309b6'} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:35:31.965090 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-0681ae26-49fb-46a3-ba57-a6a5549309b6 admin admin] The token cache is being invalidate because project 64e569311d8d43d7a746a9848b96c223 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79879) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 05:35:31.965927 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-0681ae26-49fb-46a3-ba57-a6a5549309b6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:35:31.969098 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-0681ae26-49fb-46a3-ba57-a6a5549309b6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:35:31.976397 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 847/1678] 10.222.0.23 () {58 vars in 1232 bytes} [Tue May 10 05:35:31 2022] DELETE /identity/v3/projects/64e569311d8d43d7a746a9848b96c223 => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 05:35:31.980684 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3cc491-364d-48ec-8293-7531962145cb None None] REQUEST_METHOD: `POST` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:35:31.983774 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3cc491-364d-48ec-8293-7531962145cb None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:35:31.984177 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3cc491-364d-48ec-8293-7531962145cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:35:32.057582 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.auth.core [None req-9f3cc491-364d-48ec-8293-7531962145cb None None] MFA Rules not processed for user `44883b22532e44049d846938dc2cf423`. Rule list: `[]` (Enabled: `True`). {{(pid=79879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:35:32.059629 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-9f3cc491-364d-48ec-8293-7531962145cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:35:32.062976 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 832/1679] 10.222.0.23 () {58 vars in 1009 bytes} [Tue May 10 05:35:31 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 334 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 05:35:32.065788 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79847cb-61e5-4ccb-84bc-a6b84250e2f1 None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:35:32.067739 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-e79847cb-61e5-4ccb-84bc-a6b84250e2f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:35:32.242536 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 848/1680] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 10 05:35:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 05:35:32.245065 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79847cb-61e5-4ccb-84bc-a6b84250e2f1 None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:35:32.256233 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e50af30-87ec-4ba6-ad9b-9332276db31e None None] REQUEST_METHOD: `POST` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:35:32.256676 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e50af30-87ec-4ba6-ad9b-9332276db31e None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:35:32.257563 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e50af30-87ec-4ba6-ad9b-9332276db31e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:35:32.261544 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbd0830-15dd-493c-8204-001bb936ff7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:35:32.262611 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbd0830-15dd-493c-8204-001bb936ff7a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:35:32.263087 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbd0830-15dd-493c-8204-001bb936ff7a admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:35:32.263659 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbd0830-15dd-493c-8204-001bb936ff7a admin admin] PATH_INFO: `/v3/users/2479ea7b255f41ef8f154b173c616bdb` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:35:32.265449 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dbd0830-15dd-493c-8204-001bb936ff7a admin admin] RBAC: Authorizing `identity:delete_user(user_id=2479ea7b255f41ef8f154b173c616bdb)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:35:32.269999 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dbd0830-15dd-493c-8204-001bb936ff7a admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:35:32.292044 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.auth.core [None req-6e50af30-87ec-4ba6-ad9b-9332276db31e None None] MFA Rules not processed for user `44883b22532e44049d846938dc2cf423`. Rule list: `[]` (Enabled: `True`). {{(pid=79879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:35:32.294161 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-6e50af30-87ec-4ba6-ad9b-9332276db31e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:35:32.304654 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 849/1681] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 10 05:35:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 05:35:32.308612 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e50af30-87ec-4ba6-ad9b-9332276db31e None None] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:35:32.327315 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e50af30-87ec-4ba6-ad9b-9332276db31e None None] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:35:32.372057 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082ebf6d-0590-417e-86a9-a85054b73b63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:35:32.376937 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082ebf6d-0590-417e-86a9-a85054b73b63 admin admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:35:32.377523 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082ebf6d-0590-417e-86a9-a85054b73b63 admin admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:35:32.378764 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082ebf6d-0590-417e-86a9-a85054b73b63 admin admin] PATH_INFO: `/v3/domains` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:35:32.379774 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082ebf6d-0590-417e-86a9-a85054b73b63 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:35:32.381766 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082ebf6d-0590-417e-86a9-a85054b73b63 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:35:32.386810 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082ebf6d-0590-417e-86a9-a85054b73b63 admin admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:35:32.410274 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-7dbd0830-15dd-493c-8204-001bb936ff7a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2479ea7b255f41ef8f154b173c616bdb'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:35:32.421460 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 850/1682] 10.222.0.23 () {58 vars in 1152 bytes} [Tue May 10 05:35:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:35:32.422754 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082ebf6d-0590-417e-86a9-a85054b73b63 admin admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:35:32.430752 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-082ebf6d-0590-417e-86a9-a85054b73b63 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:35:32.436413 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-7dbd0830-15dd-493c-8204-001bb936ff7a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2479ea7b255f41ef8f154b173c616bdb'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:35:32.438444 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-7dbd0830-15dd-493c-8204-001bb936ff7a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2479ea7b255f41ef8f154b173c616bdb'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:35:32.459345 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-7dbd0830-15dd-493c-8204-001bb936ff7a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2479ea7b255f41ef8f154b173c616bdb'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:35:32.463764 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-7dbd0830-15dd-493c-8204-001bb936ff7a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2479ea7b255f41ef8f154b173c616bdb'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:35:32.505794 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 833/1683] 10.222.0.23 () {58 vars in 1223 bytes} [Tue May 10 05:35:32 2022] DELETE /identity/v3/users/2479ea7b255f41ef8f154b173c616bdb => generated 0 bytes in 442 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 05:35:32.509882 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbd0830-15dd-493c-8204-001bb936ff7a admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:35:32.514909 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-7dbd0830-15dd-493c-8204-001bb936ff7a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:35:32.545701 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082ebf6d-0590-417e-86a9-a85054b73b63 admin admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:35:32.685534 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbd0830-15dd-493c-8204-001bb936ff7a admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:35:32.704716 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bf7313-d46f-4b7d-b379-88d25057e137 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:35:32.705132 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a594f4-35a5-45d1-a73c-f9492de8cc76 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd31dacf30804395bd029037b407c12a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f23435f783540199d6dcfd0417c090e', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:35:32.705423 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bf7313-d46f-4b7d-b379-88d25057e137 admin admin] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:35:32.705766 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bf7313-d46f-4b7d-b379-88d25057e137 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:35:32.705865 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a594f4-35a5-45d1-a73c-f9492de8cc76 service swift] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:35:32.706047 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bf7313-d46f-4b7d-b379-88d25057e137 admin admin] PATH_INFO: `/v3/projects` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:35:32.706140 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a594f4-35a5-45d1-a73c-f9492de8cc76 service swift] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:35:32.706771 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33bf7313-d46f-4b7d-b379-88d25057e137 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:35:32.707596 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a594f4-35a5-45d1-a73c-f9492de8cc76 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:35:32.708844 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33bf7313-d46f-4b7d-b379-88d25057e137 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:35:32.709911 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-80a594f4-35a5-45d1-a73c-f9492de8cc76 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:35:32.766828 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 834/1684] 10.222.0.23 () {60 vars in 1152 bytes} [Tue May 10 05:35:32 2022] POST /identity/v3/projects => generated 385 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 05:35:32.768487 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d25a32e-1b62-448e-a99f-3f496a737bd8 None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:35:32.768928 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d25a32e-1b62-448e-a99f-3f496a737bd8 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:35:32.769344 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d25a32e-1b62-448e-a99f-3f496a737bd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:35:32.809623 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-5d25a32e-1b62-448e-a99f-3f496a737bd8 None None] MFA Rules not processed for user `44883b22532e44049d846938dc2cf423`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:35:32.816132 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-5d25a32e-1b62-448e-a99f-3f496a737bd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:35:32.871803 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a594f4-35a5-45d1-a73c-f9492de8cc76 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:35:32.873839 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a594f4-35a5-45d1-a73c-f9492de8cc76 service swift] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:35:32.914049 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 851/1685] 10.222.0.23 () {60 vars in 1384 bytes} [Tue May 10 05:35:32 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 492 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 10 05:35:32.915796 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a594f4-35a5-45d1-a73c-f9492de8cc76 service swift] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:35:32.933566 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 835/1686] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 10 05:35:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 05:35:32.948056 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a594f4-35a5-45d1-a73c-f9492de8cc76 service swift] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:35:32.957404 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d25a32e-1b62-448e-a99f-3f496a737bd8 None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:35:32.959129 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ad3cb2-8c43-49f9-aa3f-4b5d02651522 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:35:32.959976 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ad3cb2-8c43-49f9-aa3f-4b5d02651522 admin admin] REQUEST_METHOD: `POST` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:35:32.960424 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ad3cb2-8c43-49f9-aa3f-4b5d02651522 admin admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:35:32.960533 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-5d25a32e-1b62-448e-a99f-3f496a737bd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:35:32.960934 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ad3cb2-8c43-49f9-aa3f-4b5d02651522 admin admin] PATH_INFO: `/v3/users` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:35:32.962814 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ad3cb2-8c43-49f9-aa3f-4b5d02651522 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:35:32.968006 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ad3cb2-8c43-49f9-aa3f-4b5d02651522 admin admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:35:33.025442 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 852/1687] 10.222.0.23 () {60 vars in 1143 bytes} [Tue May 10 05:35:32 2022] POST /identity/v3/users => generated 293 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 05:35:33.030644 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ad3cb2-8c43-49f9-aa3f-4b5d02651522 admin admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:35:33.058594 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ad3cb2-8c43-49f9-aa3f-4b5d02651522 admin admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:35:33.081720 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb56f623-2481-4dec-b4c8-9f728963273f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:35:33.082690 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb56f623-2481-4dec-b4c8-9f728963273f admin admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:35:33.083147 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb56f623-2481-4dec-b4c8-9f728963273f admin admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:35:33.083560 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb56f623-2481-4dec-b4c8-9f728963273f admin admin] PATH_INFO: `/v3/roles` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:35:33.085025 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb56f623-2481-4dec-b4c8-9f728963273f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:35:33.088730 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb56f623-2481-4dec-b4c8-9f728963273f admin admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:35:33.115563 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 853/1688] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 10 05:35:33 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 05:35:33.116780 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb56f623-2481-4dec-b4c8-9f728963273f admin admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:35:33.147897 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb56f623-2481-4dec-b4c8-9f728963273f admin admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:35:33.191122 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e169edc3-97bd-431d-8831-7e1658482d06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:35:33.192355 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e169edc3-97bd-431d-8831-7e1658482d06 admin admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:35:33.192355 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e169edc3-97bd-431d-8831-7e1658482d06 admin admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:35:33.192537 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e169edc3-97bd-431d-8831-7e1658482d06 admin admin] PATH_INFO: `/v3/roles` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:35:33.193324 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e169edc3-97bd-431d-8831-7e1658482d06 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:35:33.194950 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e169edc3-97bd-431d-8831-7e1658482d06 admin admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:35:33.260434 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d25a32e-1b62-448e-a99f-3f496a737bd8 None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:35:33.275631 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4a014d-72f4-4272-8791-81305b215dbb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c8461cfdd9648b8abcaf8d34b7a102a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f23435f783540199d6dcfd0417c090e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:35:33.276418 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 854/1689] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 10 05:35:33 2022] GET /identity/v3/roles => generated 1420 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 05:35:33.276535 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4a014d-72f4-4272-8791-81305b215dbb service neutron] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:35:33.276749 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4a014d-72f4-4272-8791-81305b215dbb service neutron] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:35:33.277036 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4a014d-72f4-4272-8791-81305b215dbb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:35:33.285112 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf29928e-66cd-4389-a0b1-046c7be480be None None] REQUEST_METHOD: `POST` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:35:33.285444 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf29928e-66cd-4389-a0b1-046c7be480be None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:35:33.293025 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf29928e-66cd-4389-a0b1-046c7be480be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:35:33.346362 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4a014d-72f4-4272-8791-81305b215dbb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:35:33.348115 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4a014d-72f4-4272-8791-81305b215dbb service neutron] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:35:33.420454 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 836/1690] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 10 05:35:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 463 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 05:35:33.423523 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4a014d-72f4-4272-8791-81305b215dbb service neutron] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:35:33.461892 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.auth.core [None req-cf29928e-66cd-4389-a0b1-046c7be480be None None] MFA Rules not processed for user `952c90085aff498d9aca46518d272553`. Rule list: `[]` (Enabled: `True`). {{(pid=79879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:35:33.475744 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-cf29928e-66cd-4389-a0b1-046c7be480be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:35:33.475962 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4a014d-72f4-4272-8791-81305b215dbb service neutron] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:35:33.506574 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851a782e-ed51-4dda-80bb-ff80c7b00e93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:35:33.507503 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851a782e-ed51-4dda-80bb-ff80c7b00e93 admin admin] REQUEST_METHOD: `PUT` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:35:33.507812 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851a782e-ed51-4dda-80bb-ff80c7b00e93 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:35:33.508121 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851a782e-ed51-4dda-80bb-ff80c7b00e93 admin admin] PATH_INFO: `/v3/projects/43416831675e4ad7b08db0ac262a24a4/users/7a5178afea70413d80d631d1dd2f6113/roles/382636e67fc142a2b2f486340d959e11` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:35:33.618061 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851a782e-ed51-4dda-80bb-ff80c7b00e93 admin admin] RBAC: Authorizing `identity:create_grant(project_id=43416831675e4ad7b08db0ac262a24a4, user_id=7a5178afea70413d80d631d1dd2f6113, role_id=382636e67fc142a2b2f486340d959e11)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:35:33.637803 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851a782e-ed51-4dda-80bb-ff80c7b00e93 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:35:33.773138 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 837/1691] 10.222.0.23 () {60 vars in 1482 bytes} [Tue May 10 05:35:33 2022] PUT /identity/v3/projects/43416831675e4ad7b08db0ac262a24a4/users/7a5178afea70413d80d631d1dd2f6113/roles/382636e67fc142a2b2f486340d959e11 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 05:35:33.779400 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de955591-ad01-4410-a792-739c581c6ca3 None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:35:33.782366 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de955591-ad01-4410-a792-739c581c6ca3 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:35:33.783020 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de955591-ad01-4410-a792-739c581c6ca3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:35:33.832162 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 855/1692] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 10 05:35:33 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 555 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 05:35:33.844632 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ff3b5c-897d-4086-bec3-8dbccbaa8303 None None] REQUEST_METHOD: `POST` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:35:33.844969 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ff3b5c-897d-4086-bec3-8dbccbaa8303 None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:35:33.845255 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ff3b5c-897d-4086-bec3-8dbccbaa8303 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:35:33.870703 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-de955591-ad01-4410-a792-739c581c6ca3 None None] MFA Rules not processed for user `7a5178afea70413d80d631d1dd2f6113`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:35:33.873358 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-de955591-ad01-4410-a792-739c581c6ca3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:35:33.944598 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.auth.core [None req-a8ff3b5c-897d-4086-bec3-8dbccbaa8303 None None] MFA Rules not processed for user `952c90085aff498d9aca46518d272553`. Rule list: `[]` (Enabled: `True`). {{(pid=79879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:35:33.949402 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-a8ff3b5c-897d-4086-bec3-8dbccbaa8303 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:35:34.134277 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 838/1693] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 10 05:35:33 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 361 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 05:35:34.142752 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de955591-ad01-4410-a792-739c581c6ca3 None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:35:34.148533 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-de955591-ad01-4410-a792-739c581c6ca3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:35:34.154665 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 856/1694] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 10 05:35:33 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 312 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 05:35:34.155536 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ff3b5c-897d-4086-bec3-8dbccbaa8303 None None] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:35:34.379533 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de955591-ad01-4410-a792-739c581c6ca3 None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:35:34.388020 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd80a5c-618f-4372-a9b0-395e98dd33ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:35:34.389279 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd80a5c-618f-4372-a9b0-395e98dd33ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:35:34.389993 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd80a5c-618f-4372-a9b0-395e98dd33ef admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:35:34.390527 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd80a5c-618f-4372-a9b0-395e98dd33ef admin admin] PATH_INFO: `/v3/projects/dec6ff999ecd4bf1bd6ee50f996d9c06` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:35:34.394369 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd80a5c-618f-4372-a9b0-395e98dd33ef admin admin] RBAC: Authorizing `identity:delete_project(project_id=dec6ff999ecd4bf1bd6ee50f996d9c06)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:35:34.399152 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd80a5c-618f-4372-a9b0-395e98dd33ef admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:35:34.418647 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ff3b5c-897d-4086-bec3-8dbccbaa8303 None None] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:35:34.434033 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f86fc33-553b-47c2-a575-a5f49132908d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:35:34.434893 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f86fc33-553b-47c2-a575-a5f49132908d admin admin] REQUEST_METHOD: `POST` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:35:34.435209 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f86fc33-553b-47c2-a575-a5f49132908d admin admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:35:34.435489 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f86fc33-553b-47c2-a575-a5f49132908d admin admin] PATH_INFO: `/v3/projects` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:35:34.447980 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f86fc33-553b-47c2-a575-a5f49132908d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:35:34.453907 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f86fc33-553b-47c2-a575-a5f49132908d admin admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:35:34.509803 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 857/1695] 10.222.0.23 () {60 vars in 1152 bytes} [Tue May 10 05:35:34 2022] POST /identity/v3/projects => generated 385 bytes in 354 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 05:35:34.510791 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f86fc33-553b-47c2-a575-a5f49132908d admin admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:35:34.514635 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-7f86fc33-553b-47c2-a575-a5f49132908d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:35:34.541323 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-7bd80a5c-618f-4372-a9b0-395e98dd33ef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dec6ff999ecd4bf1bd6ee50f996d9c06', 'request_id': 'req-7bd80a5c-618f-4372-a9b0-395e98dd33ef'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:35:34.562148 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-7bd80a5c-618f-4372-a9b0-395e98dd33ef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dec6ff999ecd4bf1bd6ee50f996d9c06', 'request_id': 'req-7bd80a5c-618f-4372-a9b0-395e98dd33ef'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:35:34.588052 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-7bd80a5c-618f-4372-a9b0-395e98dd33ef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dec6ff999ecd4bf1bd6ee50f996d9c06', 'request_id': 'req-7bd80a5c-618f-4372-a9b0-395e98dd33ef'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:35:34.607998 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-7bd80a5c-618f-4372-a9b0-395e98dd33ef admin admin] The token cache is being invalidate because project dec6ff999ecd4bf1bd6ee50f996d9c06 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79880) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 05:35:34.608327 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-7bd80a5c-618f-4372-a9b0-395e98dd33ef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:35:34.609882 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-7bd80a5c-618f-4372-a9b0-395e98dd33ef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:35:34.613906 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 839/1696] 10.222.0.23 () {58 vars in 1232 bytes} [Tue May 10 05:35:34 2022] DELETE /identity/v3/projects/dec6ff999ecd4bf1bd6ee50f996d9c06 => generated 0 bytes in 474 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 05:35:34.618589 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd80a5c-618f-4372-a9b0-395e98dd33ef admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:35:34.622932 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-7bd80a5c-618f-4372-a9b0-395e98dd33ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:35:34.709372 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f86fc33-553b-47c2-a575-a5f49132908d admin admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:35:34.734127 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38125787-d2ad-4512-b900-8b015ba8d236 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f50f224ca944983aecfde86375473da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f23435f783540199d6dcfd0417c090e', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:35:34.734958 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38125787-d2ad-4512-b900-8b015ba8d236 service nova] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:35:34.735340 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38125787-d2ad-4512-b900-8b015ba8d236 service nova] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:35:34.735756 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38125787-d2ad-4512-b900-8b015ba8d236 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:35:34.737789 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-38125787-d2ad-4512-b900-8b015ba8d236 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:35:34.791805 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd80a5c-618f-4372-a9b0-395e98dd33ef admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:35:34.870120 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38125787-d2ad-4512-b900-8b015ba8d236 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:35:34.875962 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38125787-d2ad-4512-b900-8b015ba8d236 service nova] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:35:34.904149 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 858/1697] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 10 05:35:34 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 05:35:34.905972 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4ac39e-5981-4440-8e09-c5ef4721ff19 None None] REQUEST_METHOD: `POST` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:35:34.906648 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4ac39e-5981-4440-8e09-c5ef4721ff19 None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:35:34.907076 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4ac39e-5981-4440-8e09-c5ef4721ff19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:35:34.971669 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.auth.core [None req-5f4ac39e-5981-4440-8e09-c5ef4721ff19 None None] MFA Rules not processed for user `44883b22532e44049d846938dc2cf423`. Rule list: `[]` (Enabled: `True`). {{(pid=79879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:35:34.977559 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-5f4ac39e-5981-4440-8e09-c5ef4721ff19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:35:34.983368 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7790d2a-e001-4fe4-bc5c-9c8e10eb8b9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:35:34.985761 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7790d2a-e001-4fe4-bc5c-9c8e10eb8b9b admin admin] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:35:34.986002 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7790d2a-e001-4fe4-bc5c-9c8e10eb8b9b admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:35:34.987827 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7790d2a-e001-4fe4-bc5c-9c8e10eb8b9b admin admin] PATH_INFO: `/v3/users` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:35:34.990363 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7790d2a-e001-4fe4-bc5c-9c8e10eb8b9b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:35:34.998124 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7790d2a-e001-4fe4-bc5c-9c8e10eb8b9b admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:35:35.003180 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 859/1698] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 10 05:35:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 05:35:35.007340 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765c4477-6bd7-4651-9d9e-7388e03daf76 None None] REQUEST_METHOD: `POST` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:35:35.007798 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765c4477-6bd7-4651-9d9e-7388e03daf76 None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:35:35.008084 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765c4477-6bd7-4651-9d9e-7388e03daf76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:35:35.075912 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 840/1699] 10.222.0.23 () {60 vars in 1143 bytes} [Tue May 10 05:35:34 2022] POST /identity/v3/users => generated 293 bytes in 461 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 05:35:35.079892 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7790d2a-e001-4fe4-bc5c-9c8e10eb8b9b admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:35:35.087786 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.auth.core [None req-765c4477-6bd7-4651-9d9e-7388e03daf76 None None] MFA Rules not processed for user `44883b22532e44049d846938dc2cf423`. Rule list: `[]` (Enabled: `True`). {{(pid=79879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:35:35.111677 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7790d2a-e001-4fe4-bc5c-9c8e10eb8b9b admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:35:35.117046 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-765c4477-6bd7-4651-9d9e-7388e03daf76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:35:35.121406 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d0eb72-7571-433f-abeb-59f94bd3098a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:35:35.123070 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d0eb72-7571-433f-abeb-59f94bd3098a admin admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:35:35.123546 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d0eb72-7571-433f-abeb-59f94bd3098a admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:35:35.124063 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d0eb72-7571-433f-abeb-59f94bd3098a admin admin] PATH_INFO: `/v3/roles` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:35:35.125266 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d0eb72-7571-433f-abeb-59f94bd3098a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:35:35.127165 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d0eb72-7571-433f-abeb-59f94bd3098a admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:35:35.133918 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 860/1700] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 10 05:35:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 05:35:35.135127 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765c4477-6bd7-4651-9d9e-7388e03daf76 None None] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:35:35.146240 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765c4477-6bd7-4651-9d9e-7388e03daf76 None None] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:35:35.152790 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 841/1701] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 10 05:35:35 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 05:35:35.160445 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d0eb72-7571-433f-abeb-59f94bd3098a admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:35:35.160747 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64d5f61-afa7-4b80-bc6d-727fdbe22712 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:35:35.161598 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64d5f61-afa7-4b80-bc6d-727fdbe22712 admin admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:35:35.162196 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64d5f61-afa7-4b80-bc6d-727fdbe22712 admin admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:35:35.162601 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64d5f61-afa7-4b80-bc6d-727fdbe22712 admin admin] PATH_INFO: `/v3/domains` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:35:35.163475 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64d5f61-afa7-4b80-bc6d-727fdbe22712 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:35:35.163957 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64d5f61-afa7-4b80-bc6d-727fdbe22712 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:35:35.165739 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64d5f61-afa7-4b80-bc6d-727fdbe22712 admin admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:35:35.197763 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 861/1702] 10.222.0.23 () {58 vars in 1152 bytes} [Tue May 10 05:35:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:35:35.199064 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64d5f61-afa7-4b80-bc6d-727fdbe22712 admin admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:35:35.202506 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d0eb72-7571-433f-abeb-59f94bd3098a admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:35:35.220511 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770c7d46-adbf-4073-ae29-340eab68a074 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:35:35.224593 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770c7d46-adbf-4073-ae29-340eab68a074 admin admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:35:35.225646 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64d5f61-afa7-4b80-bc6d-727fdbe22712 admin admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:35:35.226162 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770c7d46-adbf-4073-ae29-340eab68a074 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:35:35.226827 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770c7d46-adbf-4073-ae29-340eab68a074 admin admin] PATH_INFO: `/v3/roles` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:35:35.230198 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770c7d46-adbf-4073-ae29-340eab68a074 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:35:35.236755 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770c7d46-adbf-4073-ae29-340eab68a074 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:35:35.243351 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432ab062-e27b-4bad-9bfd-6d28a5813e72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:35:35.244259 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432ab062-e27b-4bad-9bfd-6d28a5813e72 admin admin] REQUEST_METHOD: `POST` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:35:35.244538 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432ab062-e27b-4bad-9bfd-6d28a5813e72 admin admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:35:35.245477 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432ab062-e27b-4bad-9bfd-6d28a5813e72 admin admin] PATH_INFO: `/v3/projects` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:35:35.245477 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432ab062-e27b-4bad-9bfd-6d28a5813e72 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:35:35.247989 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432ab062-e27b-4bad-9bfd-6d28a5813e72 admin admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:35:35.283059 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 842/1703] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 10 05:35:35 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 05:35:35.290520 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770c7d46-adbf-4073-ae29-340eab68a074 admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:35:35.321492 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 862/1704] 10.222.0.23 () {60 vars in 1152 bytes} [Tue May 10 05:35:35 2022] POST /identity/v3/projects => generated 405 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 05:35:35.323057 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432ab062-e27b-4bad-9bfd-6d28a5813e72 admin admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:35:35.335350 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770c7d46-adbf-4073-ae29-340eab68a074 admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:35:35.435301 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857182eb-baf0-4530-a185-03e3ddfa25a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:35:35.436403 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857182eb-baf0-4530-a185-03e3ddfa25a1 admin admin] REQUEST_METHOD: `PUT` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:35:35.436785 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857182eb-baf0-4530-a185-03e3ddfa25a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:35:35.437160 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857182eb-baf0-4530-a185-03e3ddfa25a1 admin admin] PATH_INFO: `/v3/projects/8bde5e68c738420694b1849403c31c57/users/a1c60632801a49a699daa199a36a2f09/roles/382636e67fc142a2b2f486340d959e11` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:35:35.455824 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857182eb-baf0-4530-a185-03e3ddfa25a1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8bde5e68c738420694b1849403c31c57, user_id=a1c60632801a49a699daa199a36a2f09, role_id=382636e67fc142a2b2f486340d959e11)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:35:35.458874 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857182eb-baf0-4530-a185-03e3ddfa25a1 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:35:35.484741 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 843/1705] 10.222.0.23 () {60 vars in 1482 bytes} [Tue May 10 05:35:35 2022] PUT /identity/v3/projects/8bde5e68c738420694b1849403c31c57/users/a1c60632801a49a699daa199a36a2f09/roles/382636e67fc142a2b2f486340d959e11 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 05:35:35.496972 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa59c704-7539-430c-846e-a3df80dc9541 None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:35:35.498060 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa59c704-7539-430c-846e-a3df80dc9541 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:35:35.498584 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa59c704-7539-430c-846e-a3df80dc9541 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:35:35.511258 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432ab062-e27b-4bad-9bfd-6d28a5813e72 admin admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:35:35.551534 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-fa59c704-7539-430c-846e-a3df80dc9541 None None] MFA Rules not processed for user `a1c60632801a49a699daa199a36a2f09`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:35:35.553145 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-fa59c704-7539-430c-846e-a3df80dc9541 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:35:35.726722 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c23596-c933-41ed-b100-b930a2480adc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:35:35.728859 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c23596-c933-41ed-b100-b930a2480adc admin admin] REQUEST_METHOD: `POST` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:35:35.730289 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c23596-c933-41ed-b100-b930a2480adc admin admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:35:35.730682 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c23596-c933-41ed-b100-b930a2480adc admin admin] PATH_INFO: `/v3/users` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:35:35.731533 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c23596-c933-41ed-b100-b930a2480adc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:35:35.734122 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c23596-c933-41ed-b100-b930a2480adc admin admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:35:35.761513 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 844/1706] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 10 05:35:35 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 05:35:35.763628 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f757c7-3ec9-4666-a864-332bcf7a8dbd None None] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:35:35.764073 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f757c7-3ec9-4666-a864-332bcf7a8dbd None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:35:35.764758 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f757c7-3ec9-4666-a864-332bcf7a8dbd None None] PATH_INFO: `/` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:35:35.766149 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 845/1707] 10.222.0.23 () {54 vars in 912 bytes} [Tue May 10 05:35:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 05:35:35.768212 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f757c7-3ec9-4666-a864-332bcf7a8dbd None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:35:35.770910 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-f5f757c7-3ec9-4666-a864-332bcf7a8dbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:35:35.775800 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 863/1708] 10.222.0.23 () {60 vars in 1143 bytes} [Tue May 10 05:35:35 2022] POST /identity/v3/users => generated 303 bytes in 454 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 05:35:35.782612 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c23596-c933-41ed-b100-b930a2480adc admin admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:35:35.792321 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f757c7-3ec9-4666-a864-332bcf7a8dbd None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:35:35.797608 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83584aad-b610-49d5-b0af-7295d748d396 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:35:35.798612 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83584aad-b610-49d5-b0af-7295d748d396 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:35:35.798897 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83584aad-b610-49d5-b0af-7295d748d396 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:35:35.799233 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83584aad-b610-49d5-b0af-7295d748d396 admin admin] PATH_INFO: `/v3/projects/c2c10c7658e84389ad835bc83c0b40c8` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:35:35.811770 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c23596-c933-41ed-b100-b930a2480adc admin admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:35:35.812823 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83584aad-b610-49d5-b0af-7295d748d396 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c2c10c7658e84389ad835bc83c0b40c8)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:35:35.816298 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83584aad-b610-49d5-b0af-7295d748d396 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:35:35.821985 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d51dc1-b261-45d8-889a-986f987d8a81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:35:35.823289 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d51dc1-b261-45d8-889a-986f987d8a81 admin admin] REQUEST_METHOD: `POST` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:35:35.823866 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d51dc1-b261-45d8-889a-986f987d8a81 admin admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:35:35.824375 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d51dc1-b261-45d8-889a-986f987d8a81 admin admin] PATH_INFO: `/v3/projects` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:35:35.826750 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d51dc1-b261-45d8-889a-986f987d8a81 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:35:35.829195 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d51dc1-b261-45d8-889a-986f987d8a81 admin admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:35:35.897180 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 864/1709] 10.222.0.23 () {60 vars in 1152 bytes} [Tue May 10 05:35:35 2022] POST /identity/v3/projects => generated 387 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 05:35:35.899296 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017b424d-9d55-4028-a476-ad370a024691 None None] REQUEST_METHOD: `POST` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:35:35.899761 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017b424d-9d55-4028-a476-ad370a024691 None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:35:35.900723 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017b424d-9d55-4028-a476-ad370a024691 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:35:35.944591 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-83584aad-b610-49d5-b0af-7295d748d396 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c2c10c7658e84389ad835bc83c0b40c8', 'request_id': 'req-83584aad-b610-49d5-b0af-7295d748d396'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:35:35.950232 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.auth.core [None req-017b424d-9d55-4028-a476-ad370a024691 None None] MFA Rules not processed for user `3c8461cfdd9648b8abcaf8d34b7a102a`. Rule list: `[]` (Enabled: `True`). {{(pid=79879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:35:35.956694 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-017b424d-9d55-4028-a476-ad370a024691 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:35:35.958177 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-83584aad-b610-49d5-b0af-7295d748d396 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c2c10c7658e84389ad835bc83c0b40c8', 'request_id': 'req-83584aad-b610-49d5-b0af-7295d748d396'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:35:35.975007 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-83584aad-b610-49d5-b0af-7295d748d396 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c2c10c7658e84389ad835bc83c0b40c8', 'request_id': 'req-83584aad-b610-49d5-b0af-7295d748d396'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:35:35.997589 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-83584aad-b610-49d5-b0af-7295d748d396 admin admin] The token cache is being invalidate because project c2c10c7658e84389ad835bc83c0b40c8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79880) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 05:35:35.997589 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-83584aad-b610-49d5-b0af-7295d748d396 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:35:35.998286 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-83584aad-b610-49d5-b0af-7295d748d396 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:35:36.001160 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 846/1710] 10.222.0.23 () {58 vars in 1232 bytes} [Tue May 10 05:35:35 2022] DELETE /identity/v3/projects/c2c10c7658e84389ad835bc83c0b40c8 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 05:35:36.001673 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83584aad-b610-49d5-b0af-7295d748d396 admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:35:36.005266 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-83584aad-b610-49d5-b0af-7295d748d396 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:35:36.098966 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 865/1711] 10.222.0.23 () {58 vars in 1009 bytes} [Tue May 10 05:35:35 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 05:35:36.099967 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017b424d-9d55-4028-a476-ad370a024691 None None] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:35:36.104284 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-017b424d-9d55-4028-a476-ad370a024691 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:35:36.171675 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83584aad-b610-49d5-b0af-7295d748d396 admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:35:36.190126 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1a3af6-0c68-48d9-b9d8-f1405ed1fcc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:35:36.190831 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1a3af6-0c68-48d9-b9d8-f1405ed1fcc6 admin admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:35:36.191114 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1a3af6-0c68-48d9-b9d8-f1405ed1fcc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:35:36.191399 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1a3af6-0c68-48d9-b9d8-f1405ed1fcc6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:35:36.192356 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1a3af6-0c68-48d9-b9d8-f1405ed1fcc6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:35:36.194112 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1a3af6-0c68-48d9-b9d8-f1405ed1fcc6 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:35:36.221889 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 847/1712] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 10 05:35:36 2022] GET /identity/v3/roles => generated 1420 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 05:35:36.223500 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5599e81-a500-4f1b-95a2-72be55e5c51a None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:35:36.223863 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5599e81-a500-4f1b-95a2-72be55e5c51a None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:35:36.224204 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5599e81-a500-4f1b-95a2-72be55e5c51a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:35:36.241638 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017b424d-9d55-4028-a476-ad370a024691 None None] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:35:36.257293 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c53f15-1e60-4c77-b3a2-fd9021d51ca7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:35:36.259303 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c53f15-1e60-4c77-b3a2-fd9021d51ca7 admin admin] REQUEST_METHOD: `POST` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:35:36.261819 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c53f15-1e60-4c77-b3a2-fd9021d51ca7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:35:36.262882 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c53f15-1e60-4c77-b3a2-fd9021d51ca7 admin admin] PATH_INFO: `/v3/users` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:35:36.267547 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c53f15-1e60-4c77-b3a2-fd9021d51ca7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:35:36.272889 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c53f15-1e60-4c77-b3a2-fd9021d51ca7 admin admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:35:36.276435 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-c5599e81-a500-4f1b-95a2-72be55e5c51a None None] MFA Rules not processed for user `44883b22532e44049d846938dc2cf423`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:35:36.277769 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-c5599e81-a500-4f1b-95a2-72be55e5c51a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:35:36.307843 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 848/1713] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 10 05:35:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 05:35:36.308691 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5599e81-a500-4f1b-95a2-72be55e5c51a None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:35:36.312618 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-c5599e81-a500-4f1b-95a2-72be55e5c51a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:35:36.346009 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 866/1714] 10.222.0.23 () {60 vars in 1143 bytes} [Tue May 10 05:35:36 2022] POST /identity/v3/users => generated 300 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 05:35:36.347822 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5599e81-a500-4f1b-95a2-72be55e5c51a None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:35:36.348466 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c53f15-1e60-4c77-b3a2-fd9021d51ca7 admin admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:35:36.352535 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e012273-2be9-4272-8139-82da5ba13e91 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c8461cfdd9648b8abcaf8d34b7a102a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f23435f783540199d6dcfd0417c090e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:35:36.353209 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e012273-2be9-4272-8139-82da5ba13e91 service neutron] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:35:36.353621 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e012273-2be9-4272-8139-82da5ba13e91 service neutron] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:35:36.353990 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e012273-2be9-4272-8139-82da5ba13e91 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:35:36.372920 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e012273-2be9-4272-8139-82da5ba13e91 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:35:36.374758 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e012273-2be9-4272-8139-82da5ba13e91 service neutron] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:35:36.390561 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c53f15-1e60-4c77-b3a2-fd9021d51ca7 admin admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:35:36.409731 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a2fd68-5598-471d-b2f7-9b3eb0a76114 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:35:36.413059 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 849/1715] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 10 05:35:36 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 05:35:36.414279 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a2fd68-5598-471d-b2f7-9b3eb0a76114 admin admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:35:36.414768 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085c039c-27be-43f5-a7ee-bca61c0aca58 None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:35:36.415226 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085c039c-27be-43f5-a7ee-bca61c0aca58 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:35:36.415341 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a2fd68-5598-471d-b2f7-9b3eb0a76114 admin admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:35:36.415564 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085c039c-27be-43f5-a7ee-bca61c0aca58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:35:36.415966 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a2fd68-5598-471d-b2f7-9b3eb0a76114 admin admin] PATH_INFO: `/v3/roles` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:35:36.417430 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a2fd68-5598-471d-b2f7-9b3eb0a76114 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:35:36.425813 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a2fd68-5598-471d-b2f7-9b3eb0a76114 admin admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:35:36.471329 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 867/1716] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 10 05:35:36 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 05:35:36.476948 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a2fd68-5598-471d-b2f7-9b3eb0a76114 admin admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:35:36.488857 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-085c039c-27be-43f5-a7ee-bca61c0aca58 None None] MFA Rules not processed for user `44883b22532e44049d846938dc2cf423`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:35:36.490105 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-085c039c-27be-43f5-a7ee-bca61c0aca58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:35:36.517314 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 850/1717] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 10 05:35:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 05:35:36.518176 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085c039c-27be-43f5-a7ee-bca61c0aca58 None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:35:36.520029 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a2fd68-5598-471d-b2f7-9b3eb0a76114 admin admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:35:36.535779 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085c039c-27be-43f5-a7ee-bca61c0aca58 None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:35:36.545807 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b567940-6131-45cb-b727-589006319096 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:35:36.546514 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b567940-6131-45cb-b727-589006319096 admin admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:35:36.550772 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b567940-6131-45cb-b727-589006319096 admin admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:35:36.551146 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b567940-6131-45cb-b727-589006319096 admin admin] PATH_INFO: `/v3/roles` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:35:36.552015 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b567940-6131-45cb-b727-589006319096 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:35:36.553395 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50431a01-8f2e-497c-aad3-33736131f392 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:35:36.554630 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50431a01-8f2e-497c-aad3-33736131f392 admin admin] REQUEST_METHOD: `PUT` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:35:36.554630 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50431a01-8f2e-497c-aad3-33736131f392 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:35:36.554913 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50431a01-8f2e-497c-aad3-33736131f392 admin admin] PATH_INFO: `/v3/projects/c9f790398e5a42209850352a112c6138/users/e5fab64aea894e96ac8eb44a4a531eb5/roles/382636e67fc142a2b2f486340d959e11` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:35:36.562522 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b567940-6131-45cb-b727-589006319096 admin admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:35:36.589452 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 868/1718] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 10 05:35:36 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 05:35:36.590536 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b567940-6131-45cb-b727-589006319096 admin admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:35:36.605937 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b567940-6131-45cb-b727-589006319096 admin admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:35:36.606731 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50431a01-8f2e-497c-aad3-33736131f392 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c9f790398e5a42209850352a112c6138, user_id=e5fab64aea894e96ac8eb44a4a531eb5, role_id=382636e67fc142a2b2f486340d959e11)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:35:36.610891 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50431a01-8f2e-497c-aad3-33736131f392 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:35:36.614340 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45362f85-414d-43ca-97c0-8417ea0d0e8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:35:36.615249 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45362f85-414d-43ca-97c0-8417ea0d0e8b admin admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:35:36.615679 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45362f85-414d-43ca-97c0-8417ea0d0e8b admin admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:35:36.616097 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45362f85-414d-43ca-97c0-8417ea0d0e8b admin admin] PATH_INFO: `/v3/domains` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:35:36.629769 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45362f85-414d-43ca-97c0-8417ea0d0e8b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:35:36.630091 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45362f85-414d-43ca-97c0-8417ea0d0e8b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:35:36.635210 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45362f85-414d-43ca-97c0-8417ea0d0e8b admin admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:35:36.656015 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 851/1719] 10.222.0.23 () {60 vars in 1482 bytes} [Tue May 10 05:35:36 2022] PUT /identity/v3/projects/c9f790398e5a42209850352a112c6138/users/e5fab64aea894e96ac8eb44a4a531eb5/roles/382636e67fc142a2b2f486340d959e11 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 05:35:36.656916 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50431a01-8f2e-497c-aad3-33736131f392 admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:35:36.665219 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 869/1720] 10.222.0.23 () {58 vars in 1152 bytes} [Tue May 10 05:35:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:35:36.666617 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc5626e-343c-48c2-bf67-0ffa52412c88 None None] REQUEST_METHOD: `POST` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:35:36.666904 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc5626e-343c-48c2-bf67-0ffa52412c88 None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:35:36.667181 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc5626e-343c-48c2-bf67-0ffa52412c88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:35:36.701784 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.auth.core [None req-bdc5626e-343c-48c2-bf67-0ffa52412c88 None None] MFA Rules not processed for user `44883b22532e44049d846938dc2cf423`. Rule list: `[]` (Enabled: `True`). {{(pid=79879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:35:36.703036 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-bdc5626e-343c-48c2-bf67-0ffa52412c88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:35:36.822622 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 870/1721] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 10 05:35:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 05:35:36.825656 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50431a01-8f2e-497c-aad3-33736131f392 admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:35:36.826742 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc5626e-343c-48c2-bf67-0ffa52412c88 None None] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:35:36.841073 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc5626e-343c-48c2-bf67-0ffa52412c88 None None] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:35:36.844314 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7222ca-fdaa-44c1-9125-e245eecccd8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:35:36.845651 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7222ca-fdaa-44c1-9125-e245eecccd8b admin admin] REQUEST_METHOD: `PUT` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:35:36.846273 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7222ca-fdaa-44c1-9125-e245eecccd8b admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:35:36.846837 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7222ca-fdaa-44c1-9125-e245eecccd8b admin admin] PATH_INFO: `/v3/projects/df6317c4610e477786e03385cbf7d442/users/f015c3ed04814720ac6ea4462b5c86be/roles/199ac1dd842441d7913c6ee89d8fbecc` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:35:36.850006 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b8b4cf-c0d1-4242-9466-c044760fe0c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:35:36.850694 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b8b4cf-c0d1-4242-9466-c044760fe0c0 admin admin] REQUEST_METHOD: `POST` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:35:36.850977 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b8b4cf-c0d1-4242-9466-c044760fe0c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:35:36.851248 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b8b4cf-c0d1-4242-9466-c044760fe0c0 admin admin] PATH_INFO: `/v3/projects` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:35:36.852591 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b8b4cf-c0d1-4242-9466-c044760fe0c0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:35:36.855086 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b8b4cf-c0d1-4242-9466-c044760fe0c0 admin admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:35:36.881603 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7222ca-fdaa-44c1-9125-e245eecccd8b admin admin] RBAC: Authorizing `identity:create_grant(project_id=df6317c4610e477786e03385cbf7d442, user_id=f015c3ed04814720ac6ea4462b5c86be, role_id=199ac1dd842441d7913c6ee89d8fbecc)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:35:36.912504 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 871/1722] 10.222.0.23 () {60 vars in 1152 bytes} [Tue May 10 05:35:36 2022] POST /identity/v3/projects => generated 375 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 05:35:36.913968 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b8b4cf-c0d1-4242-9466-c044760fe0c0 admin admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:35:36.914148 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7222ca-fdaa-44c1-9125-e245eecccd8b admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:35:36.915993 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-08b8b4cf-c0d1-4242-9466-c044760fe0c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:35:36.946821 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 852/1723] 10.222.0.23 () {60 vars in 1482 bytes} [Tue May 10 05:35:36 2022] PUT /identity/v3/projects/df6317c4610e477786e03385cbf7d442/users/f015c3ed04814720ac6ea4462b5c86be/roles/199ac1dd842441d7913c6ee89d8fbecc => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 05:35:36.950810 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7222ca-fdaa-44c1-9125-e245eecccd8b admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:35:36.968353 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-8d7222ca-fdaa-44c1-9125-e245eecccd8b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:35:37.072310 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b8b4cf-c0d1-4242-9466-c044760fe0c0 admin admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:35:37.130262 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7222ca-fdaa-44c1-9125-e245eecccd8b admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:35:37.140695 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd91c91-9277-4b35-b8c6-72692d9c543c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c8461cfdd9648b8abcaf8d34b7a102a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f23435f783540199d6dcfd0417c090e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:35:37.141382 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd91c91-9277-4b35-b8c6-72692d9c543c service neutron] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:35:37.143856 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd91c91-9277-4b35-b8c6-72692d9c543c service neutron] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:35:37.144143 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd91c91-9277-4b35-b8c6-72692d9c543c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:35:37.203601 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527db422-8dfd-448c-b04c-ae8cd81c6678 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:35:37.205838 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527db422-8dfd-448c-b04c-ae8cd81c6678 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:35:37.206275 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527db422-8dfd-448c-b04c-ae8cd81c6678 admin admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:35:37.206698 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527db422-8dfd-448c-b04c-ae8cd81c6678 admin admin] PATH_INFO: `/v3/users/840b4b80d94f44e3a9a1c33b7c29bd57` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:35:37.208873 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527db422-8dfd-448c-b04c-ae8cd81c6678 admin admin] RBAC: Authorizing `identity:delete_user(user_id=840b4b80d94f44e3a9a1c33b7c29bd57)` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:35:37.211781 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527db422-8dfd-448c-b04c-ae8cd81c6678 admin admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:35:37.312971 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-527db422-8dfd-448c-b04c-ae8cd81c6678 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '840b4b80d94f44e3a9a1c33b7c29bd57'} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:35:37.331321 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-527db422-8dfd-448c-b04c-ae8cd81c6678 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '840b4b80d94f44e3a9a1c33b7c29bd57'} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:35:37.334162 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-527db422-8dfd-448c-b04c-ae8cd81c6678 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '840b4b80d94f44e3a9a1c33b7c29bd57'} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:35:37.376591 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-527db422-8dfd-448c-b04c-ae8cd81c6678 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '840b4b80d94f44e3a9a1c33b7c29bd57'} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:35:37.382743 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd91c91-9277-4b35-b8c6-72692d9c543c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:35:37.384074 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd91c91-9277-4b35-b8c6-72692d9c543c service neutron] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:35:37.406198 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-527db422-8dfd-448c-b04c-ae8cd81c6678 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '840b4b80d94f44e3a9a1c33b7c29bd57'} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:35:37.423781 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 872/1724] 10.222.0.23 () {58 vars in 1223 bytes} [Tue May 10 05:35:36 2022] DELETE /identity/v3/users/840b4b80d94f44e3a9a1c33b7c29bd57 => generated 0 bytes in 510 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 05:35:37.424990 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527db422-8dfd-448c-b04c-ae8cd81c6678 admin admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:35:37.426637 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-527db422-8dfd-448c-b04c-ae8cd81c6678 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:35:37.441654 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 853/1725] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 10 05:35:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 491 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 05:35:37.442641 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd91c91-9277-4b35-b8c6-72692d9c543c service neutron] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:35:37.499146 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd91c91-9277-4b35-b8c6-72692d9c543c service neutron] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:35:37.516301 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21deea8-292c-4300-ac02-4a6cfd3d0134 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:35:37.516815 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21deea8-292c-4300-ac02-4a6cfd3d0134 admin admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:35:37.517094 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21deea8-292c-4300-ac02-4a6cfd3d0134 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:35:37.517384 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21deea8-292c-4300-ac02-4a6cfd3d0134 admin admin] PATH_INFO: `/v3/roles` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:35:37.518108 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21deea8-292c-4300-ac02-4a6cfd3d0134 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:35:37.526624 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21deea8-292c-4300-ac02-4a6cfd3d0134 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:35:37.559924 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 854/1726] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 10 05:35:37 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 05:35:37.559924 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7467ca-d032-42a7-b179-bb04a47551a6 None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:35:37.559924 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7467ca-d032-42a7-b179-bb04a47551a6 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:35:37.562339 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7467ca-d032-42a7-b179-bb04a47551a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:35:37.570035 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527db422-8dfd-448c-b04c-ae8cd81c6678 admin admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:35:37.600087 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416ac9d4-50cc-4cc1-b6b1-b49af7f99ffd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:35:37.601688 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416ac9d4-50cc-4cc1-b6b1-b49af7f99ffd admin admin] REQUEST_METHOD: `POST` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:35:37.601970 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416ac9d4-50cc-4cc1-b6b1-b49af7f99ffd admin admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:35:37.602252 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416ac9d4-50cc-4cc1-b6b1-b49af7f99ffd admin admin] PATH_INFO: `/v3/users` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:35:37.604995 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416ac9d4-50cc-4cc1-b6b1-b49af7f99ffd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:35:37.607005 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416ac9d4-50cc-4cc1-b6b1-b49af7f99ffd admin admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:35:37.623847 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-5a7467ca-d032-42a7-b179-bb04a47551a6 None None] MFA Rules not processed for user `44883b22532e44049d846938dc2cf423`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:35:37.630200 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-5a7467ca-d032-42a7-b179-bb04a47551a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:35:37.640426 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 873/1727] 10.222.0.23 () {60 vars in 1143 bytes} [Tue May 10 05:35:37 2022] POST /identity/v3/users => generated 288 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 05:35:37.642629 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c8d61d-eb03-4002-b9a4-d4c2685ba293 None None] REQUEST_METHOD: `POST` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:35:37.646782 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c8d61d-eb03-4002-b9a4-d4c2685ba293 None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:35:37.646782 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c8d61d-eb03-4002-b9a4-d4c2685ba293 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:35:37.666815 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 855/1728] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 10 05:35:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 05:35:37.667195 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7467ca-d032-42a7-b179-bb04a47551a6 None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:35:37.671080 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-5a7467ca-d032-42a7-b179-bb04a47551a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:35:37.674755 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.auth.core [None req-75c8d61d-eb03-4002-b9a4-d4c2685ba293 None None] MFA Rules not processed for user `3c8461cfdd9648b8abcaf8d34b7a102a`. Rule list: `[]` (Enabled: `True`). {{(pid=79879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:35:37.676615 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-75c8d61d-eb03-4002-b9a4-d4c2685ba293 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:35:37.716228 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7467ca-d032-42a7-b179-bb04a47551a6 None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:35:37.737549 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bd75fd-2b9c-4375-8da0-c61288dfc9a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:35:37.738473 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bd75fd-2b9c-4375-8da0-c61288dfc9a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:35:37.738987 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bd75fd-2b9c-4375-8da0-c61288dfc9a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:35:37.738987 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bd75fd-2b9c-4375-8da0-c61288dfc9a0 admin admin] PATH_INFO: `/v3/projects/df6317c4610e477786e03385cbf7d442/users/f015c3ed04814720ac6ea4462b5c86be/roles/199ac1dd842441d7913c6ee89d8fbecc` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:35:37.751452 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90bd75fd-2b9c-4375-8da0-c61288dfc9a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=df6317c4610e477786e03385cbf7d442, user_id=f015c3ed04814720ac6ea4462b5c86be, role_id=199ac1dd842441d7913c6ee89d8fbecc)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:35:37.756996 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 874/1729] 10.222.0.50 () {58 vars in 1015 bytes} [Tue May 10 05:35:37 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 05:35:37.758829 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51927489-da5d-4d13-9638-28994980d40a None None] REQUEST_METHOD: `POST` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:35:37.759286 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51927489-da5d-4d13-9638-28994980d40a None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:35:37.759883 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51927489-da5d-4d13-9638-28994980d40a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:35:37.762263 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90bd75fd-2b9c-4375-8da0-c61288dfc9a0 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:35:37.782208 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.auth.core [None req-51927489-da5d-4d13-9638-28994980d40a None None] MFA Rules not processed for user `952c90085aff498d9aca46518d272553`. Rule list: `[]` (Enabled: `True`). {{(pid=79879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:35:37.784031 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-51927489-da5d-4d13-9638-28994980d40a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:35:37.799055 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 856/1730] 10.222.0.23 () {60 vars in 1482 bytes} [Tue May 10 05:35:37 2022] PUT /identity/v3/projects/df6317c4610e477786e03385cbf7d442/users/f015c3ed04814720ac6ea4462b5c86be/roles/199ac1dd842441d7913c6ee89d8fbecc => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 05:35:37.802707 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bd75fd-2b9c-4375-8da0-c61288dfc9a0 admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:35:37.880526 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 875/1731] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 10 05:35:37 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 05:35:37.881638 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51927489-da5d-4d13-9638-28994980d40a None None] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:35:37.887611 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-51927489-da5d-4d13-9638-28994980d40a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:35:38.000376 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bd75fd-2b9c-4375-8da0-c61288dfc9a0 admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:35:38.018862 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6672c98-e11c-49f2-bd80-24876401663b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:35:38.022790 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6672c98-e11c-49f2-bd80-24876401663b admin admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:35:38.024196 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6672c98-e11c-49f2-bd80-24876401663b admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:35:38.024902 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6672c98-e11c-49f2-bd80-24876401663b admin admin] PATH_INFO: `/v3/roles` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:35:38.027379 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6672c98-e11c-49f2-bd80-24876401663b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:35:38.030493 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6672c98-e11c-49f2-bd80-24876401663b admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:35:38.053031 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 857/1732] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 10 05:35:37 2022] GET /identity/v3/roles => generated 1420 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 05:35:38.054678 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743fee46-c154-413c-8e93-05d6bc2e6834 None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:35:38.055124 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743fee46-c154-413c-8e93-05d6bc2e6834 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:35:38.055657 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743fee46-c154-413c-8e93-05d6bc2e6834 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:35:38.068519 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51927489-da5d-4d13-9638-28994980d40a None None] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:35:38.095679 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424196e6-2fcf-4757-81c5-1e2e4cfffd0b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c8461cfdd9648b8abcaf8d34b7a102a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f23435f783540199d6dcfd0417c090e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:35:38.097182 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424196e6-2fcf-4757-81c5-1e2e4cfffd0b service neutron] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:35:38.097448 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424196e6-2fcf-4757-81c5-1e2e4cfffd0b service neutron] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:35:38.097781 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424196e6-2fcf-4757-81c5-1e2e4cfffd0b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:35:38.110865 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-743fee46-c154-413c-8e93-05d6bc2e6834 None None] MFA Rules not processed for user `f015c3ed04814720ac6ea4462b5c86be`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:35:38.112710 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-743fee46-c154-413c-8e93-05d6bc2e6834 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:35:38.131147 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424196e6-2fcf-4757-81c5-1e2e4cfffd0b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:35:38.133787 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424196e6-2fcf-4757-81c5-1e2e4cfffd0b service neutron] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:35:38.163382 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 876/1733] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 10 05:35:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 282 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 05:35:38.165328 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424196e6-2fcf-4757-81c5-1e2e4cfffd0b service neutron] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:35:38.170573 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-424196e6-2fcf-4757-81c5-1e2e4cfffd0b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:35:38.217362 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424196e6-2fcf-4757-81c5-1e2e4cfffd0b service neutron] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:35:38.231110 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafb3837-1a54-4f63-b8ed-129f72e7f5ce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c8461cfdd9648b8abcaf8d34b7a102a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f23435f783540199d6dcfd0417c090e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:35:38.232015 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafb3837-1a54-4f63-b8ed-129f72e7f5ce service neutron] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:35:38.232651 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafb3837-1a54-4f63-b8ed-129f72e7f5ce service neutron] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:35:38.233131 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafb3837-1a54-4f63-b8ed-129f72e7f5ce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:35:38.254317 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafb3837-1a54-4f63-b8ed-129f72e7f5ce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:35:38.256971 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafb3837-1a54-4f63-b8ed-129f72e7f5ce service neutron] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:35:38.292524 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 877/1734] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 10 05:35:38 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 05:35:38.293372 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafb3837-1a54-4f63-b8ed-129f72e7f5ce service neutron] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:35:38.331202 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafb3837-1a54-4f63-b8ed-129f72e7f5ce service neutron] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:35:38.338141 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd1d4ab-acba-4b0e-a8b1-420eeaf53e4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:35:38.339117 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd1d4ab-acba-4b0e-a8b1-420eeaf53e4a admin admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:35:38.339418 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd1d4ab-acba-4b0e-a8b1-420eeaf53e4a admin admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:35:38.340075 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd1d4ab-acba-4b0e-a8b1-420eeaf53e4a admin admin] PATH_INFO: `/v3/roles` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:35:38.340932 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd1d4ab-acba-4b0e-a8b1-420eeaf53e4a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:35:38.342842 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd1d4ab-acba-4b0e-a8b1-420eeaf53e4a admin admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:35:38.381967 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 878/1735] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 10 05:35:38 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 05:35:38.383870 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd1d4ab-acba-4b0e-a8b1-420eeaf53e4a admin admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:35:38.406573 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd1d4ab-acba-4b0e-a8b1-420eeaf53e4a admin admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:35:38.423867 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d22949d-197d-43d2-ad32-c736f2def1fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:35:38.424778 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d22949d-197d-43d2-ad32-c736f2def1fa admin admin] REQUEST_METHOD: `PUT` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:35:38.425069 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d22949d-197d-43d2-ad32-c736f2def1fa admin admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:35:38.425369 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d22949d-197d-43d2-ad32-c736f2def1fa admin admin] PATH_INFO: `/v3/projects/7144f72dbd3e43ea94bedc38abb35892/users/dc7d2ddacd1e495ebc53dfdcb43cc179/roles/382636e67fc142a2b2f486340d959e11` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:35:38.484659 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d22949d-197d-43d2-ad32-c736f2def1fa admin admin] RBAC: Authorizing `identity:create_grant(project_id=7144f72dbd3e43ea94bedc38abb35892, user_id=dc7d2ddacd1e495ebc53dfdcb43cc179, role_id=382636e67fc142a2b2f486340d959e11)` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:35:38.502565 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d22949d-197d-43d2-ad32-c736f2def1fa admin admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:35:38.546845 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 858/1737] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 10 05:35:38 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 493 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 05:35:38.549375 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 879/1737] 10.222.0.23 () {60 vars in 1482 bytes} [Tue May 10 05:35:38 2022] PUT /identity/v3/projects/7144f72dbd3e43ea94bedc38abb35892/users/dc7d2ddacd1e495ebc53dfdcb43cc179/roles/382636e67fc142a2b2f486340d959e11 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 05:35:38.550638 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74de61e-c77c-4dc7-a14c-3f01486f2a40 None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:35:38.551065 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74de61e-c77c-4dc7-a14c-3f01486f2a40 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:35:38.551348 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74de61e-c77c-4dc7-a14c-3f01486f2a40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:35:38.569573 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d22949d-197d-43d2-ad32-c736f2def1fa admin admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:35:38.573952 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-4d22949d-197d-43d2-ad32-c736f2def1fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:35:38.659214 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-a74de61e-c77c-4dc7-a14c-3f01486f2a40 None None] MFA Rules not processed for user `dc7d2ddacd1e495ebc53dfdcb43cc179`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:35:38.665920 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-a74de61e-c77c-4dc7-a14c-3f01486f2a40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:35:38.727501 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d22949d-197d-43d2-ad32-c736f2def1fa admin admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:35:38.732184 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700434fe-367a-4957-b61b-941a3b1285d1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355be413675540a39ccb00e1a0722316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f23435f783540199d6dcfd0417c090e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:35:38.732970 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700434fe-367a-4957-b61b-941a3b1285d1 service cinder] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:35:38.733325 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700434fe-367a-4957-b61b-941a3b1285d1 service cinder] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:35:38.733604 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700434fe-367a-4957-b61b-941a3b1285d1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:35:38.857238 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700434fe-367a-4957-b61b-941a3b1285d1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:35:38.859051 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700434fe-367a-4957-b61b-941a3b1285d1 service cinder] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:35:38.869621 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 859/1738] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 10 05:35:38 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 319 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 05:35:38.870950 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74de61e-c77c-4dc7-a14c-3f01486f2a40 None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:35:38.890147 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 880/1739] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 10 05:35:38 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 05:35:39.080836 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74de61e-c77c-4dc7-a14c-3f01486f2a40 None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:35:39.096261 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a652107-1021-40c5-9e52-c99c18753972 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:35:39.097025 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a652107-1021-40c5-9e52-c99c18753972 admin admin] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:35:39.097376 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a652107-1021-40c5-9e52-c99c18753972 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:35:39.097715 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a652107-1021-40c5-9e52-c99c18753972 admin admin] PATH_INFO: `/v3/projects` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:35:39.098498 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a652107-1021-40c5-9e52-c99c18753972 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:35:39.100557 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a652107-1021-40c5-9e52-c99c18753972 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:35:39.189618 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 860/1740] 10.222.0.23 () {60 vars in 1152 bytes} [Tue May 10 05:35:38 2022] POST /identity/v3/projects => generated 375 bytes in 319 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 05:35:39.193289 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700434fe-367a-4957-b61b-941a3b1285d1 service cinder] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:35:39.210591 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700434fe-367a-4957-b61b-941a3b1285d1 service cinder] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:35:39.408790 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722f1ec0-1072-4bcb-8e4b-a9fbc852c4f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:35:39.410522 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722f1ec0-1072-4bcb-8e4b-a9fbc852c4f5 admin admin] REQUEST_METHOD: `POST` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:35:39.411043 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722f1ec0-1072-4bcb-8e4b-a9fbc852c4f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:35:39.411775 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722f1ec0-1072-4bcb-8e4b-a9fbc852c4f5 admin admin] PATH_INFO: `/v3/users` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:35:39.414118 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722f1ec0-1072-4bcb-8e4b-a9fbc852c4f5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:35:39.417999 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722f1ec0-1072-4bcb-8e4b-a9fbc852c4f5 admin admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:35:39.488428 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 881/1741] 10.222.0.23 () {60 vars in 1143 bytes} [Tue May 10 05:35:39 2022] POST /identity/v3/users => generated 294 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 05:35:39.489534 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a652107-1021-40c5-9e52-c99c18753972 admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:35:39.511816 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a652107-1021-40c5-9e52-c99c18753972 admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:35:39.525068 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31a70bb-a6d1-40f2-a895-d7607f3cf3e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:35:39.526927 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31a70bb-a6d1-40f2-a895-d7607f3cf3e3 admin admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:35:39.527284 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31a70bb-a6d1-40f2-a895-d7607f3cf3e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:35:39.527702 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31a70bb-a6d1-40f2-a895-d7607f3cf3e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:35:39.534380 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31a70bb-a6d1-40f2-a895-d7607f3cf3e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:35:39.540500 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31a70bb-a6d1-40f2-a895-d7607f3cf3e3 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:35:39.575615 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 861/1742] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 10 05:35:39 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 05:35:39.579090 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722f1ec0-1072-4bcb-8e4b-a9fbc852c4f5 admin admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:35:39.595519 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722f1ec0-1072-4bcb-8e4b-a9fbc852c4f5 admin admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:35:39.608724 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbc1426-c12d-4505-adfb-d83b2d074a36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:35:39.609887 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbc1426-c12d-4505-adfb-d83b2d074a36 admin admin] REQUEST_METHOD: `PUT` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:35:39.611937 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbc1426-c12d-4505-adfb-d83b2d074a36 admin admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:35:39.615999 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbc1426-c12d-4505-adfb-d83b2d074a36 admin admin] PATH_INFO: `/v3/projects/3abaef2566c045e2b62345ece6cb184c/users/3e3a46bf66904b47b502d955926ce2ab/roles/199ac1dd842441d7913c6ee89d8fbecc` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:35:39.653583 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbc1426-c12d-4505-adfb-d83b2d074a36 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3abaef2566c045e2b62345ece6cb184c, user_id=3e3a46bf66904b47b502d955926ce2ab, role_id=199ac1dd842441d7913c6ee89d8fbecc)` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:35:39.658170 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbc1426-c12d-4505-adfb-d83b2d074a36 admin admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:35:39.684356 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 882/1743] 10.222.0.23 () {60 vars in 1482 bytes} [Tue May 10 05:35:39 2022] PUT /identity/v3/projects/3abaef2566c045e2b62345ece6cb184c/users/3e3a46bf66904b47b502d955926ce2ab/roles/199ac1dd842441d7913c6ee89d8fbecc => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 05:35:39.688117 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31a70bb-a6d1-40f2-a895-d7607f3cf3e3 admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:35:39.731539 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31a70bb-a6d1-40f2-a895-d7607f3cf3e3 admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:35:39.842382 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9712784-4210-4558-8095-031bad47659e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:35:39.843756 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9712784-4210-4558-8095-031bad47659e admin admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:35:39.844443 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9712784-4210-4558-8095-031bad47659e admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:35:39.844821 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9712784-4210-4558-8095-031bad47659e admin admin] PATH_INFO: `/v3/roles` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:35:39.846568 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9712784-4210-4558-8095-031bad47659e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:35:39.848817 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9712784-4210-4558-8095-031bad47659e admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:35:39.883636 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 862/1744] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 10 05:35:39 2022] GET /identity/v3/roles => generated 1420 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 05:35:39.890684 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbc1426-c12d-4505-adfb-d83b2d074a36 admin admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:35:39.914596 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbc1426-c12d-4505-adfb-d83b2d074a36 admin admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:35:39.938115 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58e967a-70a3-4847-a2c9-22ba6eeefe3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:35:39.939314 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58e967a-70a3-4847-a2c9-22ba6eeefe3b admin admin] REQUEST_METHOD: `PUT` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:35:39.939823 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58e967a-70a3-4847-a2c9-22ba6eeefe3b admin admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:35:39.940230 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58e967a-70a3-4847-a2c9-22ba6eeefe3b admin admin] PATH_INFO: `/v3/projects/3abaef2566c045e2b62345ece6cb184c/users/3e3a46bf66904b47b502d955926ce2ab/roles/199ac1dd842441d7913c6ee89d8fbecc` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:35:39.943024 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58e967a-70a3-4847-a2c9-22ba6eeefe3b admin admin] RBAC: Authorizing `identity:create_grant(project_id=3abaef2566c045e2b62345ece6cb184c, user_id=3e3a46bf66904b47b502d955926ce2ab, role_id=199ac1dd842441d7913c6ee89d8fbecc)` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:35:39.947202 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58e967a-70a3-4847-a2c9-22ba6eeefe3b admin admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:35:39.978851 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9712784-4210-4558-8095-031bad47659e admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:35:39.984196 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-c9712784-4210-4558-8095-031bad47659e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:35:39.986980 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 883/1745] 10.222.0.23 () {60 vars in 1482 bytes} [Tue May 10 05:35:39 2022] PUT /identity/v3/projects/3abaef2566c045e2b62345ece6cb184c/users/3e3a46bf66904b47b502d955926ce2ab/roles/199ac1dd842441d7913c6ee89d8fbecc => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 05:35:40.000423 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5aeb63-22f8-45a3-9d05-c2efea96ea57 None None] REQUEST_METHOD: `POST` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:35:40.001333 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5aeb63-22f8-45a3-9d05-c2efea96ea57 None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:35:40.001734 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5aeb63-22f8-45a3-9d05-c2efea96ea57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:35:40.114630 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.auth.core [None req-9c5aeb63-22f8-45a3-9d05-c2efea96ea57 None None] MFA Rules not processed for user `3e3a46bf66904b47b502d955926ce2ab`. Rule list: `[]` (Enabled: `True`). {{(pid=79879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:35:40.116153 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-9c5aeb63-22f8-45a3-9d05-c2efea96ea57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:35:40.179468 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9712784-4210-4558-8095-031bad47659e admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:35:40.310185 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 884/1746] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 10 05:35:39 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 314 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 05:35:40.325047 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5aeb63-22f8-45a3-9d05-c2efea96ea57 None None] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:35:40.326502 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62593936-7a3f-476e-a11d-060a0db7f03c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355be413675540a39ccb00e1a0722316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f23435f783540199d6dcfd0417c090e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:35:40.329261 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62593936-7a3f-476e-a11d-060a0db7f03c service cinder] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:35:40.334639 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62593936-7a3f-476e-a11d-060a0db7f03c service cinder] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:35:40.337589 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62593936-7a3f-476e-a11d-060a0db7f03c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:35:40.342640 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-62593936-7a3f-476e-a11d-060a0db7f03c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:35:40.344479 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5aeb63-22f8-45a3-9d05-c2efea96ea57 None None] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:35:40.354304 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95abb1b9-db34-4dab-a32c-de87d76f65fb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355be413675540a39ccb00e1a0722316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f23435f783540199d6dcfd0417c090e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:35:40.355145 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95abb1b9-db34-4dab-a32c-de87d76f65fb service cinder] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:35:40.355408 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95abb1b9-db34-4dab-a32c-de87d76f65fb service cinder] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:35:40.355741 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95abb1b9-db34-4dab-a32c-de87d76f65fb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:35:40.593611 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62593936-7a3f-476e-a11d-060a0db7f03c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:35:40.605560 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62593936-7a3f-476e-a11d-060a0db7f03c service cinder] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:35:40.630398 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 863/1747] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 10 05:35:39 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 652 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 05:35:40.631509 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62593936-7a3f-476e-a11d-060a0db7f03c service cinder] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:35:40.633137 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-62593936-7a3f-476e-a11d-060a0db7f03c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:35:40.653017 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95abb1b9-db34-4dab-a32c-de87d76f65fb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:35:40.662715 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95abb1b9-db34-4dab-a32c-de87d76f65fb service cinder] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:35:40.720571 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 885/1748] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 10 05:35:40 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 05:35:40.958316 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62593936-7a3f-476e-a11d-060a0db7f03c service cinder] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:35:40.980359 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4ba870-fa2d-46b1-a58d-2b7f253e12b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:35:40.981474 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4ba870-fa2d-46b1-a58d-2b7f253e12b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:35:40.993352 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4ba870-fa2d-46b1-a58d-2b7f253e12b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:35:40.994393 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4ba870-fa2d-46b1-a58d-2b7f253e12b6 admin admin] PATH_INFO: `/v3/projects/98a7307423ff415b82a03968b17cb6c9` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:35:40.999174 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4ba870-fa2d-46b1-a58d-2b7f253e12b6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=98a7307423ff415b82a03968b17cb6c9)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:35:41.004510 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4ba870-fa2d-46b1-a58d-2b7f253e12b6 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:35:41.220530 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-0d4ba870-fa2d-46b1-a58d-2b7f253e12b6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '98a7307423ff415b82a03968b17cb6c9', 'request_id': 'req-0d4ba870-fa2d-46b1-a58d-2b7f253e12b6'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:35:41.252622 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-0d4ba870-fa2d-46b1-a58d-2b7f253e12b6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '98a7307423ff415b82a03968b17cb6c9', 'request_id': 'req-0d4ba870-fa2d-46b1-a58d-2b7f253e12b6'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:35:41.282434 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-0d4ba870-fa2d-46b1-a58d-2b7f253e12b6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '98a7307423ff415b82a03968b17cb6c9', 'request_id': 'req-0d4ba870-fa2d-46b1-a58d-2b7f253e12b6'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:35:41.311516 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-0d4ba870-fa2d-46b1-a58d-2b7f253e12b6 admin admin] The token cache is being invalidate because project 98a7307423ff415b82a03968b17cb6c9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79880) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 05:35:41.311830 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-0d4ba870-fa2d-46b1-a58d-2b7f253e12b6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:35:41.315876 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-0d4ba870-fa2d-46b1-a58d-2b7f253e12b6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:35:41.331279 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 864/1749] 10.222.0.23 () {58 vars in 1232 bytes} [Tue May 10 05:35:40 2022] DELETE /identity/v3/projects/98a7307423ff415b82a03968b17cb6c9 => generated 0 bytes in 700 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 05:35:41.337671 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95abb1b9-db34-4dab-a32c-de87d76f65fb service cinder] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:35:41.351655 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95abb1b9-db34-4dab-a32c-de87d76f65fb service cinder] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:35:41.654976 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7728710-25cf-436b-a1b2-369adcc5bd33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:35:41.656737 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7728710-25cf-436b-a1b2-369adcc5bd33 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:35:41.663975 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7728710-25cf-436b-a1b2-369adcc5bd33 admin admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:35:41.668704 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7728710-25cf-436b-a1b2-369adcc5bd33 admin admin] PATH_INFO: `/v3/users/b97cdc7b19c049c8b1fe23ef986c16d3` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:35:41.674737 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7728710-25cf-436b-a1b2-369adcc5bd33 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b97cdc7b19c049c8b1fe23ef986c16d3)` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:35:41.686022 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7728710-25cf-436b-a1b2-369adcc5bd33 admin admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:35:41.867770 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-d7728710-25cf-436b-a1b2-369adcc5bd33 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b97cdc7b19c049c8b1fe23ef986c16d3'} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:35:41.886641 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-d7728710-25cf-436b-a1b2-369adcc5bd33 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b97cdc7b19c049c8b1fe23ef986c16d3'} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:35:41.887690 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-d7728710-25cf-436b-a1b2-369adcc5bd33 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b97cdc7b19c049c8b1fe23ef986c16d3'} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:35:41.926627 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-d7728710-25cf-436b-a1b2-369adcc5bd33 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b97cdc7b19c049c8b1fe23ef986c16d3'} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:35:41.943856 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-d7728710-25cf-436b-a1b2-369adcc5bd33 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b97cdc7b19c049c8b1fe23ef986c16d3'} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:35:41.962042 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 886/1750] 10.222.0.23 () {58 vars in 1223 bytes} [Tue May 10 05:35:41 2022] DELETE /identity/v3/users/b97cdc7b19c049c8b1fe23ef986c16d3 => generated 0 bytes in 622 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 05:35:42.101970 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5315b06-18a3-446c-90e7-7ee258a7c4c1 None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:35:42.103164 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5315b06-18a3-446c-90e7-7ee258a7c4c1 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:35:42.104172 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5315b06-18a3-446c-90e7-7ee258a7c4c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:35:42.234367 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-f5315b06-18a3-446c-90e7-7ee258a7c4c1 None None] MFA Rules not processed for user `e5fab64aea894e96ac8eb44a4a531eb5`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:35:42.250545 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-f5315b06-18a3-446c-90e7-7ee258a7c4c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:35:42.570065 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 865/1751] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 10 05:35:42 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 468 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 05:35:42.572854 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7728710-25cf-436b-a1b2-369adcc5bd33 admin admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:35:42.574440 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-d7728710-25cf-436b-a1b2-369adcc5bd33 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:35:42.742379 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7728710-25cf-436b-a1b2-369adcc5bd33 admin admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:35:42.751118 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0c6ab5-987d-4cf8-a97d-eb0d6464bf19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:35:42.752213 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0c6ab5-987d-4cf8-a97d-eb0d6464bf19 admin admin] REQUEST_METHOD: `POST` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:35:42.752647 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0c6ab5-987d-4cf8-a97d-eb0d6464bf19 admin admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:35:42.753700 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0c6ab5-987d-4cf8-a97d-eb0d6464bf19 admin admin] PATH_INFO: `/v3/projects` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:35:42.754833 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0c6ab5-987d-4cf8-a97d-eb0d6464bf19 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:35:42.762123 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0c6ab5-987d-4cf8-a97d-eb0d6464bf19 admin admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:35:42.832814 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5315b06-18a3-446c-90e7-7ee258a7c4c1 None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:35:42.833758 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 887/1752] 10.222.0.23 () {60 vars in 1152 bytes} [Tue May 10 05:35:42 2022] POST /identity/v3/projects => generated 405 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 05:35:42.845422 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5315b06-18a3-446c-90e7-7ee258a7c4c1 None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:35:42.988827 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c473ff0-505d-42ab-ae2a-f2bd35002cff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:35:42.999719 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c473ff0-505d-42ab-ae2a-f2bd35002cff admin admin] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:35:42.999719 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c473ff0-505d-42ab-ae2a-f2bd35002cff admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:35:42.999719 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c473ff0-505d-42ab-ae2a-f2bd35002cff admin admin] PATH_INFO: `/v3/users` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:35:42.999719 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c473ff0-505d-42ab-ae2a-f2bd35002cff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:35:43.000340 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c473ff0-505d-42ab-ae2a-f2bd35002cff admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:35:43.047046 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 866/1753] 10.222.0.23 () {60 vars in 1143 bytes} [Tue May 10 05:35:42 2022] POST /identity/v3/users => generated 309 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 05:35:43.048344 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0c6ab5-987d-4cf8-a97d-eb0d6464bf19 admin admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:35:43.064036 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0c6ab5-987d-4cf8-a97d-eb0d6464bf19 admin admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:35:43.078334 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d6377e-8a78-424c-8504-7bbac6ac6f58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:35:43.079121 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d6377e-8a78-424c-8504-7bbac6ac6f58 admin admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:35:43.079409 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d6377e-8a78-424c-8504-7bbac6ac6f58 admin admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:35:43.079751 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d6377e-8a78-424c-8504-7bbac6ac6f58 admin admin] PATH_INFO: `/v3/roles` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:35:43.086232 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d6377e-8a78-424c-8504-7bbac6ac6f58 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:35:43.088345 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d6377e-8a78-424c-8504-7bbac6ac6f58 admin admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:35:43.114821 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c473ff0-505d-42ab-ae2a-f2bd35002cff admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:35:43.126795 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c473ff0-505d-42ab-ae2a-f2bd35002cff admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:35:43.129197 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 888/1754] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 10 05:35:43 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 05:35:43.150823 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e38b27-86e9-485a-acde-fc699436a20f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:35:43.152045 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e38b27-86e9-485a-acde-fc699436a20f admin admin] REQUEST_METHOD: `PUT` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:35:43.152996 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e38b27-86e9-485a-acde-fc699436a20f admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:35:43.154066 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e38b27-86e9-485a-acde-fc699436a20f admin admin] PATH_INFO: `/v3/projects/06d3be9b601241c9bb9ebcfdc8148f82/users/828789daf7cd4761b10c32995944b848/roles/199ac1dd842441d7913c6ee89d8fbecc` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:35:43.197217 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e38b27-86e9-485a-acde-fc699436a20f admin admin] RBAC: Authorizing `identity:create_grant(project_id=06d3be9b601241c9bb9ebcfdc8148f82, user_id=828789daf7cd4761b10c32995944b848, role_id=199ac1dd842441d7913c6ee89d8fbecc)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:35:43.202467 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e38b27-86e9-485a-acde-fc699436a20f admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:35:43.256384 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 867/1755] 10.222.0.23 () {60 vars in 1482 bytes} [Tue May 10 05:35:43 2022] PUT /identity/v3/projects/06d3be9b601241c9bb9ebcfdc8148f82/users/828789daf7cd4761b10c32995944b848/roles/199ac1dd842441d7913c6ee89d8fbecc => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 05:35:43.257778 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d6377e-8a78-424c-8504-7bbac6ac6f58 admin admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:35:43.259787 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-b0d6377e-8a78-424c-8504-7bbac6ac6f58 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:35:43.262219 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e38b27-86e9-485a-acde-fc699436a20f admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:35:43.303670 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d6377e-8a78-424c-8504-7bbac6ac6f58 admin admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:35:43.568837 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef6bbcd-c67f-465a-bd9c-01fdd796ad98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:35:43.568837 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef6bbcd-c67f-465a-bd9c-01fdd796ad98 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:35:43.574477 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef6bbcd-c67f-465a-bd9c-01fdd796ad98 admin admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:35:43.575419 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef6bbcd-c67f-465a-bd9c-01fdd796ad98 admin admin] PATH_INFO: `/v3/projects/0143eaf3ed9c4e079a010035ab06ede9` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:35:43.583453 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef6bbcd-c67f-465a-bd9c-01fdd796ad98 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0143eaf3ed9c4e079a010035ab06ede9)` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:35:43.588398 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef6bbcd-c67f-465a-bd9c-01fdd796ad98 admin admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:35:43.783641 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-0ef6bbcd-c67f-465a-bd9c-01fdd796ad98 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0143eaf3ed9c4e079a010035ab06ede9', 'request_id': 'req-0ef6bbcd-c67f-465a-bd9c-01fdd796ad98'} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:35:43.840430 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-0ef6bbcd-c67f-465a-bd9c-01fdd796ad98 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0143eaf3ed9c4e079a010035ab06ede9', 'request_id': 'req-0ef6bbcd-c67f-465a-bd9c-01fdd796ad98'} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:35:43.888121 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-0ef6bbcd-c67f-465a-bd9c-01fdd796ad98 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0143eaf3ed9c4e079a010035ab06ede9', 'request_id': 'req-0ef6bbcd-c67f-465a-bd9c-01fdd796ad98'} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:35:43.888292 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e38b27-86e9-485a-acde-fc699436a20f admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:35:43.922397 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-0ef6bbcd-c67f-465a-bd9c-01fdd796ad98 admin admin] The token cache is being invalidate because project 0143eaf3ed9c4e079a010035ab06ede9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79879) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 05:35:43.922882 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-0ef6bbcd-c67f-465a-bd9c-01fdd796ad98 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:35:43.923906 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-0ef6bbcd-c67f-465a-bd9c-01fdd796ad98 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:35:43.925970 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 889/1756] 10.222.0.23 () {58 vars in 1232 bytes} [Tue May 10 05:35:43 2022] DELETE /identity/v3/projects/0143eaf3ed9c4e079a010035ab06ede9 => generated 0 bytes in 669 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 05:35:43.931163 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76945058-69ff-47a3-bf8f-89137c720206 None None] REQUEST_METHOD: `POST` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:35:43.936168 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76945058-69ff-47a3-bf8f-89137c720206 None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:35:43.936612 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76945058-69ff-47a3-bf8f-89137c720206 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:35:43.981082 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.auth.core [None req-76945058-69ff-47a3-bf8f-89137c720206 None None] MFA Rules not processed for user `44883b22532e44049d846938dc2cf423`. Rule list: `[]` (Enabled: `True`). {{(pid=79879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:35:43.982571 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-76945058-69ff-47a3-bf8f-89137c720206 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:35:44.100088 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8dfafa4-8c79-4f84-8455-423b935a0b81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:35:44.100317 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dfafa4-8c79-4f84-8455-423b935a0b81 admin admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:35:44.100686 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dfafa4-8c79-4f84-8455-423b935a0b81 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:35:44.100974 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dfafa4-8c79-4f84-8455-423b935a0b81 admin admin] PATH_INFO: `/v3/roles` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:35:44.101771 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8dfafa4-8c79-4f84-8455-423b935a0b81 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:35:44.118617 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8dfafa4-8c79-4f84-8455-423b935a0b81 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:35:44.126096 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 890/1757] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 10 05:35:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 05:35:44.128062 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092781a9-dbb6-460b-86c0-ebb7dc62cdbc None None] REQUEST_METHOD: `POST` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:35:44.128447 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092781a9-dbb6-460b-86c0-ebb7dc62cdbc None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:35:44.129554 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092781a9-dbb6-460b-86c0-ebb7dc62cdbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:35:44.185109 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 868/1758] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 10 05:35:43 2022] GET /identity/v3/roles => generated 1420 bytes in 906 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 05:35:44.187806 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b0a455-f0ab-4d07-8cc2-1ca4d3d30abc None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:35:44.190399 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b0a455-f0ab-4d07-8cc2-1ca4d3d30abc None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:35:44.191793 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b0a455-f0ab-4d07-8cc2-1ca4d3d30abc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:35:44.204516 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.auth.core [None req-092781a9-dbb6-460b-86c0-ebb7dc62cdbc None None] MFA Rules not processed for user `5fd529982ab24820826d466e4d13a07d`. Rule list: `[]` (Enabled: `True`). {{(pid=79879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:35:44.206115 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-092781a9-dbb6-460b-86c0-ebb7dc62cdbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:35:44.264661 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-42b0a455-f0ab-4d07-8cc2-1ca4d3d30abc None None] MFA Rules not processed for user `44883b22532e44049d846938dc2cf423`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:35:44.278756 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-42b0a455-f0ab-4d07-8cc2-1ca4d3d30abc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:35:44.303344 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 869/1759] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 10 05:35:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 05:35:44.304465 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b0a455-f0ab-4d07-8cc2-1ca4d3d30abc None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:35:44.307283 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-42b0a455-f0ab-4d07-8cc2-1ca4d3d30abc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:35:44.311936 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 891/1760] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 10 05:35:44 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 05:35:44.312746 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092781a9-dbb6-460b-86c0-ebb7dc62cdbc None None] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:35:44.330730 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092781a9-dbb6-460b-86c0-ebb7dc62cdbc None None] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:35:44.332964 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b0a455-f0ab-4d07-8cc2-1ca4d3d30abc None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:35:44.336810 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df24fbed-fe83-4dcd-b234-85c772503c8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:35:44.337754 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df24fbed-fe83-4dcd-b234-85c772503c8d admin admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:35:44.338001 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0241e5cd-8b4b-4b2e-8c83-50ca17520036 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:35:44.338476 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df24fbed-fe83-4dcd-b234-85c772503c8d admin admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:35:44.338905 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0241e5cd-8b4b-4b2e-8c83-50ca17520036 admin admin] REQUEST_METHOD: `PUT` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:35:44.339137 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df24fbed-fe83-4dcd-b234-85c772503c8d admin admin] PATH_INFO: `/v3/domains` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:35:44.339241 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0241e5cd-8b4b-4b2e-8c83-50ca17520036 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:35:44.339452 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0241e5cd-8b4b-4b2e-8c83-50ca17520036 admin admin] PATH_INFO: `/v3/projects/06d3be9b601241c9bb9ebcfdc8148f82/users/828789daf7cd4761b10c32995944b848/roles/199ac1dd842441d7913c6ee89d8fbecc` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:35:44.340384 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df24fbed-fe83-4dcd-b234-85c772503c8d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:35:44.340904 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df24fbed-fe83-4dcd-b234-85c772503c8d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:35:44.341484 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0241e5cd-8b4b-4b2e-8c83-50ca17520036 admin admin] RBAC: Authorizing `identity:create_grant(project_id=06d3be9b601241c9bb9ebcfdc8148f82, user_id=828789daf7cd4761b10c32995944b848, role_id=199ac1dd842441d7913c6ee89d8fbecc)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:35:44.342957 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df24fbed-fe83-4dcd-b234-85c772503c8d admin admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:35:44.344158 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0241e5cd-8b4b-4b2e-8c83-50ca17520036 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:35:44.355426 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 870/1761] 10.222.0.23 () {60 vars in 1482 bytes} [Tue May 10 05:35:44 2022] PUT /identity/v3/projects/06d3be9b601241c9bb9ebcfdc8148f82/users/828789daf7cd4761b10c32995944b848/roles/199ac1dd842441d7913c6ee89d8fbecc => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 05:35:44.356323 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0241e5cd-8b4b-4b2e-8c83-50ca17520036 admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:35:44.356630 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 892/1762] 10.222.0.23 () {58 vars in 1152 bytes} [Tue May 10 05:35:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:35:44.360911 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df24fbed-fe83-4dcd-b234-85c772503c8d admin admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:35:44.363085 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-0241e5cd-8b4b-4b2e-8c83-50ca17520036 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:35:44.390412 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df24fbed-fe83-4dcd-b234-85c772503c8d admin admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:35:44.547457 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0241e5cd-8b4b-4b2e-8c83-50ca17520036 admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:35:44.555744 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346817df-03b7-4fe4-bf11-48367ad29357 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f50f224ca944983aecfde86375473da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f23435f783540199d6dcfd0417c090e', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:35:44.556746 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346817df-03b7-4fe4-bf11-48367ad29357 service nova] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:35:44.557751 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346817df-03b7-4fe4-bf11-48367ad29357 service nova] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:35:44.558548 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346817df-03b7-4fe4-bf11-48367ad29357 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:35:44.608150 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be12c6f5-c349-45d7-a1ec-c22854fb415e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:35:44.608844 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be12c6f5-c349-45d7-a1ec-c22854fb415e admin admin] REQUEST_METHOD: `POST` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:35:44.612299 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be12c6f5-c349-45d7-a1ec-c22854fb415e admin admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:35:44.615761 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be12c6f5-c349-45d7-a1ec-c22854fb415e admin admin] PATH_INFO: `/v3/projects` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:35:44.616730 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be12c6f5-c349-45d7-a1ec-c22854fb415e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:35:44.623502 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be12c6f5-c349-45d7-a1ec-c22854fb415e admin admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:35:44.692608 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 893/1763] 10.222.0.23 () {60 vars in 1152 bytes} [Tue May 10 05:35:44 2022] POST /identity/v3/projects => generated 385 bytes in 332 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 05:35:44.694360 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346817df-03b7-4fe4-bf11-48367ad29357 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:35:44.695101 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be12c6f5-c349-45d7-a1ec-c22854fb415e admin admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:35:44.697953 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346817df-03b7-4fe4-bf11-48367ad29357 service nova] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:35:44.720900 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 871/1764] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 10 05:35:44 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 05:35:44.848269 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be12c6f5-c349-45d7-a1ec-c22854fb415e admin admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:35:44.862145 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d8760a-6029-4a3a-854d-990fc8060151 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:35:44.862838 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d8760a-6029-4a3a-854d-990fc8060151 admin admin] REQUEST_METHOD: `POST` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:35:44.863276 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d8760a-6029-4a3a-854d-990fc8060151 admin admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:35:44.863741 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d8760a-6029-4a3a-854d-990fc8060151 admin admin] PATH_INFO: `/v3/users` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:35:44.864616 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d8760a-6029-4a3a-854d-990fc8060151 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:35:44.866711 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d8760a-6029-4a3a-854d-990fc8060151 admin admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:35:44.908500 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 894/1765] 10.222.0.23 () {60 vars in 1143 bytes} [Tue May 10 05:35:44 2022] POST /identity/v3/users => generated 293 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 05:35:44.913078 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346817df-03b7-4fe4-bf11-48367ad29357 service nova] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:35:44.930249 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346817df-03b7-4fe4-bf11-48367ad29357 service nova] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:35:44.951190 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734281ad-60e2-44af-a7a9-3aebf560a812 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:35:44.952141 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734281ad-60e2-44af-a7a9-3aebf560a812 admin admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:35:44.954862 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734281ad-60e2-44af-a7a9-3aebf560a812 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:35:44.955265 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734281ad-60e2-44af-a7a9-3aebf560a812 admin admin] PATH_INFO: `/v3/roles` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:35:44.961658 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734281ad-60e2-44af-a7a9-3aebf560a812 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:35:44.963408 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734281ad-60e2-44af-a7a9-3aebf560a812 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:35:45.000091 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca9ad28-8cc5-47d9-a082-0c736370f00b None None] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:35:45.000638 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca9ad28-8cc5-47d9-a082-0c736370f00b None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:35:45.001151 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca9ad28-8cc5-47d9-a082-0c736370f00b None None] PATH_INFO: `/` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:35:45.004457 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 895/1766] 10.222.0.23 () {54 vars in 921 bytes} [Tue May 10 05:35:44 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 05:35:45.024977 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 872/1767] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 10 05:35:44 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 05:35:45.029155 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca9ad28-8cc5-47d9-a082-0c736370f00b None None] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:35:45.057072 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca9ad28-8cc5-47d9-a082-0c736370f00b None None] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:35:45.069053 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140a2f5a-c77a-449f-bb2c-d175da87df35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:35:45.083598 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140a2f5a-c77a-449f-bb2c-d175da87df35 admin admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:35:45.084785 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140a2f5a-c77a-449f-bb2c-d175da87df35 admin admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:35:45.085927 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140a2f5a-c77a-449f-bb2c-d175da87df35 admin admin] PATH_INFO: `/v3/roles` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:35:45.088498 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140a2f5a-c77a-449f-bb2c-d175da87df35 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:35:45.091853 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140a2f5a-c77a-449f-bb2c-d175da87df35 admin admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:35:45.098614 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac3307c-a9d5-4233-8daf-4d6d906f44af None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:35:45.099047 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac3307c-a9d5-4233-8daf-4d6d906f44af None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:35:45.099509 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac3307c-a9d5-4233-8daf-4d6d906f44af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:35:45.119425 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 896/1768] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 10 05:35:45 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 05:35:45.123820 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140a2f5a-c77a-449f-bb2c-d175da87df35 admin admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:35:45.138691 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-8ac3307c-a9d5-4233-8daf-4d6d906f44af None None] MFA Rules not processed for user `7f50f224ca944983aecfde86375473da`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:35:45.140239 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-8ac3307c-a9d5-4233-8daf-4d6d906f44af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:35:45.144961 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140a2f5a-c77a-449f-bb2c-d175da87df35 admin admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:35:45.171656 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22789422-f0cb-46cd-aa39-7745b0c27fd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:35:45.173645 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22789422-f0cb-46cd-aa39-7745b0c27fd1 admin admin] REQUEST_METHOD: `PUT` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:35:45.173930 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22789422-f0cb-46cd-aa39-7745b0c27fd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:35:45.174210 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22789422-f0cb-46cd-aa39-7745b0c27fd1 admin admin] PATH_INFO: `/v3/projects/791e63489bcb47a99b6df16e41c84ad9/users/fb49312656f74cd691135376a2db7a10/roles/382636e67fc142a2b2f486340d959e11` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:35:45.223002 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22789422-f0cb-46cd-aa39-7745b0c27fd1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=791e63489bcb47a99b6df16e41c84ad9, user_id=fb49312656f74cd691135376a2db7a10, role_id=382636e67fc142a2b2f486340d959e11)` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:35:45.226020 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22789422-f0cb-46cd-aa39-7745b0c27fd1 admin admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:35:45.264550 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 897/1769] 10.222.0.23 () {60 vars in 1482 bytes} [Tue May 10 05:35:45 2022] PUT /identity/v3/projects/791e63489bcb47a99b6df16e41c84ad9/users/fb49312656f74cd691135376a2db7a10/roles/382636e67fc142a2b2f486340d959e11 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 05:35:45.266049 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2a42a7-1faf-46c9-a070-57d5cbaaa1ab None None] REQUEST_METHOD: `POST` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:35:45.266409 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2a42a7-1faf-46c9-a070-57d5cbaaa1ab None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:35:45.266693 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2a42a7-1faf-46c9-a070-57d5cbaaa1ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:35:45.274920 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 873/1770] 10.222.0.23 () {58 vars in 1018 bytes} [Tue May 10 05:35:45 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 05:35:45.276403 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4998d1aa-ded2-4113-bdae-407d22a10bdb None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:35:45.276694 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4998d1aa-ded2-4113-bdae-407d22a10bdb None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:35:45.276994 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4998d1aa-ded2-4113-bdae-407d22a10bdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:35:45.313293 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.auth.core [None req-ee2a42a7-1faf-46c9-a070-57d5cbaaa1ab None None] MFA Rules not processed for user `1fa3b659464a49ef863e2e398aadf22a`. Rule list: `[]` (Enabled: `True`). {{(pid=79879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:35:45.314519 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-ee2a42a7-1faf-46c9-a070-57d5cbaaa1ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:35:45.335389 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-4998d1aa-ded2-4113-bdae-407d22a10bdb None None] MFA Rules not processed for user `fb49312656f74cd691135376a2db7a10`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:35:45.337095 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-4998d1aa-ded2-4113-bdae-407d22a10bdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:35:45.458386 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 874/1771] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 10 05:35:45 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 05:35:45.459238 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4998d1aa-ded2-4113-bdae-407d22a10bdb None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:35:45.483544 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 898/1772] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 10 05:35:45 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 05:35:45.484898 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2a42a7-1faf-46c9-a070-57d5cbaaa1ab None None] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:35:45.638240 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2a42a7-1faf-46c9-a070-57d5cbaaa1ab None None] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:35:45.653446 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4998d1aa-ded2-4113-bdae-407d22a10bdb None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:35:45.666789 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ec1a27-d07c-419c-a34e-f6e5125a3bbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:35:45.669099 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ec1a27-d07c-419c-a34e-f6e5125a3bbe admin admin] REQUEST_METHOD: `POST` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:35:45.670987 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ec1a27-d07c-419c-a34e-f6e5125a3bbe admin admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:35:45.671418 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ec1a27-d07c-419c-a34e-f6e5125a3bbe admin admin] PATH_INFO: `/v3/projects` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:35:45.674346 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ec1a27-d07c-419c-a34e-f6e5125a3bbe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:35:45.675134 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20dce2e-e682-4fc1-b29f-95a65b939058 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f50f224ca944983aecfde86375473da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f23435f783540199d6dcfd0417c090e', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:35:45.677271 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20dce2e-e682-4fc1-b29f-95a65b939058 service nova] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:35:45.678682 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ec1a27-d07c-419c-a34e-f6e5125a3bbe admin admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:35:45.679115 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20dce2e-e682-4fc1-b29f-95a65b939058 service nova] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:35:45.680282 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20dce2e-e682-4fc1-b29f-95a65b939058 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:35:45.702968 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20dce2e-e682-4fc1-b29f-95a65b939058 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:35:45.707662 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20dce2e-e682-4fc1-b29f-95a65b939058 service nova] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:35:45.723237 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 875/1773] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 10 05:35:45 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 264 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 05:35:45.735617 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 899/1774] 10.222.0.23 () {60 vars in 1152 bytes} [Tue May 10 05:35:45 2022] POST /identity/v3/projects => generated 385 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 05:35:45.738361 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20dce2e-e682-4fc1-b29f-95a65b939058 service nova] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:35:45.761322 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20dce2e-e682-4fc1-b29f-95a65b939058 service nova] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:35:45.837054 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abf1c56-deb2-4995-a9e4-eede7ab197e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:35:45.837759 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abf1c56-deb2-4995-a9e4-eede7ab197e2 admin admin] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:35:45.838136 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abf1c56-deb2-4995-a9e4-eede7ab197e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:35:45.838512 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abf1c56-deb2-4995-a9e4-eede7ab197e2 admin admin] PATH_INFO: `/v3/users` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:35:45.839375 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abf1c56-deb2-4995-a9e4-eede7ab197e2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:35:45.841915 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abf1c56-deb2-4995-a9e4-eede7ab197e2 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:35:45.873434 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 876/1775] 10.222.0.23 () {60 vars in 1143 bytes} [Tue May 10 05:35:45 2022] POST /identity/v3/users => generated 299 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 05:35:45.878130 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ec1a27-d07c-419c-a34e-f6e5125a3bbe admin admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:35:45.902553 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ec1a27-d07c-419c-a34e-f6e5125a3bbe admin admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:35:45.908956 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907f3cf8-2cf6-481d-9a21-93556afc29f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:35:45.909887 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907f3cf8-2cf6-481d-9a21-93556afc29f1 admin admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:35:45.910280 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907f3cf8-2cf6-481d-9a21-93556afc29f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:35:45.910839 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907f3cf8-2cf6-481d-9a21-93556afc29f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:35:45.911296 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907f3cf8-2cf6-481d-9a21-93556afc29f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:35:45.914281 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907f3cf8-2cf6-481d-9a21-93556afc29f1 admin admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:35:45.934890 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abf1c56-deb2-4995-a9e4-eede7ab197e2 admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:35:45.948661 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abf1c56-deb2-4995-a9e4-eede7ab197e2 admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:35:45.949428 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 900/1776] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 10 05:35:45 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 05:35:45.954282 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76322b82-2eb5-4e01-a833-47ab8aab3d84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:35:45.955541 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76322b82-2eb5-4e01-a833-47ab8aab3d84 admin admin] REQUEST_METHOD: `PUT` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:35:45.956385 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76322b82-2eb5-4e01-a833-47ab8aab3d84 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:35:45.956670 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76322b82-2eb5-4e01-a833-47ab8aab3d84 admin admin] PATH_INFO: `/v3/projects/60717d8e8e804e5691ece7530732b4e1/users/8725d9b96ef843aa9d0f53b9c615a57e/roles/199ac1dd842441d7913c6ee89d8fbecc` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:35:45.977647 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76322b82-2eb5-4e01-a833-47ab8aab3d84 admin admin] RBAC: Authorizing `identity:create_grant(project_id=60717d8e8e804e5691ece7530732b4e1, user_id=8725d9b96ef843aa9d0f53b9c615a57e, role_id=199ac1dd842441d7913c6ee89d8fbecc)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:35:45.980813 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76322b82-2eb5-4e01-a833-47ab8aab3d84 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:35:46.011125 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 877/1777] 10.222.0.23 () {60 vars in 1482 bytes} [Tue May 10 05:35:45 2022] PUT /identity/v3/projects/60717d8e8e804e5691ece7530732b4e1/users/8725d9b96ef843aa9d0f53b9c615a57e/roles/199ac1dd842441d7913c6ee89d8fbecc => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 05:35:46.012484 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907f3cf8-2cf6-481d-9a21-93556afc29f1 admin admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:35:46.026779 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907f3cf8-2cf6-481d-9a21-93556afc29f1 admin admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:35:46.135603 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc4b725-1242-440f-bef0-f0d5b48e9185 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:35:46.136285 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc4b725-1242-440f-bef0-f0d5b48e9185 admin admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:35:46.136564 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc4b725-1242-440f-bef0-f0d5b48e9185 admin admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:35:46.137118 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc4b725-1242-440f-bef0-f0d5b48e9185 admin admin] PATH_INFO: `/v3/roles` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:35:46.137708 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc4b725-1242-440f-bef0-f0d5b48e9185 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:35:46.148641 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc4b725-1242-440f-bef0-f0d5b48e9185 admin admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:35:46.162168 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 901/1778] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 10 05:35:46 2022] GET /identity/v3/roles => generated 1420 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 05:35:46.165680 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76322b82-2eb5-4e01-a833-47ab8aab3d84 admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:35:46.196613 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76322b82-2eb5-4e01-a833-47ab8aab3d84 admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:35:46.207865 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0b9a8b-9a1c-4165-89e1-6f700f303d94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:35:46.208860 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0b9a8b-9a1c-4165-89e1-6f700f303d94 admin admin] REQUEST_METHOD: `PUT` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:35:46.209458 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0b9a8b-9a1c-4165-89e1-6f700f303d94 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:35:46.209703 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0b9a8b-9a1c-4165-89e1-6f700f303d94 admin admin] PATH_INFO: `/v3/projects/60717d8e8e804e5691ece7530732b4e1/users/8725d9b96ef843aa9d0f53b9c615a57e/roles/199ac1dd842441d7913c6ee89d8fbecc` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:35:46.212002 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0b9a8b-9a1c-4165-89e1-6f700f303d94 admin admin] RBAC: Authorizing `identity:create_grant(project_id=60717d8e8e804e5691ece7530732b4e1, user_id=8725d9b96ef843aa9d0f53b9c615a57e, role_id=199ac1dd842441d7913c6ee89d8fbecc)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:35:46.215741 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0b9a8b-9a1c-4165-89e1-6f700f303d94 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:35:46.237838 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 878/1779] 10.222.0.23 () {60 vars in 1482 bytes} [Tue May 10 05:35:46 2022] PUT /identity/v3/projects/60717d8e8e804e5691ece7530732b4e1/users/8725d9b96ef843aa9d0f53b9c615a57e/roles/199ac1dd842441d7913c6ee89d8fbecc => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 05:35:46.239862 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115b9f97-e106-495c-8148-7a3d5c5f9de9 None None] REQUEST_METHOD: `POST` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:35:46.240153 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115b9f97-e106-495c-8148-7a3d5c5f9de9 None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:35:46.240670 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115b9f97-e106-495c-8148-7a3d5c5f9de9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:35:46.291961 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.auth.core [None req-115b9f97-e106-495c-8148-7a3d5c5f9de9 None None] MFA Rules not processed for user `8725d9b96ef843aa9d0f53b9c615a57e`. Rule list: `[]` (Enabled: `True`). {{(pid=79879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:35:46.293688 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-115b9f97-e106-495c-8148-7a3d5c5f9de9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:35:46.438543 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 902/1780] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 10 05:35:46 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 05:35:46.449894 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0b9a8b-9a1c-4165-89e1-6f700f303d94 admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:35:46.452268 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-3a0b9a8b-9a1c-4165-89e1-6f700f303d94 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:35:46.540330 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0b9a8b-9a1c-4165-89e1-6f700f303d94 admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:35:46.544224 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc4c04e-e29f-4f2e-ba59-c6be43a78e15 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355be413675540a39ccb00e1a0722316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f23435f783540199d6dcfd0417c090e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:35:46.545539 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc4c04e-e29f-4f2e-ba59-c6be43a78e15 service cinder] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:35:46.546001 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc4c04e-e29f-4f2e-ba59-c6be43a78e15 service cinder] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:35:46.548167 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc4c04e-e29f-4f2e-ba59-c6be43a78e15 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:35:46.565319 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc4c04e-e29f-4f2e-ba59-c6be43a78e15 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:35:46.567100 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc4c04e-e29f-4f2e-ba59-c6be43a78e15 service cinder] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:35:46.592069 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 879/1781] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 10 05:35:46 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 05:35:46.708251 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115b9f97-e106-495c-8148-7a3d5c5f9de9 None None] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:35:46.904095 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115b9f97-e106-495c-8148-7a3d5c5f9de9 None None] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:35:46.912545 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45651ee6-6bac-4b1b-8382-8120278c2e04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:35:46.913668 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45651ee6-6bac-4b1b-8382-8120278c2e04 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:35:46.914016 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45651ee6-6bac-4b1b-8382-8120278c2e04 admin admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:35:46.914354 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45651ee6-6bac-4b1b-8382-8120278c2e04 admin admin] PATH_INFO: `/v3/users/fb49312656f74cd691135376a2db7a10` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:35:46.915921 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45651ee6-6bac-4b1b-8382-8120278c2e04 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fb49312656f74cd691135376a2db7a10)` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:35:46.919848 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45651ee6-6bac-4b1b-8382-8120278c2e04 admin admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:35:47.004099 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc4c04e-e29f-4f2e-ba59-c6be43a78e15 service cinder] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:35:47.005963 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-4dc4c04e-e29f-4f2e-ba59-c6be43a78e15 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:35:47.022811 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc4c04e-e29f-4f2e-ba59-c6be43a78e15 service cinder] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:35:47.035721 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fa4fc4-2217-40fb-8580-b9e0076423fe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355be413675540a39ccb00e1a0722316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f23435f783540199d6dcfd0417c090e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:35:47.036554 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fa4fc4-2217-40fb-8580-b9e0076423fe service cinder] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:35:47.036840 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fa4fc4-2217-40fb-8580-b9e0076423fe service cinder] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:35:47.037120 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fa4fc4-2217-40fb-8580-b9e0076423fe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:35:47.044186 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-01fa4fc4-2217-40fb-8580-b9e0076423fe service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:35:47.081909 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-45651ee6-6bac-4b1b-8382-8120278c2e04 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fb49312656f74cd691135376a2db7a10'} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:35:47.111486 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-45651ee6-6bac-4b1b-8382-8120278c2e04 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fb49312656f74cd691135376a2db7a10'} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:35:47.112368 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-45651ee6-6bac-4b1b-8382-8120278c2e04 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fb49312656f74cd691135376a2db7a10'} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:35:47.190675 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-45651ee6-6bac-4b1b-8382-8120278c2e04 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fb49312656f74cd691135376a2db7a10'} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:35:47.212767 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-45651ee6-6bac-4b1b-8382-8120278c2e04 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fb49312656f74cd691135376a2db7a10'} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:35:47.253092 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01fa4fc4-2217-40fb-8580-b9e0076423fe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:35:47.253909 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 903/1782] 10.222.0.23 () {58 vars in 1223 bytes} [Tue May 10 05:35:46 2022] DELETE /identity/v3/users/fb49312656f74cd691135376a2db7a10 => generated 0 bytes in 542 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 05:35:47.255672 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01fa4fc4-2217-40fb-8580-b9e0076423fe service cinder] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:35:47.260554 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918d942f-f3c0-4141-aab8-8c214cb472b0 None None] REQUEST_METHOD: `POST` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:35:47.264903 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918d942f-f3c0-4141-aab8-8c214cb472b0 None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:35:47.265218 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918d942f-f3c0-4141-aab8-8c214cb472b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:35:47.300715 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 880/1783] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 10 05:35:47 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 05:35:47.364191 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.auth.core [None req-918d942f-f3c0-4141-aab8-8c214cb472b0 None None] MFA Rules not processed for user `44883b22532e44049d846938dc2cf423`. Rule list: `[]` (Enabled: `True`). {{(pid=79879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:35:47.364883 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-918d942f-f3c0-4141-aab8-8c214cb472b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:35:47.660021 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 904/1784] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 10 05:35:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 405 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 05:35:47.829200 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fa4fc4-2217-40fb-8580-b9e0076423fe service cinder] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:35:47.831012 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-01fa4fc4-2217-40fb-8580-b9e0076423fe service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:35:47.852875 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918d942f-f3c0-4141-aab8-8c214cb472b0 None None] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:35:47.865463 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-918d942f-f3c0-4141-aab8-8c214cb472b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:35:48.007785 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fa4fc4-2217-40fb-8580-b9e0076423fe service cinder] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:35:48.013757 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918d942f-f3c0-4141-aab8-8c214cb472b0 None None] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:35:48.027565 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2301f2-e824-4d27-ad71-a5ea068cfc09 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355be413675540a39ccb00e1a0722316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f23435f783540199d6dcfd0417c090e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:35:48.031539 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2301f2-e824-4d27-ad71-a5ea068cfc09 service cinder] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:35:48.031921 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2301f2-e824-4d27-ad71-a5ea068cfc09 service cinder] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:35:48.034710 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2301f2-e824-4d27-ad71-a5ea068cfc09 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:35:48.046179 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-7e2301f2-e824-4d27-ad71-a5ea068cfc09 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:35:48.138514 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e32328-d697-4ff0-9dc6-4846d8cd9d94 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c8461cfdd9648b8abcaf8d34b7a102a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f23435f783540199d6dcfd0417c090e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:35:48.139444 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e32328-d697-4ff0-9dc6-4846d8cd9d94 service neutron] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:35:48.144155 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e32328-d697-4ff0-9dc6-4846d8cd9d94 service neutron] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:35:48.144967 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e32328-d697-4ff0-9dc6-4846d8cd9d94 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:35:48.173577 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e32328-d697-4ff0-9dc6-4846d8cd9d94 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:35:48.174361 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e32328-d697-4ff0-9dc6-4846d8cd9d94 service neutron] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:35:48.206216 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 881/1785] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 10 05:35:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 05:35:48.327095 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2301f2-e824-4d27-ad71-a5ea068cfc09 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:35:48.334192 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2301f2-e824-4d27-ad71-a5ea068cfc09 service cinder] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:35:48.372180 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 905/1786] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 10 05:35:47 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 520 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 05:35:49.343098 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2476e0fb-7af0-4375-b455-10e22fb4c202 None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:35:49.344215 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2476e0fb-7af0-4375-b455-10e22fb4c202 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:35:49.344700 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2476e0fb-7af0-4375-b455-10e22fb4c202 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:35:49.404382 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-2476e0fb-7af0-4375-b455-10e22fb4c202 None None] MFA Rules not processed for user `828789daf7cd4761b10c32995944b848`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:35:49.408228 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-2476e0fb-7af0-4375-b455-10e22fb4c202 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:35:49.563481 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 882/1787] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 10 05:35:49 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 05:35:50.294648 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2301f2-e824-4d27-ad71-a5ea068cfc09 service cinder] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:35:50.296983 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-7e2301f2-e824-4d27-ad71-a5ea068cfc09 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:35:50.330745 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2301f2-e824-4d27-ad71-a5ea068cfc09 service cinder] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:35:50.344425 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6341a121-6c2b-4504-b2c4-ce962915176c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:35:50.360772 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6341a121-6c2b-4504-b2c4-ce962915176c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:35:50.361229 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6341a121-6c2b-4504-b2c4-ce962915176c admin admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:35:50.362154 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6341a121-6c2b-4504-b2c4-ce962915176c admin admin] PATH_INFO: `/v3/projects/791e63489bcb47a99b6df16e41c84ad9` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:35:50.370070 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6341a121-6c2b-4504-b2c4-ce962915176c admin admin] RBAC: Authorizing `identity:delete_project(project_id=791e63489bcb47a99b6df16e41c84ad9)` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:35:50.372162 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6341a121-6c2b-4504-b2c4-ce962915176c admin admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:35:50.486096 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-6341a121-6c2b-4504-b2c4-ce962915176c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '791e63489bcb47a99b6df16e41c84ad9', 'request_id': 'req-6341a121-6c2b-4504-b2c4-ce962915176c'} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:35:50.499439 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-6341a121-6c2b-4504-b2c4-ce962915176c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '791e63489bcb47a99b6df16e41c84ad9', 'request_id': 'req-6341a121-6c2b-4504-b2c4-ce962915176c'} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:35:50.518481 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-6341a121-6c2b-4504-b2c4-ce962915176c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '791e63489bcb47a99b6df16e41c84ad9', 'request_id': 'req-6341a121-6c2b-4504-b2c4-ce962915176c'} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:35:50.543235 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-6341a121-6c2b-4504-b2c4-ce962915176c admin admin] The token cache is being invalidate because project 791e63489bcb47a99b6df16e41c84ad9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79879) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 05:35:50.543447 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-6341a121-6c2b-4504-b2c4-ce962915176c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:35:50.543990 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-6341a121-6c2b-4504-b2c4-ce962915176c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:35:50.548440 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 906/1788] 10.222.0.23 () {58 vars in 1232 bytes} [Tue May 10 05:35:50 2022] DELETE /identity/v3/projects/791e63489bcb47a99b6df16e41c84ad9 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 05:35:50.558079 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2476e0fb-7af0-4375-b455-10e22fb4c202 None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:35:50.575610 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2476e0fb-7af0-4375-b455-10e22fb4c202 None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:35:50.651329 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39eb35af-b441-44a8-93c8-14c2c157606c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:35:50.652360 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39eb35af-b441-44a8-93c8-14c2c157606c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:35:50.652700 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39eb35af-b441-44a8-93c8-14c2c157606c admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:35:50.653307 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39eb35af-b441-44a8-93c8-14c2c157606c admin admin] PATH_INFO: `/v3/users/8725d9b96ef843aa9d0f53b9c615a57e` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:35:50.654831 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39eb35af-b441-44a8-93c8-14c2c157606c admin admin] RBAC: Authorizing `identity:delete_user(user_id=8725d9b96ef843aa9d0f53b9c615a57e)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:35:50.657200 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39eb35af-b441-44a8-93c8-14c2c157606c admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:35:50.745016 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-39eb35af-b441-44a8-93c8-14c2c157606c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8725d9b96ef843aa9d0f53b9c615a57e'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:35:50.774294 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-39eb35af-b441-44a8-93c8-14c2c157606c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8725d9b96ef843aa9d0f53b9c615a57e'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:35:50.775137 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-39eb35af-b441-44a8-93c8-14c2c157606c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8725d9b96ef843aa9d0f53b9c615a57e'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:35:50.783539 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-39eb35af-b441-44a8-93c8-14c2c157606c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8725d9b96ef843aa9d0f53b9c615a57e'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:35:50.784691 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-39eb35af-b441-44a8-93c8-14c2c157606c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8725d9b96ef843aa9d0f53b9c615a57e'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:35:50.804825 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 883/1789] 10.222.0.23 () {58 vars in 1223 bytes} [Tue May 10 05:35:50 2022] DELETE /identity/v3/users/8725d9b96ef843aa9d0f53b9c615a57e => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 05:35:51.569816 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6341a121-6c2b-4504-b2c4-ce962915176c admin admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:35:51.572221 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-6341a121-6c2b-4504-b2c4-ce962915176c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:35:51.606118 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6341a121-6c2b-4504-b2c4-ce962915176c admin admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:35:51.830053 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d3269e-73a5-4eab-98cc-9ad0d85da239 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:35:51.830718 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d3269e-73a5-4eab-98cc-9ad0d85da239 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:35:51.830926 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d3269e-73a5-4eab-98cc-9ad0d85da239 admin admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:35:51.831251 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d3269e-73a5-4eab-98cc-9ad0d85da239 admin admin] PATH_INFO: `/v3/projects/60717d8e8e804e5691ece7530732b4e1` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:35:51.833299 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d3269e-73a5-4eab-98cc-9ad0d85da239 admin admin] RBAC: Authorizing `identity:delete_project(project_id=60717d8e8e804e5691ece7530732b4e1)` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:35:51.843029 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d3269e-73a5-4eab-98cc-9ad0d85da239 admin admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:35:52.016090 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-86d3269e-73a5-4eab-98cc-9ad0d85da239 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '60717d8e8e804e5691ece7530732b4e1', 'request_id': 'req-86d3269e-73a5-4eab-98cc-9ad0d85da239'} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:35:52.025011 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-86d3269e-73a5-4eab-98cc-9ad0d85da239 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '60717d8e8e804e5691ece7530732b4e1', 'request_id': 'req-86d3269e-73a5-4eab-98cc-9ad0d85da239'} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:35:52.036173 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-86d3269e-73a5-4eab-98cc-9ad0d85da239 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '60717d8e8e804e5691ece7530732b4e1', 'request_id': 'req-86d3269e-73a5-4eab-98cc-9ad0d85da239'} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:35:52.056892 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-86d3269e-73a5-4eab-98cc-9ad0d85da239 admin admin] The token cache is being invalidate because project 60717d8e8e804e5691ece7530732b4e1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79879) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 05:35:52.057630 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-86d3269e-73a5-4eab-98cc-9ad0d85da239 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:35:52.058501 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-86d3269e-73a5-4eab-98cc-9ad0d85da239 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:35:52.069840 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 907/1790] 10.222.0.23 () {58 vars in 1232 bytes} [Tue May 10 05:35:51 2022] DELETE /identity/v3/projects/60717d8e8e804e5691ece7530732b4e1 => generated 0 bytes in 501 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 05:35:52.075312 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022747b2-ad05-434b-bb48-b740a5dd80b3 None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:35:52.075939 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022747b2-ad05-434b-bb48-b740a5dd80b3 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:35:52.076048 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022747b2-ad05-434b-bb48-b740a5dd80b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:35:52.096330 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-022747b2-ad05-434b-bb48-b740a5dd80b3 None None] MFA Rules not processed for user `44883b22532e44049d846938dc2cf423`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:35:52.097854 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-022747b2-ad05-434b-bb48-b740a5dd80b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:35:52.186108 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 884/1791] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 10 05:35:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 05:35:52.204282 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6679fff-ce73-431f-9fda-bcb91663610e None None] REQUEST_METHOD: `POST` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:35:52.205600 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6679fff-ce73-431f-9fda-bcb91663610e None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:35:52.206036 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6679fff-ce73-431f-9fda-bcb91663610e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:35:52.235836 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.auth.core [None req-f6679fff-ce73-431f-9fda-bcb91663610e None None] MFA Rules not processed for user `44883b22532e44049d846938dc2cf423`. Rule list: `[]` (Enabled: `True`). {{(pid=79879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:35:52.237062 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-f6679fff-ce73-431f-9fda-bcb91663610e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:35:52.256403 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 908/1792] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 10 05:35:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 05:35:52.259508 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022747b2-ad05-434b-bb48-b740a5dd80b3 None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:35:52.272682 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022747b2-ad05-434b-bb48-b740a5dd80b3 None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:35:52.289030 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0ada1e-1993-434d-a530-bd7d948fb4ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:35:52.290056 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0ada1e-1993-434d-a530-bd7d948fb4ae admin admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:35:52.290339 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0ada1e-1993-434d-a530-bd7d948fb4ae admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:35:52.290626 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0ada1e-1993-434d-a530-bd7d948fb4ae admin admin] PATH_INFO: `/v3/domains` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:35:52.291470 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0ada1e-1993-434d-a530-bd7d948fb4ae admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:35:52.291900 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0ada1e-1993-434d-a530-bd7d948fb4ae admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:35:52.293963 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0ada1e-1993-434d-a530-bd7d948fb4ae admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:35:52.317655 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 885/1793] 10.222.0.23 () {58 vars in 1152 bytes} [Tue May 10 05:35:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:35:52.323023 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6679fff-ce73-431f-9fda-bcb91663610e None None] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:35:52.334096 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6679fff-ce73-431f-9fda-bcb91663610e None None] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:35:52.339151 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d91cb4-6aae-42ee-adc7-8c2aff44fce7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:35:52.341031 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d91cb4-6aae-42ee-adc7-8c2aff44fce7 admin admin] REQUEST_METHOD: `POST` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:35:52.341669 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d91cb4-6aae-42ee-adc7-8c2aff44fce7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:35:52.342152 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d91cb4-6aae-42ee-adc7-8c2aff44fce7 admin admin] PATH_INFO: `/v3/projects` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:35:52.343055 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d91cb4-6aae-42ee-adc7-8c2aff44fce7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:35:52.346847 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d91cb4-6aae-42ee-adc7-8c2aff44fce7 admin admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:35:52.395353 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 909/1794] 10.222.0.23 () {60 vars in 1152 bytes} [Tue May 10 05:35:52 2022] POST /identity/v3/projects => generated 385 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 05:35:52.397860 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0ada1e-1993-434d-a530-bd7d948fb4ae admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:35:52.413302 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0ada1e-1993-434d-a530-bd7d948fb4ae admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:35:52.459235 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d91cb4-6aae-42ee-adc7-8c2aff44fce7 admin admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:35:52.465060 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-64d91cb4-6aae-42ee-adc7-8c2aff44fce7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:35:52.552414 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4558521-9d4a-4ad6-bd2e-81c485e4a721 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:35:52.553558 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4558521-9d4a-4ad6-bd2e-81c485e4a721 admin admin] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:35:52.553999 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4558521-9d4a-4ad6-bd2e-81c485e4a721 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:35:52.554549 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4558521-9d4a-4ad6-bd2e-81c485e4a721 admin admin] PATH_INFO: `/v3/users` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:35:52.555768 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4558521-9d4a-4ad6-bd2e-81c485e4a721 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:35:52.559232 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4558521-9d4a-4ad6-bd2e-81c485e4a721 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:35:52.578341 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d91cb4-6aae-42ee-adc7-8c2aff44fce7 admin admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:35:52.584856 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5335addf-24b9-4d76-9f94-6a2061c5bc87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:35:52.586134 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5335addf-24b9-4d76-9f94-6a2061c5bc87 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:35:52.586594 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5335addf-24b9-4d76-9f94-6a2061c5bc87 admin admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:35:52.587014 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5335addf-24b9-4d76-9f94-6a2061c5bc87 admin admin] PATH_INFO: `/v3/users/e5fab64aea894e96ac8eb44a4a531eb5` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:35:52.587891 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 886/1795] 10.222.0.23 () {60 vars in 1143 bytes} [Tue May 10 05:35:52 2022] POST /identity/v3/users => generated 293 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 05:35:52.588616 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5335addf-24b9-4d76-9f94-6a2061c5bc87 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e5fab64aea894e96ac8eb44a4a531eb5)` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:35:52.590761 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5335addf-24b9-4d76-9f94-6a2061c5bc87 admin admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:35:52.601004 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b0d58c-fa14-44cd-afbc-16d47a8c3974 None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:35:52.601292 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b0d58c-fa14-44cd-afbc-16d47a8c3974 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:35:52.601573 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b0d58c-fa14-44cd-afbc-16d47a8c3974 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:35:52.649132 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-56b0d58c-fa14-44cd-afbc-16d47a8c3974 None None] MFA Rules not processed for user `5fd529982ab24820826d466e4d13a07d`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:35:52.650590 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-56b0d58c-fa14-44cd-afbc-16d47a8c3974 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:35:52.682668 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-5335addf-24b9-4d76-9f94-6a2061c5bc87 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e5fab64aea894e96ac8eb44a4a531eb5'} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:35:52.697499 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-5335addf-24b9-4d76-9f94-6a2061c5bc87 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e5fab64aea894e96ac8eb44a4a531eb5'} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:35:52.698249 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-5335addf-24b9-4d76-9f94-6a2061c5bc87 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e5fab64aea894e96ac8eb44a4a531eb5'} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:35:52.715780 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-5335addf-24b9-4d76-9f94-6a2061c5bc87 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e5fab64aea894e96ac8eb44a4a531eb5'} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:35:52.727555 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-5335addf-24b9-4d76-9f94-6a2061c5bc87 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e5fab64aea894e96ac8eb44a4a531eb5'} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:35:52.740214 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 910/1796] 10.222.0.23 () {58 vars in 1223 bytes} [Tue May 10 05:35:52 2022] DELETE /identity/v3/users/e5fab64aea894e96ac8eb44a4a531eb5 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 05:35:52.741049 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5335addf-24b9-4d76-9f94-6a2061c5bc87 admin admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:35:52.744563 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-5335addf-24b9-4d76-9f94-6a2061c5bc87 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:35:52.762292 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 887/1797] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 10 05:35:52 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 05:35:52.902839 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5335addf-24b9-4d76-9f94-6a2061c5bc87 admin admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:35:52.911812 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cfb573-7d1a-43b7-a95d-d2ce0bf8e0b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:35:52.912783 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cfb573-7d1a-43b7-a95d-d2ce0bf8e0b6 admin admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:35:52.913141 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cfb573-7d1a-43b7-a95d-d2ce0bf8e0b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:35:52.913871 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cfb573-7d1a-43b7-a95d-d2ce0bf8e0b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:35:52.915082 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38cfb573-7d1a-43b7-a95d-d2ce0bf8e0b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:35:52.917528 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38cfb573-7d1a-43b7-a95d-d2ce0bf8e0b6 admin admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:35:52.936912 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 911/1798] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 10 05:35:52 2022] GET /identity/v3/roles => generated 1420 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 05:35:52.938487 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b0d58c-fa14-44cd-afbc-16d47a8c3974 None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:35:52.952890 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b0d58c-fa14-44cd-afbc-16d47a8c3974 None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:35:52.960738 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a439dd91-3e58-470a-b227-d24ff9aaf23e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:35:52.961658 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a439dd91-3e58-470a-b227-d24ff9aaf23e admin admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:35:52.962010 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a439dd91-3e58-470a-b227-d24ff9aaf23e admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:35:52.962351 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a439dd91-3e58-470a-b227-d24ff9aaf23e admin admin] PATH_INFO: `/v3/roles` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:35:52.963301 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a439dd91-3e58-470a-b227-d24ff9aaf23e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:35:52.965168 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a439dd91-3e58-470a-b227-d24ff9aaf23e admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:35:52.977300 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 888/1799] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 10 05:35:52 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 05:35:52.981301 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cfb573-7d1a-43b7-a95d-d2ce0bf8e0b6 admin admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:35:52.993926 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cfb573-7d1a-43b7-a95d-d2ce0bf8e0b6 admin admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:35:53.007251 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d01169-7f50-42f5-b0dd-3e73585d1180 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:35:53.009220 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d01169-7f50-42f5-b0dd-3e73585d1180 admin admin] REQUEST_METHOD: `PUT` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:35:53.011751 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d01169-7f50-42f5-b0dd-3e73585d1180 admin admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:35:53.012255 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d01169-7f50-42f5-b0dd-3e73585d1180 admin admin] PATH_INFO: `/v3/projects/ec12e803f2954a33a2db579185a32285/users/38d872f4fe1a4dc09691436fa701e2de/roles/382636e67fc142a2b2f486340d959e11` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:35:53.048604 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d01169-7f50-42f5-b0dd-3e73585d1180 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ec12e803f2954a33a2db579185a32285, user_id=38d872f4fe1a4dc09691436fa701e2de, role_id=382636e67fc142a2b2f486340d959e11)` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:35:53.052255 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d01169-7f50-42f5-b0dd-3e73585d1180 admin admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:35:53.071462 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 912/1800] 10.222.0.23 () {60 vars in 1482 bytes} [Tue May 10 05:35:52 2022] PUT /identity/v3/projects/ec12e803f2954a33a2db579185a32285/users/38d872f4fe1a4dc09691436fa701e2de/roles/382636e67fc142a2b2f486340d959e11 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 05:35:53.081917 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a32146-ade5-4bab-bcb4-7fab5a0d1c3a None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:35:53.082389 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a32146-ade5-4bab-bcb4-7fab5a0d1c3a None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:35:53.082471 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a32146-ade5-4bab-bcb4-7fab5a0d1c3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:35:53.120211 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-60a32146-ade5-4bab-bcb4-7fab5a0d1c3a None None] MFA Rules not processed for user `38d872f4fe1a4dc09691436fa701e2de`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:35:53.122739 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-60a32146-ade5-4bab-bcb4-7fab5a0d1c3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:35:53.209728 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 889/1801] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 10 05:35:53 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 05:35:53.214317 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d01169-7f50-42f5-b0dd-3e73585d1180 admin admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:35:53.314419 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d01169-7f50-42f5-b0dd-3e73585d1180 admin admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:35:53.328909 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d657de-2c8f-49d1-b374-ac77dca395e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:35:53.329709 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d657de-2c8f-49d1-b374-ac77dca395e2 admin admin] REQUEST_METHOD: `POST` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:35:53.330001 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d657de-2c8f-49d1-b374-ac77dca395e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:35:53.330282 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d657de-2c8f-49d1-b374-ac77dca395e2 admin admin] PATH_INFO: `/v3/projects` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:35:53.331014 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d657de-2c8f-49d1-b374-ac77dca395e2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:35:53.340687 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d657de-2c8f-49d1-b374-ac77dca395e2 admin admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:35:53.349777 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a32146-ade5-4bab-bcb4-7fab5a0d1c3a None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:35:53.351221 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-60a32146-ade5-4bab-bcb4-7fab5a0d1c3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:35:53.376191 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a32146-ade5-4bab-bcb4-7fab5a0d1c3a None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:35:53.378010 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 913/1802] 10.222.0.23 () {60 vars in 1152 bytes} [Tue May 10 05:35:53 2022] POST /identity/v3/projects => generated 389 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 05:35:53.382012 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d657de-2c8f-49d1-b374-ac77dca395e2 admin admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:35:53.474821 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdbbda5-da00-40fb-9238-c49bc08328b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:35:53.476446 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdbbda5-da00-40fb-9238-c49bc08328b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:35:53.476832 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdbbda5-da00-40fb-9238-c49bc08328b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:35:53.477116 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdbbda5-da00-40fb-9238-c49bc08328b9 admin admin] PATH_INFO: `/v3/users/7a5178afea70413d80d631d1dd2f6113` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:35:53.479067 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abdbbda5-da00-40fb-9238-c49bc08328b9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7a5178afea70413d80d631d1dd2f6113)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:35:53.484142 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abdbbda5-da00-40fb-9238-c49bc08328b9 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:35:53.501498 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d657de-2c8f-49d1-b374-ac77dca395e2 admin admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:35:53.509343 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0688308-befb-472c-9426-9ee6c7342906 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:35:53.510315 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0688308-befb-472c-9426-9ee6c7342906 admin admin] REQUEST_METHOD: `POST` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:35:53.513028 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0688308-befb-472c-9426-9ee6c7342906 admin admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:35:53.513494 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0688308-befb-472c-9426-9ee6c7342906 admin admin] PATH_INFO: `/v3/users` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:35:53.515494 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0688308-befb-472c-9426-9ee6c7342906 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:35:53.517877 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0688308-befb-472c-9426-9ee6c7342906 admin admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:35:53.567614 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 914/1803] 10.222.0.23 () {60 vars in 1143 bytes} [Tue May 10 05:35:53 2022] POST /identity/v3/users => generated 301 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 05:35:53.573331 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0688308-befb-472c-9426-9ee6c7342906 admin admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:35:53.588472 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-abdbbda5-da00-40fb-9238-c49bc08328b9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7a5178afea70413d80d631d1dd2f6113'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:35:53.592231 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0688308-befb-472c-9426-9ee6c7342906 admin admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:35:53.601105 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feffe446-11cc-4221-bc73-a12662bd5537 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:35:53.601995 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feffe446-11cc-4221-bc73-a12662bd5537 admin admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:35:53.602423 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feffe446-11cc-4221-bc73-a12662bd5537 admin admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:35:53.602845 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feffe446-11cc-4221-bc73-a12662bd5537 admin admin] PATH_INFO: `/v3/roles` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:35:53.603784 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feffe446-11cc-4221-bc73-a12662bd5537 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:35:53.605814 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feffe446-11cc-4221-bc73-a12662bd5537 admin admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:35:53.619701 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-abdbbda5-da00-40fb-9238-c49bc08328b9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7a5178afea70413d80d631d1dd2f6113'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:35:53.620064 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 915/1804] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 10 05:35:53 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 05:35:53.621126 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feffe446-11cc-4221-bc73-a12662bd5537 admin admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:35:53.623291 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-feffe446-11cc-4221-bc73-a12662bd5537 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:35:53.625797 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-abdbbda5-da00-40fb-9238-c49bc08328b9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7a5178afea70413d80d631d1dd2f6113'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:35:53.635558 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-abdbbda5-da00-40fb-9238-c49bc08328b9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7a5178afea70413d80d631d1dd2f6113'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:35:53.637068 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-abdbbda5-da00-40fb-9238-c49bc08328b9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7a5178afea70413d80d631d1dd2f6113'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:35:53.638493 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feffe446-11cc-4221-bc73-a12662bd5537 admin admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:35:53.644421 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d74dbd2-0f54-4447-8636-d937534911ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:35:53.645366 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d74dbd2-0f54-4447-8636-d937534911ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:35:53.645630 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d74dbd2-0f54-4447-8636-d937534911ef admin admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:35:53.646043 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d74dbd2-0f54-4447-8636-d937534911ef admin admin] PATH_INFO: `/v3/projects/c9f790398e5a42209850352a112c6138` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:35:53.647292 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d74dbd2-0f54-4447-8636-d937534911ef admin admin] RBAC: Authorizing `identity:delete_project(project_id=c9f790398e5a42209850352a112c6138)` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:35:53.649484 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d74dbd2-0f54-4447-8636-d937534911ef admin admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:35:53.653883 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 890/1805] 10.222.0.23 () {58 vars in 1223 bytes} [Tue May 10 05:35:53 2022] DELETE /identity/v3/users/7a5178afea70413d80d631d1dd2f6113 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 05:35:53.655294 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdbbda5-da00-40fb-9238-c49bc08328b9 admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:35:53.657771 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-abdbbda5-da00-40fb-9238-c49bc08328b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:35:53.700288 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-6d74dbd2-0f54-4447-8636-d937534911ef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c9f790398e5a42209850352a112c6138', 'request_id': 'req-6d74dbd2-0f54-4447-8636-d937534911ef'} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:35:53.707133 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-6d74dbd2-0f54-4447-8636-d937534911ef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c9f790398e5a42209850352a112c6138', 'request_id': 'req-6d74dbd2-0f54-4447-8636-d937534911ef'} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:35:53.721107 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-6d74dbd2-0f54-4447-8636-d937534911ef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c9f790398e5a42209850352a112c6138', 'request_id': 'req-6d74dbd2-0f54-4447-8636-d937534911ef'} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:35:53.736780 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-6d74dbd2-0f54-4447-8636-d937534911ef admin admin] The token cache is being invalidate because project c9f790398e5a42209850352a112c6138 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79879) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 05:35:53.737499 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-6d74dbd2-0f54-4447-8636-d937534911ef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:35:53.738331 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-6d74dbd2-0f54-4447-8636-d937534911ef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:35:53.740122 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 916/1806] 10.222.0.23 () {58 vars in 1232 bytes} [Tue May 10 05:35:53 2022] DELETE /identity/v3/projects/c9f790398e5a42209850352a112c6138 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 05:35:53.741680 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254d7c3c-69f7-4d11-863f-bdd999b0257e None None] REQUEST_METHOD: `POST` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:35:53.742121 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254d7c3c-69f7-4d11-863f-bdd999b0257e None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:35:53.742524 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254d7c3c-69f7-4d11-863f-bdd999b0257e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:35:53.759818 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdbbda5-da00-40fb-9238-c49bc08328b9 admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:35:53.772625 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.auth.core [None req-254d7c3c-69f7-4d11-863f-bdd999b0257e None None] MFA Rules not processed for user `44883b22532e44049d846938dc2cf423`. Rule list: `[]` (Enabled: `True`). {{(pid=79879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:35:53.774162 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-254d7c3c-69f7-4d11-863f-bdd999b0257e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:35:53.869823 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc6d6f9-df8e-4c60-b58d-b22e75775feb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:35:53.871298 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc6d6f9-df8e-4c60-b58d-b22e75775feb admin admin] REQUEST_METHOD: `PUT` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:35:53.871612 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc6d6f9-df8e-4c60-b58d-b22e75775feb admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:35:53.871900 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc6d6f9-df8e-4c60-b58d-b22e75775feb admin admin] PATH_INFO: `/v3/projects/613ab268002244ffba7850ebd0c48ca9/users/50fea3416a354d5286b85f00f2114cec/roles/199ac1dd842441d7913c6ee89d8fbecc` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:35:53.901655 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 917/1807] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 10 05:35:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 05:35:53.901655 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254d7c3c-69f7-4d11-863f-bdd999b0257e None None] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:35:53.902658 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc6d6f9-df8e-4c60-b58d-b22e75775feb admin admin] RBAC: Authorizing `identity:create_grant(project_id=613ab268002244ffba7850ebd0c48ca9, user_id=50fea3416a354d5286b85f00f2114cec, role_id=199ac1dd842441d7913c6ee89d8fbecc)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:35:53.906852 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc6d6f9-df8e-4c60-b58d-b22e75775feb admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:35:53.907645 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-254d7c3c-69f7-4d11-863f-bdd999b0257e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:35:53.930347 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 891/1808] 10.222.0.23 () {60 vars in 1482 bytes} [Tue May 10 05:35:53 2022] PUT /identity/v3/projects/613ab268002244ffba7850ebd0c48ca9/users/50fea3416a354d5286b85f00f2114cec/roles/199ac1dd842441d7913c6ee89d8fbecc => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 05:35:53.931670 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc6d6f9-df8e-4c60-b58d-b22e75775feb admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:35:53.933480 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254d7c3c-69f7-4d11-863f-bdd999b0257e None None] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:35:53.935768 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-bfc6d6f9-df8e-4c60-b58d-b22e75775feb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:35:54.000162 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956fe704-a5eb-42ac-80d8-c19e8dc03b12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:35:54.001192 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956fe704-a5eb-42ac-80d8-c19e8dc03b12 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:35:54.001577 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956fe704-a5eb-42ac-80d8-c19e8dc03b12 admin admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:35:54.001948 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956fe704-a5eb-42ac-80d8-c19e8dc03b12 admin admin] PATH_INFO: `/v3/users/828789daf7cd4761b10c32995944b848` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:35:54.003553 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956fe704-a5eb-42ac-80d8-c19e8dc03b12 admin admin] RBAC: Authorizing `identity:delete_user(user_id=828789daf7cd4761b10c32995944b848)` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:35:54.006870 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956fe704-a5eb-42ac-80d8-c19e8dc03b12 admin admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:35:54.052606 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc6d6f9-df8e-4c60-b58d-b22e75775feb admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:35:54.063410 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c26b8bc-73eb-4e9d-91a7-435003f73083 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:35:54.064609 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c26b8bc-73eb-4e9d-91a7-435003f73083 admin admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:35:54.065639 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c26b8bc-73eb-4e9d-91a7-435003f73083 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:35:54.082605 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c26b8bc-73eb-4e9d-91a7-435003f73083 admin admin] PATH_INFO: `/v3/roles` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:35:54.086109 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c26b8bc-73eb-4e9d-91a7-435003f73083 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:35:54.093531 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c26b8bc-73eb-4e9d-91a7-435003f73083 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:35:54.120922 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-956fe704-a5eb-42ac-80d8-c19e8dc03b12 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '828789daf7cd4761b10c32995944b848'} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:35:54.134528 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 892/1809] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 10 05:35:53 2022] GET /identity/v3/roles => generated 1420 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 05:35:54.142256 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c26b8bc-73eb-4e9d-91a7-435003f73083 admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:35:54.155473 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-956fe704-a5eb-42ac-80d8-c19e8dc03b12 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '828789daf7cd4761b10c32995944b848'} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:35:54.156464 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-956fe704-a5eb-42ac-80d8-c19e8dc03b12 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '828789daf7cd4761b10c32995944b848'} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:35:54.160468 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-8c26b8bc-73eb-4e9d-91a7-435003f73083 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:35:54.185147 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-956fe704-a5eb-42ac-80d8-c19e8dc03b12 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '828789daf7cd4761b10c32995944b848'} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:35:54.211283 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-956fe704-a5eb-42ac-80d8-c19e8dc03b12 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '828789daf7cd4761b10c32995944b848'} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:35:54.231852 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 918/1810] 10.222.0.23 () {58 vars in 1223 bytes} [Tue May 10 05:35:53 2022] DELETE /identity/v3/users/828789daf7cd4761b10c32995944b848 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 05:35:54.232710 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956fe704-a5eb-42ac-80d8-c19e8dc03b12 admin admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:35:54.244270 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-956fe704-a5eb-42ac-80d8-c19e8dc03b12 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:35:54.316561 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c26b8bc-73eb-4e9d-91a7-435003f73083 admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:35:54.358385 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956fe704-a5eb-42ac-80d8-c19e8dc03b12 admin admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:35:54.369847 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f137b30d-39d0-42cf-9934-6b9e6d41e08f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:35:54.370694 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f137b30d-39d0-42cf-9934-6b9e6d41e08f admin admin] REQUEST_METHOD: `PUT` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:35:54.370982 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f137b30d-39d0-42cf-9934-6b9e6d41e08f admin admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:35:54.371262 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f137b30d-39d0-42cf-9934-6b9e6d41e08f admin admin] PATH_INFO: `/v3/projects/613ab268002244ffba7850ebd0c48ca9/users/50fea3416a354d5286b85f00f2114cec/roles/199ac1dd842441d7913c6ee89d8fbecc` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:35:54.390015 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f137b30d-39d0-42cf-9934-6b9e6d41e08f admin admin] RBAC: Authorizing `identity:create_grant(project_id=613ab268002244ffba7850ebd0c48ca9, user_id=50fea3416a354d5286b85f00f2114cec, role_id=199ac1dd842441d7913c6ee89d8fbecc)` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:35:54.396581 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f137b30d-39d0-42cf-9934-6b9e6d41e08f admin admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:35:54.424813 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a8d11c-756e-472c-b22a-d2ec0b95b038 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c8461cfdd9648b8abcaf8d34b7a102a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f23435f783540199d6dcfd0417c090e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:35:54.425486 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a8d11c-756e-472c-b22a-d2ec0b95b038 service neutron] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:35:54.425766 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a8d11c-756e-472c-b22a-d2ec0b95b038 service neutron] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:35:54.426037 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a8d11c-756e-472c-b22a-d2ec0b95b038 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:35:54.428077 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-58a8d11c-756e-472c-b22a-d2ec0b95b038 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:35:54.428788 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 919/1811] 10.222.0.23 () {60 vars in 1482 bytes} [Tue May 10 05:35:54 2022] PUT /identity/v3/projects/613ab268002244ffba7850ebd0c48ca9/users/50fea3416a354d5286b85f00f2114cec/roles/199ac1dd842441d7913c6ee89d8fbecc => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 05:35:54.458025 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136d82ea-c090-4ede-aa95-eb3678c2828c None None] REQUEST_METHOD: `POST` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:35:54.461179 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136d82ea-c090-4ede-aa95-eb3678c2828c None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:35:54.461675 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136d82ea-c090-4ede-aa95-eb3678c2828c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:35:54.492894 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a8d11c-756e-472c-b22a-d2ec0b95b038 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:35:54.494782 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a8d11c-756e-472c-b22a-d2ec0b95b038 service neutron] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:35:54.510808 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 893/1812] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 10 05:35:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 05:35:54.559084 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.auth.core [None req-136d82ea-c090-4ede-aa95-eb3678c2828c None None] MFA Rules not processed for user `50fea3416a354d5286b85f00f2114cec`. Rule list: `[]` (Enabled: `True`). {{(pid=79879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:35:54.560357 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-136d82ea-c090-4ede-aa95-eb3678c2828c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:35:54.685212 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 920/1813] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 10 05:35:54 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 05:35:54.697654 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a8d11c-756e-472c-b22a-d2ec0b95b038 service neutron] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:35:54.699564 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-58a8d11c-756e-472c-b22a-d2ec0b95b038 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:35:54.772855 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a8d11c-756e-472c-b22a-d2ec0b95b038 service neutron] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:35:54.836827 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05195d08-5364-42c6-93c6-db9f727dca18 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355be413675540a39ccb00e1a0722316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f23435f783540199d6dcfd0417c090e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:35:54.837906 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05195d08-5364-42c6-93c6-db9f727dca18 service cinder] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:35:54.838404 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05195d08-5364-42c6-93c6-db9f727dca18 service cinder] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:35:54.838893 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05195d08-5364-42c6-93c6-db9f727dca18 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:35:54.855893 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05195d08-5364-42c6-93c6-db9f727dca18 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:35:54.859365 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05195d08-5364-42c6-93c6-db9f727dca18 service cinder] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:35:54.874398 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 894/1814] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 10 05:35:54 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 05:35:55.037658 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136d82ea-c090-4ede-aa95-eb3678c2828c None None] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:35:55.121720 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136d82ea-c090-4ede-aa95-eb3678c2828c None None] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:35:55.128327 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba225f23-baee-4434-8cd3-27cb6cc275c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:35:55.129153 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba225f23-baee-4434-8cd3-27cb6cc275c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:35:55.129588 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba225f23-baee-4434-8cd3-27cb6cc275c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:35:55.129943 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba225f23-baee-4434-8cd3-27cb6cc275c6 admin admin] PATH_INFO: `/v3/users/38d872f4fe1a4dc09691436fa701e2de` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:35:55.131731 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba225f23-baee-4434-8cd3-27cb6cc275c6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=38d872f4fe1a4dc09691436fa701e2de)` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:35:55.134084 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba225f23-baee-4434-8cd3-27cb6cc275c6 admin admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:35:55.198739 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-ba225f23-baee-4434-8cd3-27cb6cc275c6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '38d872f4fe1a4dc09691436fa701e2de'} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:35:55.207812 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-ba225f23-baee-4434-8cd3-27cb6cc275c6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '38d872f4fe1a4dc09691436fa701e2de'} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:35:55.208702 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-ba225f23-baee-4434-8cd3-27cb6cc275c6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '38d872f4fe1a4dc09691436fa701e2de'} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:35:55.227200 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-ba225f23-baee-4434-8cd3-27cb6cc275c6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '38d872f4fe1a4dc09691436fa701e2de'} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:35:55.235167 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-ba225f23-baee-4434-8cd3-27cb6cc275c6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '38d872f4fe1a4dc09691436fa701e2de'} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:35:55.247890 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 921/1815] 10.222.0.23 () {58 vars in 1223 bytes} [Tue May 10 05:35:55 2022] DELETE /identity/v3/users/38d872f4fe1a4dc09691436fa701e2de => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 05:35:55.248021 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7880e54-4c59-4566-88b6-42151a60cd94 None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:35:55.248475 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7880e54-4c59-4566-88b6-42151a60cd94 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:35:55.248705 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7880e54-4c59-4566-88b6-42151a60cd94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:35:55.266685 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-b7880e54-4c59-4566-88b6-42151a60cd94 None None] MFA Rules not processed for user `44883b22532e44049d846938dc2cf423`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:35:55.268161 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-b7880e54-4c59-4566-88b6-42151a60cd94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:35:55.353501 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 895/1816] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 10 05:35:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 05:35:55.364569 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba225f23-baee-4434-8cd3-27cb6cc275c6 admin admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:35:55.366023 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-ba225f23-baee-4434-8cd3-27cb6cc275c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:35:55.382100 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f99b41-1eea-4820-bfd9-82e649a83a06 None None] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:35:55.382358 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f99b41-1eea-4820-bfd9-82e649a83a06 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:35:55.382600 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f99b41-1eea-4820-bfd9-82e649a83a06 None None] PATH_INFO: `/` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:35:55.385110 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 896/1817] 10.222.0.23 () {54 vars in 921 bytes} [Tue May 10 05:35:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 05:35:55.460321 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8945647-d281-4813-b59b-cd4de38371f8 None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:35:55.460850 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8945647-d281-4813-b59b-cd4de38371f8 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:35:55.461412 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8945647-d281-4813-b59b-cd4de38371f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:35:55.501749 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-d8945647-d281-4813-b59b-cd4de38371f8 None None] MFA Rules not processed for user `7f50f224ca944983aecfde86375473da`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:35:55.503475 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-d8945647-d281-4813-b59b-cd4de38371f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:35:55.665580 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 897/1818] 10.222.0.23 () {58 vars in 1018 bytes} [Tue May 10 05:35:55 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 05:35:55.666464 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8945647-d281-4813-b59b-cd4de38371f8 None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:35:55.667809 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-d8945647-d281-4813-b59b-cd4de38371f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:35:55.668142 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba225f23-baee-4434-8cd3-27cb6cc275c6 admin admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:35:55.673622 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cba2327-436c-4298-b6fb-eeb28967a69e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c8461cfdd9648b8abcaf8d34b7a102a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f23435f783540199d6dcfd0417c090e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:35:55.674373 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cba2327-436c-4298-b6fb-eeb28967a69e service neutron] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:35:55.674720 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cba2327-436c-4298-b6fb-eeb28967a69e service neutron] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:35:55.675058 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cba2327-436c-4298-b6fb-eeb28967a69e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:35:55.691174 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8945647-d281-4813-b59b-cd4de38371f8 None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:35:55.697357 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24f2c58-3da2-4de7-8f5b-c771a8a1e33b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:35:55.697511 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cba2327-436c-4298-b6fb-eeb28967a69e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:35:55.698248 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24f2c58-3da2-4de7-8f5b-c771a8a1e33b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:35:55.698536 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24f2c58-3da2-4de7-8f5b-c771a8a1e33b admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:35:55.698810 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24f2c58-3da2-4de7-8f5b-c771a8a1e33b admin admin] PATH_INFO: `/v3/projects/06d3be9b601241c9bb9ebcfdc8148f82` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:35:55.700317 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24f2c58-3da2-4de7-8f5b-c771a8a1e33b admin admin] RBAC: Authorizing `identity:delete_project(project_id=06d3be9b601241c9bb9ebcfdc8148f82)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:35:55.702901 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cba2327-436c-4298-b6fb-eeb28967a69e service neutron] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:35:55.703728 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24f2c58-3da2-4de7-8f5b-c771a8a1e33b admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:35:55.720734 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 922/1819] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 10 05:35:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 05:35:55.752424 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cba2327-436c-4298-b6fb-eeb28967a69e service neutron] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:35:55.753858 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-1cba2327-436c-4298-b6fb-eeb28967a69e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:35:55.785440 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cba2327-436c-4298-b6fb-eeb28967a69e service neutron] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:35:55.791259 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94be36d4-2cd6-4954-b744-39051ddaa586 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f50f224ca944983aecfde86375473da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f23435f783540199d6dcfd0417c090e', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:35:55.791939 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94be36d4-2cd6-4954-b744-39051ddaa586 service nova] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:35:55.792114 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94be36d4-2cd6-4954-b744-39051ddaa586 service nova] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:35:55.792389 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94be36d4-2cd6-4954-b744-39051ddaa586 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:35:55.802125 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94be36d4-2cd6-4954-b744-39051ddaa586 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:35:55.803907 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94be36d4-2cd6-4954-b744-39051ddaa586 service nova] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:35:55.821017 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 923/1820] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 10 05:35:55 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 05:35:55.829658 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-f24f2c58-3da2-4de7-8f5b-c771a8a1e33b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '06d3be9b601241c9bb9ebcfdc8148f82', 'request_id': 'req-f24f2c58-3da2-4de7-8f5b-c771a8a1e33b'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:35:55.838220 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-f24f2c58-3da2-4de7-8f5b-c771a8a1e33b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '06d3be9b601241c9bb9ebcfdc8148f82', 'request_id': 'req-f24f2c58-3da2-4de7-8f5b-c771a8a1e33b'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:35:55.865074 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-f24f2c58-3da2-4de7-8f5b-c771a8a1e33b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '06d3be9b601241c9bb9ebcfdc8148f82', 'request_id': 'req-f24f2c58-3da2-4de7-8f5b-c771a8a1e33b'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:35:55.870880 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94be36d4-2cd6-4954-b744-39051ddaa586 service nova] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:35:55.873430 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-94be36d4-2cd6-4954-b744-39051ddaa586 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:35:55.885969 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-f24f2c58-3da2-4de7-8f5b-c771a8a1e33b admin admin] The token cache is being invalidate because project 06d3be9b601241c9bb9ebcfdc8148f82 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79880) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 05:35:55.886187 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-f24f2c58-3da2-4de7-8f5b-c771a8a1e33b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:35:55.888131 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-f24f2c58-3da2-4de7-8f5b-c771a8a1e33b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:35:55.895442 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 898/1821] 10.222.0.23 () {58 vars in 1232 bytes} [Tue May 10 05:35:55 2022] DELETE /identity/v3/projects/06d3be9b601241c9bb9ebcfdc8148f82 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 05:35:55.901313 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de16a60e-7065-4067-9edf-a8c522ac8876 None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:35:55.901605 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de16a60e-7065-4067-9edf-a8c522ac8876 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:35:55.901882 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de16a60e-7065-4067-9edf-a8c522ac8876 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:35:55.912199 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94be36d4-2cd6-4954-b744-39051ddaa586 service nova] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:35:55.935437 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-de16a60e-7065-4067-9edf-a8c522ac8876 None None] MFA Rules not processed for user `44883b22532e44049d846938dc2cf423`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:35:55.936623 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-de16a60e-7065-4067-9edf-a8c522ac8876 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:35:56.008413 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d107c82d-c6c3-4634-82f6-67a7cf6c6796 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:35:56.009286 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d107c82d-c6c3-4634-82f6-67a7cf6c6796 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:35:56.009977 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d107c82d-c6c3-4634-82f6-67a7cf6c6796 admin admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:35:56.010080 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d107c82d-c6c3-4634-82f6-67a7cf6c6796 admin admin] PATH_INFO: `/v3/projects/43416831675e4ad7b08db0ac262a24a4` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:35:56.010402 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 899/1822] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 10 05:35:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 05:35:56.011312 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d107c82d-c6c3-4634-82f6-67a7cf6c6796 admin admin] RBAC: Authorizing `identity:delete_project(project_id=43416831675e4ad7b08db0ac262a24a4)` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:35:56.013291 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d107c82d-c6c3-4634-82f6-67a7cf6c6796 admin admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:35:56.019656 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452efcf1-4bf8-40c8-9158-b6fe5b464764 None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:35:56.020231 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452efcf1-4bf8-40c8-9158-b6fe5b464764 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:35:56.020710 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452efcf1-4bf8-40c8-9158-b6fe5b464764 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:35:56.039889 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-452efcf1-4bf8-40c8-9158-b6fe5b464764 None None] MFA Rules not processed for user `44883b22532e44049d846938dc2cf423`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:35:56.041155 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-452efcf1-4bf8-40c8-9158-b6fe5b464764 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:35:56.049849 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 900/1823] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 10 05:35:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 05:35:56.054122 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452efcf1-4bf8-40c8-9158-b6fe5b464764 None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:35:56.064854 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-d107c82d-c6c3-4634-82f6-67a7cf6c6796 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '43416831675e4ad7b08db0ac262a24a4', 'request_id': 'req-d107c82d-c6c3-4634-82f6-67a7cf6c6796'} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:35:56.065899 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452efcf1-4bf8-40c8-9158-b6fe5b464764 None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:35:56.071071 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-d107c82d-c6c3-4634-82f6-67a7cf6c6796 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '43416831675e4ad7b08db0ac262a24a4', 'request_id': 'req-d107c82d-c6c3-4634-82f6-67a7cf6c6796'} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:35:56.080581 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-d107c82d-c6c3-4634-82f6-67a7cf6c6796 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '43416831675e4ad7b08db0ac262a24a4', 'request_id': 'req-d107c82d-c6c3-4634-82f6-67a7cf6c6796'} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:35:56.093973 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-d107c82d-c6c3-4634-82f6-67a7cf6c6796 admin admin] The token cache is being invalidate because project 43416831675e4ad7b08db0ac262a24a4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79879) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 05:35:56.094784 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-d107c82d-c6c3-4634-82f6-67a7cf6c6796 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:35:56.095672 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-d107c82d-c6c3-4634-82f6-67a7cf6c6796 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:35:56.098691 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 924/1824] 10.222.0.23 () {58 vars in 1232 bytes} [Tue May 10 05:35:55 2022] DELETE /identity/v3/projects/43416831675e4ad7b08db0ac262a24a4 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 05:35:56.102290 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d107c82d-c6c3-4634-82f6-67a7cf6c6796 admin admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:35:56.105852 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-d107c82d-c6c3-4634-82f6-67a7cf6c6796 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:35:56.133388 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c4f388-13f8-4add-8c3e-da451029a57f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:35:56.134191 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c4f388-13f8-4add-8c3e-da451029a57f admin admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:35:56.134691 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c4f388-13f8-4add-8c3e-da451029a57f admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:35:56.135140 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c4f388-13f8-4add-8c3e-da451029a57f admin admin] PATH_INFO: `/v3/domains` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:35:56.136122 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c4f388-13f8-4add-8c3e-da451029a57f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:35:56.136364 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c4f388-13f8-4add-8c3e-da451029a57f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:35:56.138071 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c4f388-13f8-4add-8c3e-da451029a57f admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:35:56.151246 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 901/1825] 10.222.0.23 () {58 vars in 1152 bytes} [Tue May 10 05:35:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 05:35:56.152269 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c4f388-13f8-4add-8c3e-da451029a57f admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:35:56.155038 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-68c4f388-13f8-4add-8c3e-da451029a57f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:35:56.167099 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c4f388-13f8-4add-8c3e-da451029a57f admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:35:56.171765 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7d9dda-2578-4ee0-a6c2-ad50c79ec640 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:35:56.173780 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d107c82d-c6c3-4634-82f6-67a7cf6c6796 admin admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:35:56.174039 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7d9dda-2578-4ee0-a6c2-ad50c79ec640 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:35:56.174448 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7d9dda-2578-4ee0-a6c2-ad50c79ec640 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:35:56.174790 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7d9dda-2578-4ee0-a6c2-ad50c79ec640 admin admin] PATH_INFO: `/v3/projects/ec12e803f2954a33a2db579185a32285` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:35:56.176017 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7d9dda-2578-4ee0-a6c2-ad50c79ec640 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ec12e803f2954a33a2db579185a32285)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:35:56.178008 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7d9dda-2578-4ee0-a6c2-ad50c79ec640 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:35:56.181302 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a06cd1-a92d-4e0a-9e2e-83fcd6acfa1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:35:56.182278 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a06cd1-a92d-4e0a-9e2e-83fcd6acfa1c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:35:56.182623 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a06cd1-a92d-4e0a-9e2e-83fcd6acfa1c admin admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:35:56.182904 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a06cd1-a92d-4e0a-9e2e-83fcd6acfa1c admin admin] PATH_INFO: `/v3/users/a1c60632801a49a699daa199a36a2f09` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:35:56.184154 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a06cd1-a92d-4e0a-9e2e-83fcd6acfa1c admin admin] RBAC: Authorizing `identity:delete_user(user_id=a1c60632801a49a699daa199a36a2f09)` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:35:56.186118 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a06cd1-a92d-4e0a-9e2e-83fcd6acfa1c admin admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:35:56.225865 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-9e7d9dda-2578-4ee0-a6c2-ad50c79ec640 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ec12e803f2954a33a2db579185a32285', 'request_id': 'req-9e7d9dda-2578-4ee0-a6c2-ad50c79ec640'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:35:56.232385 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-95a06cd1-a92d-4e0a-9e2e-83fcd6acfa1c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a1c60632801a49a699daa199a36a2f09'} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:35:56.233645 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-9e7d9dda-2578-4ee0-a6c2-ad50c79ec640 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ec12e803f2954a33a2db579185a32285', 'request_id': 'req-9e7d9dda-2578-4ee0-a6c2-ad50c79ec640'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:35:56.239934 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-95a06cd1-a92d-4e0a-9e2e-83fcd6acfa1c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a1c60632801a49a699daa199a36a2f09'} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:35:56.240724 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-95a06cd1-a92d-4e0a-9e2e-83fcd6acfa1c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a1c60632801a49a699daa199a36a2f09'} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:35:56.242048 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-9e7d9dda-2578-4ee0-a6c2-ad50c79ec640 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ec12e803f2954a33a2db579185a32285', 'request_id': 'req-9e7d9dda-2578-4ee0-a6c2-ad50c79ec640'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:35:56.252424 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-95a06cd1-a92d-4e0a-9e2e-83fcd6acfa1c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a1c60632801a49a699daa199a36a2f09'} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:35:56.252610 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-9e7d9dda-2578-4ee0-a6c2-ad50c79ec640 admin admin] The token cache is being invalidate because project ec12e803f2954a33a2db579185a32285 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79880) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 05:35:56.253059 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-9e7d9dda-2578-4ee0-a6c2-ad50c79ec640 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:35:56.253545 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-9e7d9dda-2578-4ee0-a6c2-ad50c79ec640 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:35:56.255335 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 902/1826] 10.222.0.23 () {58 vars in 1232 bytes} [Tue May 10 05:35:56 2022] DELETE /identity/v3/projects/ec12e803f2954a33a2db579185a32285 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 05:35:56.255904 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7d9dda-2578-4ee0-a6c2-ad50c79ec640 admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:35:56.257241 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-9e7d9dda-2578-4ee0-a6c2-ad50c79ec640 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:35:56.262060 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-95a06cd1-a92d-4e0a-9e2e-83fcd6acfa1c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a1c60632801a49a699daa199a36a2f09'} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:35:56.269257 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 925/1827] 10.222.0.23 () {58 vars in 1223 bytes} [Tue May 10 05:35:56 2022] DELETE /identity/v3/users/a1c60632801a49a699daa199a36a2f09 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 05:35:56.270220 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a06cd1-a92d-4e0a-9e2e-83fcd6acfa1c admin admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:35:56.277642 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-95a06cd1-a92d-4e0a-9e2e-83fcd6acfa1c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:35:56.334439 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7d9dda-2578-4ee0-a6c2-ad50c79ec640 admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:35:56.351761 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a06cd1-a92d-4e0a-9e2e-83fcd6acfa1c admin admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:35:56.356486 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacecbea-a49d-4f00-9991-03493a36de34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:35:56.357445 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacecbea-a49d-4f00-9991-03493a36de34 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:35:56.357813 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacecbea-a49d-4f00-9991-03493a36de34 admin admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:35:56.358156 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacecbea-a49d-4f00-9991-03493a36de34 admin admin] PATH_INFO: `/v3/users/50fea3416a354d5286b85f00f2114cec` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:35:56.359562 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dacecbea-a49d-4f00-9991-03493a36de34 admin admin] RBAC: Authorizing `identity:delete_user(user_id=50fea3416a354d5286b85f00f2114cec)` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:35:56.361718 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dacecbea-a49d-4f00-9991-03493a36de34 admin admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:35:56.403329 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b834069d-b800-46ea-ba92-b56238e7838e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:35:56.404036 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b834069d-b800-46ea-ba92-b56238e7838e admin admin] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:35:56.404321 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b834069d-b800-46ea-ba92-b56238e7838e admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:35:56.404611 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b834069d-b800-46ea-ba92-b56238e7838e admin admin] PATH_INFO: `/v3/projects` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:35:56.405301 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b834069d-b800-46ea-ba92-b56238e7838e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:35:56.407241 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b834069d-b800-46ea-ba92-b56238e7838e admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:35:56.420466 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-dacecbea-a49d-4f00-9991-03493a36de34 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '50fea3416a354d5286b85f00f2114cec'} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:35:56.429612 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-dacecbea-a49d-4f00-9991-03493a36de34 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '50fea3416a354d5286b85f00f2114cec'} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:35:56.430534 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-dacecbea-a49d-4f00-9991-03493a36de34 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '50fea3416a354d5286b85f00f2114cec'} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:35:56.436931 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 903/1828] 10.222.0.23 () {60 vars in 1152 bytes} [Tue May 10 05:35:56 2022] POST /identity/v3/projects => generated 371 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 05:35:56.440923 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b834069d-b800-46ea-ba92-b56238e7838e admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:35:56.442709 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-b834069d-b800-46ea-ba92-b56238e7838e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:35:56.443689 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-dacecbea-a49d-4f00-9991-03493a36de34 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '50fea3416a354d5286b85f00f2114cec'} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:35:56.451010 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-dacecbea-a49d-4f00-9991-03493a36de34 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '50fea3416a354d5286b85f00f2114cec'} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:35:56.457580 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 926/1829] 10.222.0.23 () {58 vars in 1223 bytes} [Tue May 10 05:35:56 2022] DELETE /identity/v3/users/50fea3416a354d5286b85f00f2114cec => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 05:35:56.533767 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b834069d-b800-46ea-ba92-b56238e7838e admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:35:56.591705 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc16c0c-7d1d-4c56-8e87-219d7b8281e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:35:56.592403 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc16c0c-7d1d-4c56-8e87-219d7b8281e7 admin admin] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:35:56.592689 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc16c0c-7d1d-4c56-8e87-219d7b8281e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:35:56.592968 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc16c0c-7d1d-4c56-8e87-219d7b8281e7 admin admin] PATH_INFO: `/v3/users` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:35:56.593689 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc16c0c-7d1d-4c56-8e87-219d7b8281e7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:35:56.595880 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc16c0c-7d1d-4c56-8e87-219d7b8281e7 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:35:56.615819 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 904/1830] 10.222.0.23 () {60 vars in 1143 bytes} [Tue May 10 05:35:56 2022] POST /identity/v3/users => generated 286 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 05:35:56.620345 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacecbea-a49d-4f00-9991-03493a36de34 admin admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:35:56.630826 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacecbea-a49d-4f00-9991-03493a36de34 admin admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:35:56.635597 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29098a7e-a9fa-4f61-9393-9d8ed9227725 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:35:56.636341 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29098a7e-a9fa-4f61-9393-9d8ed9227725 admin admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:35:56.636694 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29098a7e-a9fa-4f61-9393-9d8ed9227725 admin admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:35:56.637035 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29098a7e-a9fa-4f61-9393-9d8ed9227725 admin admin] PATH_INFO: `/v3/roles` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:35:56.637955 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29098a7e-a9fa-4f61-9393-9d8ed9227725 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:35:56.639601 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29098a7e-a9fa-4f61-9393-9d8ed9227725 admin admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:35:56.654568 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 927/1831] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 10 05:35:56 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 05:35:56.656201 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc16c0c-7d1d-4c56-8e87-219d7b8281e7 admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:35:56.666590 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc16c0c-7d1d-4c56-8e87-219d7b8281e7 admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:35:56.672056 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40432934-bb80-464b-aed4-80c948cd8b75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:35:56.672739 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40432934-bb80-464b-aed4-80c948cd8b75 admin admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:35:56.673016 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40432934-bb80-464b-aed4-80c948cd8b75 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:35:56.673313 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40432934-bb80-464b-aed4-80c948cd8b75 admin admin] PATH_INFO: `/v3/roles` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:35:56.674051 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40432934-bb80-464b-aed4-80c948cd8b75 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:35:56.675683 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40432934-bb80-464b-aed4-80c948cd8b75 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:35:56.686321 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 905/1832] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 10 05:35:56 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 05:35:56.690363 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29098a7e-a9fa-4f61-9393-9d8ed9227725 admin admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:35:56.701470 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29098a7e-a9fa-4f61-9393-9d8ed9227725 admin admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:35:56.702763 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40432934-bb80-464b-aed4-80c948cd8b75 admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:35:56.705355 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-40432934-bb80-464b-aed4-80c948cd8b75 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:35:56.713418 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c813cc-6633-4ffa-b3fd-f2fc47f38579 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:35:56.715181 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c813cc-6633-4ffa-b3fd-f2fc47f38579 admin admin] REQUEST_METHOD: `PUT` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:35:56.716564 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c813cc-6633-4ffa-b3fd-f2fc47f38579 admin admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:35:56.717121 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c813cc-6633-4ffa-b3fd-f2fc47f38579 admin admin] PATH_INFO: `/v3/projects/855610fee45b447f818ba2e08439f40a/users/ccd1888fdccd4bfea3a07b9486474427/roles/382636e67fc142a2b2f486340d959e11` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:35:56.720103 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40432934-bb80-464b-aed4-80c948cd8b75 admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:35:56.737289 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63f000a-3880-4810-a66f-a8b533ae5d15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:35:56.738244 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63f000a-3880-4810-a66f-a8b533ae5d15 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:35:56.738440 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63f000a-3880-4810-a66f-a8b533ae5d15 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:35:56.738563 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c813cc-6633-4ffa-b3fd-f2fc47f38579 admin admin] RBAC: Authorizing `identity:create_grant(project_id=855610fee45b447f818ba2e08439f40a, user_id=ccd1888fdccd4bfea3a07b9486474427, role_id=382636e67fc142a2b2f486340d959e11)` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:35:56.738729 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63f000a-3880-4810-a66f-a8b533ae5d15 admin admin] PATH_INFO: `/v3/projects/8bde5e68c738420694b1849403c31c57` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:35:56.740387 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63f000a-3880-4810-a66f-a8b533ae5d15 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8bde5e68c738420694b1849403c31c57)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:35:56.741464 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c813cc-6633-4ffa-b3fd-f2fc47f38579 admin admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:35:56.742330 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63f000a-3880-4810-a66f-a8b533ae5d15 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:35:56.758629 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 928/1833] 10.222.0.23 () {60 vars in 1482 bytes} [Tue May 10 05:35:56 2022] PUT /identity/v3/projects/855610fee45b447f818ba2e08439f40a/users/ccd1888fdccd4bfea3a07b9486474427/roles/382636e67fc142a2b2f486340d959e11 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 05:35:56.768893 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e13d4d1-24d5-4781-86e9-0bae6e5455fc None None] REQUEST_METHOD: `POST` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:35:56.769319 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e13d4d1-24d5-4781-86e9-0bae6e5455fc None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:35:56.769602 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e13d4d1-24d5-4781-86e9-0bae6e5455fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:35:56.800759 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.auth.core [None req-7e13d4d1-24d5-4781-86e9-0bae6e5455fc None None] MFA Rules not processed for user `ccd1888fdccd4bfea3a07b9486474427`. Rule list: `[]` (Enabled: `True`). {{(pid=79879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:35:56.803097 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-7e13d4d1-24d5-4781-86e9-0bae6e5455fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:35:56.833674 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-a63f000a-3880-4810-a66f-a8b533ae5d15 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8bde5e68c738420694b1849403c31c57', 'request_id': 'req-a63f000a-3880-4810-a66f-a8b533ae5d15'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:35:56.841444 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-a63f000a-3880-4810-a66f-a8b533ae5d15 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8bde5e68c738420694b1849403c31c57', 'request_id': 'req-a63f000a-3880-4810-a66f-a8b533ae5d15'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:35:56.852816 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-a63f000a-3880-4810-a66f-a8b533ae5d15 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8bde5e68c738420694b1849403c31c57', 'request_id': 'req-a63f000a-3880-4810-a66f-a8b533ae5d15'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:35:56.871184 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-a63f000a-3880-4810-a66f-a8b533ae5d15 admin admin] The token cache is being invalidate because project 8bde5e68c738420694b1849403c31c57 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79880) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 05:35:56.871507 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-a63f000a-3880-4810-a66f-a8b533ae5d15 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:35:56.872201 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-a63f000a-3880-4810-a66f-a8b533ae5d15 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:35:56.874296 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 906/1834] 10.222.0.23 () {58 vars in 1232 bytes} [Tue May 10 05:35:56 2022] DELETE /identity/v3/projects/8bde5e68c738420694b1849403c31c57 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 05:35:56.878917 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63f000a-3880-4810-a66f-a8b533ae5d15 admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:35:56.880997 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-a63f000a-3880-4810-a66f-a8b533ae5d15 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:35:56.885852 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 929/1835] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 10 05:35:56 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 05:35:56.890127 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e13d4d1-24d5-4781-86e9-0bae6e5455fc None None] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:35:56.955082 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63f000a-3880-4810-a66f-a8b533ae5d15 admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:35:56.961570 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa07a7c-81e6-4561-8f4a-cfb9cfc996bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:35:56.962709 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa07a7c-81e6-4561-8f4a-cfb9cfc996bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:35:56.963052 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa07a7c-81e6-4561-8f4a-cfb9cfc996bf admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:35:56.963429 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa07a7c-81e6-4561-8f4a-cfb9cfc996bf admin admin] PATH_INFO: `/v3/users/f015c3ed04814720ac6ea4462b5c86be` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:35:56.965132 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa07a7c-81e6-4561-8f4a-cfb9cfc996bf admin admin] RBAC: Authorizing `identity:delete_user(user_id=f015c3ed04814720ac6ea4462b5c86be)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:35:56.967397 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa07a7c-81e6-4561-8f4a-cfb9cfc996bf admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:35:56.971612 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e13d4d1-24d5-4781-86e9-0bae6e5455fc None None] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:35:56.976877 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c52cad0-9add-4b96-923c-8ec3d120bcdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:35:56.977567 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c52cad0-9add-4b96-923c-8ec3d120bcdf admin admin] REQUEST_METHOD: `POST` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:35:56.977851 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c52cad0-9add-4b96-923c-8ec3d120bcdf admin admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:35:56.978122 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c52cad0-9add-4b96-923c-8ec3d120bcdf admin admin] PATH_INFO: `/v3/projects` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:35:56.978818 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c52cad0-9add-4b96-923c-8ec3d120bcdf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:35:56.980819 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c52cad0-9add-4b96-923c-8ec3d120bcdf admin admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:35:57.008037 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 930/1836] 10.222.0.23 () {60 vars in 1152 bytes} [Tue May 10 05:35:56 2022] POST /identity/v3/projects => generated 371 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 05:35:57.011977 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c52cad0-9add-4b96-923c-8ec3d120bcdf admin admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:35:57.013621 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-1c52cad0-9add-4b96-923c-8ec3d120bcdf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:35:57.027992 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-9aa07a7c-81e6-4561-8f4a-cfb9cfc996bf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f015c3ed04814720ac6ea4462b5c86be'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:35:57.040785 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-9aa07a7c-81e6-4561-8f4a-cfb9cfc996bf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f015c3ed04814720ac6ea4462b5c86be'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:35:57.041498 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-9aa07a7c-81e6-4561-8f4a-cfb9cfc996bf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f015c3ed04814720ac6ea4462b5c86be'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:35:57.048451 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-9aa07a7c-81e6-4561-8f4a-cfb9cfc996bf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f015c3ed04814720ac6ea4462b5c86be'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:35:57.049185 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-9aa07a7c-81e6-4561-8f4a-cfb9cfc996bf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f015c3ed04814720ac6ea4462b5c86be'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:35:57.086951 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c52cad0-9add-4b96-923c-8ec3d120bcdf admin admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:35:57.092279 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311263f6-b4f8-4c9a-887d-48ebb0d37caa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:35:57.093020 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311263f6-b4f8-4c9a-887d-48ebb0d37caa admin admin] REQUEST_METHOD: `POST` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:35:57.093304 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311263f6-b4f8-4c9a-887d-48ebb0d37caa admin admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:35:57.093574 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311263f6-b4f8-4c9a-887d-48ebb0d37caa admin admin] PATH_INFO: `/v3/users` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:35:57.094272 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311263f6-b4f8-4c9a-887d-48ebb0d37caa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:35:57.098631 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 907/1837] 10.222.0.23 () {58 vars in 1223 bytes} [Tue May 10 05:35:56 2022] DELETE /identity/v3/users/f015c3ed04814720ac6ea4462b5c86be => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 05:35:57.098762 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311263f6-b4f8-4c9a-887d-48ebb0d37caa admin admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:35:57.098970 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa07a7c-81e6-4561-8f4a-cfb9cfc996bf admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:35:57.105447 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-9aa07a7c-81e6-4561-8f4a-cfb9cfc996bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:35:57.127163 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 931/1838] 10.222.0.23 () {60 vars in 1143 bytes} [Tue May 10 05:35:57 2022] POST /identity/v3/users => generated 292 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 05:35:57.134436 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311263f6-b4f8-4c9a-887d-48ebb0d37caa admin admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:35:57.138249 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-311263f6-b4f8-4c9a-887d-48ebb0d37caa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:35:57.154725 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311263f6-b4f8-4c9a-887d-48ebb0d37caa admin admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:35:57.206535 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa07a7c-81e6-4561-8f4a-cfb9cfc996bf admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:35:57.211607 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2b9b15-b178-4699-8332-8157aaa1f08e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:35:57.212658 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2b9b15-b178-4699-8332-8157aaa1f08e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:35:57.213220 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2b9b15-b178-4699-8332-8157aaa1f08e admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:35:57.213220 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2b9b15-b178-4699-8332-8157aaa1f08e admin admin] PATH_INFO: `/v3/projects/613ab268002244ffba7850ebd0c48ca9` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:35:57.214583 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2b9b15-b178-4699-8332-8157aaa1f08e admin admin] RBAC: Authorizing `identity:delete_project(project_id=613ab268002244ffba7850ebd0c48ca9)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:35:57.217031 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2b9b15-b178-4699-8332-8157aaa1f08e admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:35:57.232042 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8ec39d-62ed-42b5-9746-816993008ef1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:35:57.232728 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8ec39d-62ed-42b5-9746-816993008ef1 admin admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:35:57.233008 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8ec39d-62ed-42b5-9746-816993008ef1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:35:57.233432 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8ec39d-62ed-42b5-9746-816993008ef1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:35:57.234356 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8ec39d-62ed-42b5-9746-816993008ef1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:35:57.236570 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8ec39d-62ed-42b5-9746-816993008ef1 admin admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:35:57.248003 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 932/1839] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 10 05:35:57 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 05:35:57.252122 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8ec39d-62ed-42b5-9746-816993008ef1 admin admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:35:57.263741 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8ec39d-62ed-42b5-9746-816993008ef1 admin admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:35:57.279655 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-3e2b9b15-b178-4699-8332-8157aaa1f08e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '613ab268002244ffba7850ebd0c48ca9', 'request_id': 'req-3e2b9b15-b178-4699-8332-8157aaa1f08e'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:35:57.286103 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-3e2b9b15-b178-4699-8332-8157aaa1f08e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '613ab268002244ffba7850ebd0c48ca9', 'request_id': 'req-3e2b9b15-b178-4699-8332-8157aaa1f08e'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:35:57.295105 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-3e2b9b15-b178-4699-8332-8157aaa1f08e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '613ab268002244ffba7850ebd0c48ca9', 'request_id': 'req-3e2b9b15-b178-4699-8332-8157aaa1f08e'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:35:57.308146 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-3e2b9b15-b178-4699-8332-8157aaa1f08e admin admin] The token cache is being invalidate because project 613ab268002244ffba7850ebd0c48ca9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79880) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 05:35:57.308446 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-3e2b9b15-b178-4699-8332-8157aaa1f08e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:35:57.309665 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-3e2b9b15-b178-4699-8332-8157aaa1f08e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:35:57.311635 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 908/1840] 10.222.0.23 () {58 vars in 1232 bytes} [Tue May 10 05:35:57 2022] DELETE /identity/v3/projects/613ab268002244ffba7850ebd0c48ca9 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 05:35:57.316235 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a69b8e-546d-4041-9c8b-2da909cb708d None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:35:57.316741 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a69b8e-546d-4041-9c8b-2da909cb708d None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:35:57.317095 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a69b8e-546d-4041-9c8b-2da909cb708d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:35:57.332710 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f44c23b-2a10-4c84-b348-7b24c29b4bba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:35:57.334447 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f44c23b-2a10-4c84-b348-7b24c29b4bba admin admin] REQUEST_METHOD: `PUT` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:35:57.334993 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f44c23b-2a10-4c84-b348-7b24c29b4bba admin admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:35:57.335475 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f44c23b-2a10-4c84-b348-7b24c29b4bba admin admin] PATH_INFO: `/v3/projects/df3cd8b6961e4c61a2d9bbf239b2a5d6/users/e2230c2bc8814d95a3d9d8ec68b829dd/roles/199ac1dd842441d7913c6ee89d8fbecc` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:35:57.335845 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-56a69b8e-546d-4041-9c8b-2da909cb708d None None] MFA Rules not processed for user `44883b22532e44049d846938dc2cf423`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:35:57.337054 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-56a69b8e-546d-4041-9c8b-2da909cb708d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:35:57.345052 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 909/1841] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 10 05:35:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 05:35:57.352476 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8999ed1-50f7-4626-a222-2e1448f8ceae None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:35:57.352762 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8999ed1-50f7-4626-a222-2e1448f8ceae None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:35:57.353035 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8999ed1-50f7-4626-a222-2e1448f8ceae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:35:57.354081 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f44c23b-2a10-4c84-b348-7b24c29b4bba admin admin] RBAC: Authorizing `identity:create_grant(project_id=df3cd8b6961e4c61a2d9bbf239b2a5d6, user_id=e2230c2bc8814d95a3d9d8ec68b829dd, role_id=199ac1dd842441d7913c6ee89d8fbecc)` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:35:57.357893 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f44c23b-2a10-4c84-b348-7b24c29b4bba admin admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:35:57.373834 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-a8999ed1-50f7-4626-a222-2e1448f8ceae None None] MFA Rules not processed for user `44883b22532e44049d846938dc2cf423`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:35:57.374042 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 933/1842] 10.222.0.23 () {60 vars in 1482 bytes} [Tue May 10 05:35:57 2022] PUT /identity/v3/projects/df3cd8b6961e4c61a2d9bbf239b2a5d6/users/e2230c2bc8814d95a3d9d8ec68b829dd/roles/199ac1dd842441d7913c6ee89d8fbecc => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 05:35:57.375037 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-a8999ed1-50f7-4626-a222-2e1448f8ceae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:35:57.382291 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f44c23b-2a10-4c84-b348-7b24c29b4bba admin admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:35:57.384127 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-3f44c23b-2a10-4c84-b348-7b24c29b4bba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:35:57.441644 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 910/1843] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 10 05:35:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 05:35:57.444748 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8999ed1-50f7-4626-a222-2e1448f8ceae None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:35:57.446266 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-a8999ed1-50f7-4626-a222-2e1448f8ceae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:35:57.451216 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f44c23b-2a10-4c84-b348-7b24c29b4bba admin admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:35:57.455844 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4dc08e2-e508-4941-87f4-17df96df6b8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:35:57.456537 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dc08e2-e508-4941-87f4-17df96df6b8e admin admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:35:57.456819 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dc08e2-e508-4941-87f4-17df96df6b8e admin admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:35:57.457091 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dc08e2-e508-4941-87f4-17df96df6b8e admin admin] PATH_INFO: `/v3/roles` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:35:57.457585 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8999ed1-50f7-4626-a222-2e1448f8ceae None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:35:57.457816 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4dc08e2-e508-4941-87f4-17df96df6b8e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:35:57.459409 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4dc08e2-e508-4941-87f4-17df96df6b8e admin admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:35:57.462190 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298f4803-ac82-4b9a-9095-a568b8b80944 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:35:57.463044 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298f4803-ac82-4b9a-9095-a568b8b80944 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:35:57.463326 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298f4803-ac82-4b9a-9095-a568b8b80944 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:35:57.463617 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298f4803-ac82-4b9a-9095-a568b8b80944 admin admin] PATH_INFO: `/v3/projects/df6317c4610e477786e03385cbf7d442` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:35:57.464877 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298f4803-ac82-4b9a-9095-a568b8b80944 admin admin] RBAC: Authorizing `identity:delete_project(project_id=df6317c4610e477786e03385cbf7d442)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:35:57.466782 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298f4803-ac82-4b9a-9095-a568b8b80944 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:35:57.469649 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 934/1844] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 10 05:35:57 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 05:35:57.470492 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4dc08e2-e508-4941-87f4-17df96df6b8e admin admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:35:57.480672 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4dc08e2-e508-4941-87f4-17df96df6b8e admin admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:35:57.485296 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43154fb7-307b-4aed-b282-0a03e88bce0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:35:57.485955 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43154fb7-307b-4aed-b282-0a03e88bce0e admin admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:35:57.486232 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43154fb7-307b-4aed-b282-0a03e88bce0e admin admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:35:57.486502 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43154fb7-307b-4aed-b282-0a03e88bce0e admin admin] PATH_INFO: `/v3/domains` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:35:57.487255 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43154fb7-307b-4aed-b282-0a03e88bce0e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:35:57.487558 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43154fb7-307b-4aed-b282-0a03e88bce0e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:35:57.489234 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43154fb7-307b-4aed-b282-0a03e88bce0e admin admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:35:57.501324 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 935/1845] 10.222.0.23 () {58 vars in 1152 bytes} [Tue May 10 05:35:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:35:57.502241 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43154fb7-307b-4aed-b282-0a03e88bce0e admin admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:35:57.511902 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43154fb7-307b-4aed-b282-0a03e88bce0e admin admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:35:57.518765 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-298f4803-ac82-4b9a-9095-a568b8b80944 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'df6317c4610e477786e03385cbf7d442', 'request_id': 'req-298f4803-ac82-4b9a-9095-a568b8b80944'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:35:57.526505 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-298f4803-ac82-4b9a-9095-a568b8b80944 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'df6317c4610e477786e03385cbf7d442', 'request_id': 'req-298f4803-ac82-4b9a-9095-a568b8b80944'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:35:57.537120 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-298f4803-ac82-4b9a-9095-a568b8b80944 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'df6317c4610e477786e03385cbf7d442', 'request_id': 'req-298f4803-ac82-4b9a-9095-a568b8b80944'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:35:57.548145 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-298f4803-ac82-4b9a-9095-a568b8b80944 admin admin] The token cache is being invalidate because project df6317c4610e477786e03385cbf7d442 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79880) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 05:35:57.548433 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-298f4803-ac82-4b9a-9095-a568b8b80944 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:35:57.549663 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-298f4803-ac82-4b9a-9095-a568b8b80944 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:35:57.555661 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 911/1846] 10.222.0.23 () {58 vars in 1232 bytes} [Tue May 10 05:35:57 2022] DELETE /identity/v3/projects/df6317c4610e477786e03385cbf7d442 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 05:35:57.555661 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298f4803-ac82-4b9a-9095-a568b8b80944 admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:35:57.555661 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-298f4803-ac82-4b9a-9095-a568b8b80944 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:35:57.584135 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa30e50-4d7e-4c11-a617-74f8631c29a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:35:57.585247 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa30e50-4d7e-4c11-a617-74f8631c29a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:35:57.585669 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa30e50-4d7e-4c11-a617-74f8631c29a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:35:57.586015 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa30e50-4d7e-4c11-a617-74f8631c29a9 admin admin] PATH_INFO: `/v3/projects/df3cd8b6961e4c61a2d9bbf239b2a5d6/users/e2230c2bc8814d95a3d9d8ec68b829dd/roles/199ac1dd842441d7913c6ee89d8fbecc` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:35:57.588133 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa30e50-4d7e-4c11-a617-74f8631c29a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=df3cd8b6961e4c61a2d9bbf239b2a5d6, user_id=e2230c2bc8814d95a3d9d8ec68b829dd, role_id=199ac1dd842441d7913c6ee89d8fbecc)` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:35:57.590878 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa30e50-4d7e-4c11-a617-74f8631c29a9 admin admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:35:57.601980 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 936/1847] 10.222.0.23 () {60 vars in 1482 bytes} [Tue May 10 05:35:57 2022] PUT /identity/v3/projects/df3cd8b6961e4c61a2d9bbf239b2a5d6/users/e2230c2bc8814d95a3d9d8ec68b829dd/roles/199ac1dd842441d7913c6ee89d8fbecc => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 05:35:57.603282 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e01f61b-15cf-4ea5-9488-40b60da7ed05 None None] REQUEST_METHOD: `POST` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:35:57.603587 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e01f61b-15cf-4ea5-9488-40b60da7ed05 None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:35:57.603877 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e01f61b-15cf-4ea5-9488-40b60da7ed05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:35:57.624548 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.auth.core [None req-2e01f61b-15cf-4ea5-9488-40b60da7ed05 None None] MFA Rules not processed for user `44883b22532e44049d846938dc2cf423`. Rule list: `[]` (Enabled: `True`). {{(pid=79879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:35:57.625823 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-2e01f61b-15cf-4ea5-9488-40b60da7ed05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:35:57.626887 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298f4803-ac82-4b9a-9095-a568b8b80944 admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:35:57.683794 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141be47d-1924-43ff-ad56-c253c2d75ed1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:35:57.684431 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141be47d-1924-43ff-ad56-c253c2d75ed1 admin admin] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:35:57.684714 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141be47d-1924-43ff-ad56-c253c2d75ed1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:35:57.685020 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141be47d-1924-43ff-ad56-c253c2d75ed1 admin admin] PATH_INFO: `/v3/projects` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:35:57.685174 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 937/1848] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 10 05:35:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 05:35:57.686418 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f7c34f-9521-43d4-951d-685865cfb9bd None None] REQUEST_METHOD: `POST` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:35:57.686706 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f7c34f-9521-43d4-951d-685865cfb9bd None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:35:57.686975 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f7c34f-9521-43d4-951d-685865cfb9bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:35:57.689330 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141be47d-1924-43ff-ad56-c253c2d75ed1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:35:57.691259 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141be47d-1924-43ff-ad56-c253c2d75ed1 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:35:57.713236 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.auth.core [None req-13f7c34f-9521-43d4-951d-685865cfb9bd None None] MFA Rules not processed for user `e2230c2bc8814d95a3d9d8ec68b829dd`. Rule list: `[]` (Enabled: `True`). {{(pid=79879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:35:57.714443 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-13f7c34f-9521-43d4-951d-685865cfb9bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:35:57.721228 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 912/1849] 10.222.0.23 () {60 vars in 1152 bytes} [Tue May 10 05:35:57 2022] POST /identity/v3/projects => generated 381 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 05:35:57.721228 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6356d12-ae84-4f46-b398-6bd15d6b45d6 None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:35:57.721228 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6356d12-ae84-4f46-b398-6bd15d6b45d6 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:35:57.721228 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6356d12-ae84-4f46-b398-6bd15d6b45d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:35:57.737434 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-f6356d12-ae84-4f46-b398-6bd15d6b45d6 None None] MFA Rules not processed for user `44883b22532e44049d846938dc2cf423`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:35:57.738623 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-f6356d12-ae84-4f46-b398-6bd15d6b45d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:35:57.786515 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 938/1850] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 10 05:35:57 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 05:35:57.787747 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f7c34f-9521-43d4-951d-685865cfb9bd None None] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:35:57.801546 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f7c34f-9521-43d4-951d-685865cfb9bd None None] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:35:57.849624 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 913/1851] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 10 05:35:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 05:35:57.850498 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6356d12-ae84-4f46-b398-6bd15d6b45d6 None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:35:57.853835 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-f6356d12-ae84-4f46-b398-6bd15d6b45d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:35:57.890493 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10955ebf-ad25-4340-8a7d-785e5e866236 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:35:57.891409 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10955ebf-ad25-4340-8a7d-785e5e866236 admin admin] REQUEST_METHOD: `POST` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:35:57.892437 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10955ebf-ad25-4340-8a7d-785e5e866236 admin admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:35:57.892437 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10955ebf-ad25-4340-8a7d-785e5e866236 admin admin] PATH_INFO: `/v3/users` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:35:57.893049 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10955ebf-ad25-4340-8a7d-785e5e866236 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:35:57.895095 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10955ebf-ad25-4340-8a7d-785e5e866236 admin admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:35:57.943397 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 939/1852] 10.222.0.23 () {60 vars in 1143 bytes} [Tue May 10 05:35:57 2022] POST /identity/v3/users => generated 291 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 05:35:57.943397 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10955ebf-ad25-4340-8a7d-785e5e866236 admin admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:35:57.952593 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10955ebf-ad25-4340-8a7d-785e5e866236 admin admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:35:57.954956 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6356d12-ae84-4f46-b398-6bd15d6b45d6 None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:35:57.958501 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675200b4-83a2-4e7f-b93e-7b5f464bce35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:35:57.959348 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675200b4-83a2-4e7f-b93e-7b5f464bce35 admin admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:35:57.959731 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675200b4-83a2-4e7f-b93e-7b5f464bce35 admin admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:35:57.960085 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675200b4-83a2-4e7f-b93e-7b5f464bce35 admin admin] PATH_INFO: `/v3/domains` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:35:57.961070 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675200b4-83a2-4e7f-b93e-7b5f464bce35 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:35:57.961451 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675200b4-83a2-4e7f-b93e-7b5f464bce35 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:35:57.963321 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675200b4-83a2-4e7f-b93e-7b5f464bce35 admin admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:35:57.964140 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9edf84a-2319-4b92-8c9e-64ae7137ac21 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355be413675540a39ccb00e1a0722316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f23435f783540199d6dcfd0417c090e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:35:57.965270 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9edf84a-2319-4b92-8c9e-64ae7137ac21 service cinder] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:35:57.965881 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9edf84a-2319-4b92-8c9e-64ae7137ac21 service cinder] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:35:57.966381 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9edf84a-2319-4b92-8c9e-64ae7137ac21 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:35:58.004326 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 940/1853] 10.222.0.23 () {58 vars in 1152 bytes} [Tue May 10 05:35:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:35:58.005177 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675200b4-83a2-4e7f-b93e-7b5f464bce35 admin admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:35:58.030308 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675200b4-83a2-4e7f-b93e-7b5f464bce35 admin admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:35:58.042707 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7b0d1d-502a-4c95-82d2-3b99f3bf3aca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:35:58.045195 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7b0d1d-502a-4c95-82d2-3b99f3bf3aca admin admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:35:58.046764 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7b0d1d-502a-4c95-82d2-3b99f3bf3aca admin admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:35:58.047065 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7b0d1d-502a-4c95-82d2-3b99f3bf3aca admin admin] PATH_INFO: `/v3/roles` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:35:58.049160 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7b0d1d-502a-4c95-82d2-3b99f3bf3aca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:35:58.052709 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7b0d1d-502a-4c95-82d2-3b99f3bf3aca admin admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:35:58.085604 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 941/1854] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 10 05:35:58 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 05:35:58.086726 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7b0d1d-502a-4c95-82d2-3b99f3bf3aca admin admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:35:58.115426 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7b0d1d-502a-4c95-82d2-3b99f3bf3aca admin admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:35:58.116471 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9edf84a-2319-4b92-8c9e-64ae7137ac21 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:35:58.123009 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9edf84a-2319-4b92-8c9e-64ae7137ac21 service cinder] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:35:58.126729 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d33a3a-3845-4267-b5b9-c6e518bb2ec9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:35:58.127466 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d33a3a-3845-4267-b5b9-c6e518bb2ec9 admin admin] REQUEST_METHOD: `POST` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:35:58.127789 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d33a3a-3845-4267-b5b9-c6e518bb2ec9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:35:58.128070 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d33a3a-3845-4267-b5b9-c6e518bb2ec9 admin admin] PATH_INFO: `/v3/projects` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:35:58.128811 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d33a3a-3845-4267-b5b9-c6e518bb2ec9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:35:58.131164 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d33a3a-3845-4267-b5b9-c6e518bb2ec9 admin admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:35:58.152547 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 914/1855] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 10 05:35:57 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 05:35:58.153722 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9edf84a-2319-4b92-8c9e-64ae7137ac21 service cinder] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:35:58.167202 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9edf84a-2319-4b92-8c9e-64ae7137ac21 service cinder] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:35:58.173406 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810f6143-ac6c-4371-91b2-70d7ccd0a826 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:35:58.174385 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810f6143-ac6c-4371-91b2-70d7ccd0a826 admin admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:35:58.174847 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810f6143-ac6c-4371-91b2-70d7ccd0a826 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:35:58.175341 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810f6143-ac6c-4371-91b2-70d7ccd0a826 admin admin] PATH_INFO: `/v3/roles` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:35:58.176293 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810f6143-ac6c-4371-91b2-70d7ccd0a826 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:35:58.178026 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 942/1856] 10.222.0.23 () {60 vars in 1152 bytes} [Tue May 10 05:35:58 2022] POST /identity/v3/projects => generated 377 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 05:35:58.178592 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810f6143-ac6c-4371-91b2-70d7ccd0a826 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:35:58.185434 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d33a3a-3845-4267-b5b9-c6e518bb2ec9 admin admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:35:58.199357 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 915/1857] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 10 05:35:58 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 05:35:58.204849 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810f6143-ac6c-4371-91b2-70d7ccd0a826 admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:35:58.219039 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810f6143-ac6c-4371-91b2-70d7ccd0a826 admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:35:58.271014 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d33a3a-3845-4267-b5b9-c6e518bb2ec9 admin admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:35:58.278077 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb17b08-6ca0-4282-ba69-d27b3ec99a20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:35:58.278879 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb17b08-6ca0-4282-ba69-d27b3ec99a20 admin admin] REQUEST_METHOD: `POST` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:35:58.279356 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb17b08-6ca0-4282-ba69-d27b3ec99a20 admin admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:35:58.279729 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb17b08-6ca0-4282-ba69-d27b3ec99a20 admin admin] PATH_INFO: `/v3/users` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:35:58.280588 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb17b08-6ca0-4282-ba69-d27b3ec99a20 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:35:58.282588 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb17b08-6ca0-4282-ba69-d27b3ec99a20 admin admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:35:58.316251 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14292124-e292-4a83-a2ef-d576d2c572aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:35:58.317822 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14292124-e292-4a83-a2ef-d576d2c572aa admin admin] REQUEST_METHOD: `PUT` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:35:58.318176 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14292124-e292-4a83-a2ef-d576d2c572aa admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:35:58.318653 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14292124-e292-4a83-a2ef-d576d2c572aa admin admin] PATH_INFO: `/v3/projects/b915f47a796e47a6acd4988ea0222da6/users/f3175ca0687f4a6b928e1db31d78e534/roles/382636e67fc142a2b2f486340d959e11` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:35:58.321250 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 943/1858] 10.222.0.23 () {60 vars in 1143 bytes} [Tue May 10 05:35:58 2022] POST /identity/v3/users => generated 289 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 05:35:58.326318 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb17b08-6ca0-4282-ba69-d27b3ec99a20 admin admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:35:58.347151 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb17b08-6ca0-4282-ba69-d27b3ec99a20 admin admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:35:58.363018 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d884de-0a8a-4eca-b952-1b34ed67c0e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:35:58.364504 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d884de-0a8a-4eca-b952-1b34ed67c0e0 admin admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:35:58.365237 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d884de-0a8a-4eca-b952-1b34ed67c0e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:35:58.365829 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d884de-0a8a-4eca-b952-1b34ed67c0e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:35:58.367027 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d884de-0a8a-4eca-b952-1b34ed67c0e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:35:58.369756 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d884de-0a8a-4eca-b952-1b34ed67c0e0 admin admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:35:58.380518 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14292124-e292-4a83-a2ef-d576d2c572aa admin admin] RBAC: Authorizing `identity:create_grant(project_id=b915f47a796e47a6acd4988ea0222da6, user_id=f3175ca0687f4a6b928e1db31d78e534, role_id=382636e67fc142a2b2f486340d959e11)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:35:58.383695 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14292124-e292-4a83-a2ef-d576d2c572aa admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:35:58.405761 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 944/1859] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 10 05:35:58 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 05:35:58.406798 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d884de-0a8a-4eca-b952-1b34ed67c0e0 admin admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:35:58.436138 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 916/1860] 10.222.0.23 () {60 vars in 1482 bytes} [Tue May 10 05:35:58 2022] PUT /identity/v3/projects/b915f47a796e47a6acd4988ea0222da6/users/f3175ca0687f4a6b928e1db31d78e534/roles/382636e67fc142a2b2f486340d959e11 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 05:35:58.440514 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d884de-0a8a-4eca-b952-1b34ed67c0e0 admin admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:35:58.450297 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6357e9a5-f1e1-4d73-a876-3d30162605b8 None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:35:58.451864 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6357e9a5-f1e1-4d73-a876-3d30162605b8 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:35:58.453283 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6357e9a5-f1e1-4d73-a876-3d30162605b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:35:58.534031 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-6357e9a5-f1e1-4d73-a876-3d30162605b8 None None] MFA Rules not processed for user `f3175ca0687f4a6b928e1db31d78e534`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:35:58.535617 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-6357e9a5-f1e1-4d73-a876-3d30162605b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:35:58.554864 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b763f17-c7bb-4ca8-9316-687c17b0f2dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:35:58.555566 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b763f17-c7bb-4ca8-9316-687c17b0f2dd admin admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:35:58.555886 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b763f17-c7bb-4ca8-9316-687c17b0f2dd admin admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:35:58.557456 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b763f17-c7bb-4ca8-9316-687c17b0f2dd admin admin] PATH_INFO: `/v3/roles` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:35:58.558220 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b763f17-c7bb-4ca8-9316-687c17b0f2dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:35:58.560560 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b763f17-c7bb-4ca8-9316-687c17b0f2dd admin admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:35:58.578908 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 945/1861] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 10 05:35:58 2022] GET /identity/v3/roles => generated 1420 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 05:35:58.584310 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b763f17-c7bb-4ca8-9316-687c17b0f2dd admin admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:35:58.610208 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b763f17-c7bb-4ca8-9316-687c17b0f2dd admin admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:35:58.621011 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f08f98c-5064-40ad-91ad-af553ce42352 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:35:58.621974 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f08f98c-5064-40ad-91ad-af553ce42352 admin admin] REQUEST_METHOD: `PUT` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:35:58.622191 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f08f98c-5064-40ad-91ad-af553ce42352 admin admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:35:58.623237 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f08f98c-5064-40ad-91ad-af553ce42352 admin admin] PATH_INFO: `/v3/projects/d3990bb8176647ef9f9d6d33b66dce76/users/78e9f65f6bfd42bf9e264b28ffbd4c93/roles/382636e67fc142a2b2f486340d959e11` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:35:58.658018 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f08f98c-5064-40ad-91ad-af553ce42352 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d3990bb8176647ef9f9d6d33b66dce76, user_id=78e9f65f6bfd42bf9e264b28ffbd4c93, role_id=382636e67fc142a2b2f486340d959e11)` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:35:58.663736 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f08f98c-5064-40ad-91ad-af553ce42352 admin admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:35:58.711101 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 946/1862] 10.222.0.23 () {60 vars in 1482 bytes} [Tue May 10 05:35:58 2022] PUT /identity/v3/projects/d3990bb8176647ef9f9d6d33b66dce76/users/78e9f65f6bfd42bf9e264b28ffbd4c93/roles/382636e67fc142a2b2f486340d959e11 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 05:35:58.711101 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593b5a42-c7cf-485c-be01-543bd82746f0 None None] REQUEST_METHOD: `POST` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:35:58.711101 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593b5a42-c7cf-485c-be01-543bd82746f0 None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:35:58.711101 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593b5a42-c7cf-485c-be01-543bd82746f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:35:58.715408 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 917/1863] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 10 05:35:58 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 05:35:58.719864 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6357e9a5-f1e1-4d73-a876-3d30162605b8 None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:35:58.740061 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6357e9a5-f1e1-4d73-a876-3d30162605b8 None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:35:58.751645 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.auth.core [None req-593b5a42-c7cf-485c-be01-543bd82746f0 None None] MFA Rules not processed for user `78e9f65f6bfd42bf9e264b28ffbd4c93`. Rule list: `[]` (Enabled: `True`). {{(pid=79879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:35:58.753437 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-593b5a42-c7cf-485c-be01-543bd82746f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:35:58.852558 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77587ee0-32a0-406f-a1f4-1add4a7705d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:35:58.853494 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77587ee0-32a0-406f-a1f4-1add4a7705d5 admin admin] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:35:58.855534 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77587ee0-32a0-406f-a1f4-1add4a7705d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:35:58.856063 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77587ee0-32a0-406f-a1f4-1add4a7705d5 admin admin] PATH_INFO: `/v3/projects` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:35:58.857110 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77587ee0-32a0-406f-a1f4-1add4a7705d5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:35:58.864713 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77587ee0-32a0-406f-a1f4-1add4a7705d5 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:35:58.885764 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 947/1864] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 10 05:35:58 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 05:35:58.886953 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593b5a42-c7cf-485c-be01-543bd82746f0 None None] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:35:58.888383 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-593b5a42-c7cf-485c-be01-543bd82746f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:35:58.908090 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593b5a42-c7cf-485c-be01-543bd82746f0 None None] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:35:58.917454 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94d40ac-dc75-4a51-bb47-d5f28782c2e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:35:58.918911 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94d40ac-dc75-4a51-bb47-d5f28782c2e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:35:58.919214 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94d40ac-dc75-4a51-bb47-d5f28782c2e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:35:58.919490 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94d40ac-dc75-4a51-bb47-d5f28782c2e1 admin admin] PATH_INFO: `/v3/users/ccd1888fdccd4bfea3a07b9486474427` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:35:58.921084 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94d40ac-dc75-4a51-bb47-d5f28782c2e1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ccd1888fdccd4bfea3a07b9486474427)` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:35:58.923584 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94d40ac-dc75-4a51-bb47-d5f28782c2e1 admin admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:35:58.939213 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 918/1865] 10.222.0.23 () {60 vars in 1152 bytes} [Tue May 10 05:35:58 2022] POST /identity/v3/projects => generated 379 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 05:35:58.940467 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77587ee0-32a0-406f-a1f4-1add4a7705d5 admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:35:59.000079 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-c94d40ac-dc75-4a51-bb47-d5f28782c2e1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ccd1888fdccd4bfea3a07b9486474427'} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:35:59.014017 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-c94d40ac-dc75-4a51-bb47-d5f28782c2e1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ccd1888fdccd4bfea3a07b9486474427'} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:35:59.014748 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-c94d40ac-dc75-4a51-bb47-d5f28782c2e1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ccd1888fdccd4bfea3a07b9486474427'} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:35:59.052337 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77587ee0-32a0-406f-a1f4-1add4a7705d5 admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:35:59.053779 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-c94d40ac-dc75-4a51-bb47-d5f28782c2e1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ccd1888fdccd4bfea3a07b9486474427'} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:35:59.063262 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-c94d40ac-dc75-4a51-bb47-d5f28782c2e1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ccd1888fdccd4bfea3a07b9486474427'} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:35:59.073810 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 948/1866] 10.222.0.23 () {58 vars in 1223 bytes} [Tue May 10 05:35:58 2022] DELETE /identity/v3/users/ccd1888fdccd4bfea3a07b9486474427 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 05:35:59.074811 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94d40ac-dc75-4a51-bb47-d5f28782c2e1 admin admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:35:59.075691 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91f8794-aa9a-4f36-8a0f-8f73b750d744 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:35:59.076444 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91f8794-aa9a-4f36-8a0f-8f73b750d744 admin admin] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:35:59.076746 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91f8794-aa9a-4f36-8a0f-8f73b750d744 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:35:59.077028 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91f8794-aa9a-4f36-8a0f-8f73b750d744 admin admin] PATH_INFO: `/v3/projects` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:35:59.077134 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-c94d40ac-dc75-4a51-bb47-d5f28782c2e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:35:59.077738 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91f8794-aa9a-4f36-8a0f-8f73b750d744 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:35:59.079755 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91f8794-aa9a-4f36-8a0f-8f73b750d744 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:35:59.111844 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 919/1867] 10.222.0.23 () {60 vars in 1152 bytes} [Tue May 10 05:35:58 2022] POST /identity/v3/projects => generated 379 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 05:35:59.113177 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e7c81e-8e58-4a53-a9a2-a3106799e602 None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:35:59.113466 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e7c81e-8e58-4a53-a9a2-a3106799e602 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:35:59.113742 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e7c81e-8e58-4a53-a9a2-a3106799e602 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:35:59.135299 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-23e7c81e-8e58-4a53-a9a2-a3106799e602 None None] MFA Rules not processed for user `44883b22532e44049d846938dc2cf423`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:35:59.136822 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-23e7c81e-8e58-4a53-a9a2-a3106799e602 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:35:59.159679 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94d40ac-dc75-4a51-bb47-d5f28782c2e1 admin admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:35:59.211314 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 920/1868] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 10 05:35:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 05:35:59.215267 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e7c81e-8e58-4a53-a9a2-a3106799e602 None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:35:59.216760 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-23e7c81e-8e58-4a53-a9a2-a3106799e602 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:35:59.241489 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5162897a-c282-40b2-ae29-88e9ce824bb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:35:59.242262 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5162897a-c282-40b2-ae29-88e9ce824bb9 admin admin] REQUEST_METHOD: `POST` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:35:59.242618 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5162897a-c282-40b2-ae29-88e9ce824bb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:35:59.243071 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5162897a-c282-40b2-ae29-88e9ce824bb9 admin admin] PATH_INFO: `/v3/users` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:35:59.243817 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5162897a-c282-40b2-ae29-88e9ce824bb9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:35:59.246209 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5162897a-c282-40b2-ae29-88e9ce824bb9 admin admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:35:59.251470 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e7c81e-8e58-4a53-a9a2-a3106799e602 None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:35:59.265962 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d776e528-2a1e-4ec1-ae36-157f00292256 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:35:59.267881 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d776e528-2a1e-4ec1-ae36-157f00292256 admin admin] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:35:59.268168 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d776e528-2a1e-4ec1-ae36-157f00292256 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:35:59.268447 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d776e528-2a1e-4ec1-ae36-157f00292256 admin admin] PATH_INFO: `/v3/users` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:35:59.269861 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d776e528-2a1e-4ec1-ae36-157f00292256 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:35:59.271921 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d776e528-2a1e-4ec1-ae36-157f00292256 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:35:59.273390 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 949/1869] 10.222.0.23 () {60 vars in 1143 bytes} [Tue May 10 05:35:59 2022] POST /identity/v3/users => generated 296 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 05:35:59.274400 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5162897a-c282-40b2-ae29-88e9ce824bb9 admin admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:35:59.276502 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-5162897a-c282-40b2-ae29-88e9ce824bb9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:35:59.296119 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 921/1870] 10.222.0.23 () {60 vars in 1143 bytes} [Tue May 10 05:35:59 2022] POST /identity/v3/users => generated 290 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 05:35:59.296119 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d776e528-2a1e-4ec1-ae36-157f00292256 admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:35:59.306130 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d776e528-2a1e-4ec1-ae36-157f00292256 admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:35:59.310967 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a71aef-adf2-48b7-85b6-815828851235 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:35:59.311980 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a71aef-adf2-48b7-85b6-815828851235 admin admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:35:59.312090 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a71aef-adf2-48b7-85b6-815828851235 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:35:59.312328 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a71aef-adf2-48b7-85b6-815828851235 admin admin] PATH_INFO: `/v3/roles` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:35:59.313121 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a71aef-adf2-48b7-85b6-815828851235 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:35:59.314761 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a71aef-adf2-48b7-85b6-815828851235 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:35:59.325369 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 922/1871] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 10 05:35:59 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 05:35:59.326314 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a71aef-adf2-48b7-85b6-815828851235 admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:35:59.337549 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a71aef-adf2-48b7-85b6-815828851235 admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:35:59.342715 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9f0ca0-ad2f-4b36-8a35-3e4fd591ccfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:35:59.343640 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9f0ca0-ad2f-4b36-8a35-3e4fd591ccfe admin admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:35:59.343922 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9f0ca0-ad2f-4b36-8a35-3e4fd591ccfe admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:35:59.344199 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9f0ca0-ad2f-4b36-8a35-3e4fd591ccfe admin admin] PATH_INFO: `/v3/roles` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:35:59.345172 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9f0ca0-ad2f-4b36-8a35-3e4fd591ccfe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:35:59.346776 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9f0ca0-ad2f-4b36-8a35-3e4fd591ccfe admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:35:59.348902 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5162897a-c282-40b2-ae29-88e9ce824bb9 admin admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:35:59.352736 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3b3631-6d9d-47c5-83b0-20efee1262e8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c8461cfdd9648b8abcaf8d34b7a102a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f23435f783540199d6dcfd0417c090e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:35:59.353464 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3b3631-6d9d-47c5-83b0-20efee1262e8 service neutron] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:35:59.353760 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3b3631-6d9d-47c5-83b0-20efee1262e8 service neutron] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:35:59.354068 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3b3631-6d9d-47c5-83b0-20efee1262e8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:35:59.359039 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 923/1872] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 10 05:35:59 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 05:35:59.360267 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9f0ca0-ad2f-4b36-8a35-3e4fd591ccfe admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:35:59.365848 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3b3631-6d9d-47c5-83b0-20efee1262e8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:35:59.367321 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3b3631-6d9d-47c5-83b0-20efee1262e8 service neutron] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:35:59.370726 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9f0ca0-ad2f-4b36-8a35-3e4fd591ccfe admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:35:59.377933 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bf3b91-acd2-43fd-ace7-0871a21f4664 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:35:59.378530 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 950/1873] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 10 05:35:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 05:35:59.379012 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bf3b91-acd2-43fd-ace7-0871a21f4664 admin admin] REQUEST_METHOD: `PUT` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:35:59.379358 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bf3b91-acd2-43fd-ace7-0871a21f4664 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:35:59.379476 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3b3631-6d9d-47c5-83b0-20efee1262e8 service neutron] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:35:59.379729 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bf3b91-acd2-43fd-ace7-0871a21f4664 admin admin] PATH_INFO: `/v3/projects/37aa078348fe4f26831aaac5977292f1/users/168e77fed59d4ec68e5f169a79ef7e9f/roles/199ac1dd842441d7913c6ee89d8fbecc` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:35:59.389708 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3b3631-6d9d-47c5-83b0-20efee1262e8 service neutron] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:35:59.395296 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2bf3b91-acd2-43fd-ace7-0871a21f4664 admin admin] RBAC: Authorizing `identity:create_grant(project_id=37aa078348fe4f26831aaac5977292f1, user_id=168e77fed59d4ec68e5f169a79ef7e9f, role_id=199ac1dd842441d7913c6ee89d8fbecc)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:35:59.396211 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba530fb-6efc-48d3-aa36-0c2fff45e88f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:35:59.397078 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba530fb-6efc-48d3-aa36-0c2fff45e88f admin admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:35:59.397367 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba530fb-6efc-48d3-aa36-0c2fff45e88f admin admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:35:59.397646 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba530fb-6efc-48d3-aa36-0c2fff45e88f admin admin] PATH_INFO: `/v3/roles` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:35:59.398386 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba530fb-6efc-48d3-aa36-0c2fff45e88f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:35:59.398866 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2bf3b91-acd2-43fd-ace7-0871a21f4664 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:35:59.400283 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba530fb-6efc-48d3-aa36-0c2fff45e88f admin admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:35:59.415276 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 924/1874] 10.222.0.23 () {60 vars in 1482 bytes} [Tue May 10 05:35:59 2022] PUT /identity/v3/projects/37aa078348fe4f26831aaac5977292f1/users/168e77fed59d4ec68e5f169a79ef7e9f/roles/199ac1dd842441d7913c6ee89d8fbecc => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 05:35:59.419654 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 951/1875] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 10 05:35:59 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 05:35:59.420053 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bf3b91-acd2-43fd-ace7-0871a21f4664 admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:35:59.422843 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba530fb-6efc-48d3-aa36-0c2fff45e88f admin admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:35:59.434110 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba530fb-6efc-48d3-aa36-0c2fff45e88f admin admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:35:59.497282 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bf3b91-acd2-43fd-ace7-0871a21f4664 admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:35:59.503479 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702d6341-7f5b-48cd-b72b-b39811624202 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:35:59.504217 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702d6341-7f5b-48cd-b72b-b39811624202 admin admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:35:59.504504 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702d6341-7f5b-48cd-b72b-b39811624202 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:35:59.504787 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702d6341-7f5b-48cd-b72b-b39811624202 admin admin] PATH_INFO: `/v3/roles` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:35:59.505750 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702d6341-7f5b-48cd-b72b-b39811624202 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:35:59.507326 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702d6341-7f5b-48cd-b72b-b39811624202 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:35:59.515603 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc965d1-b257-4448-a1e7-2103334e7d9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:35:59.516547 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc965d1-b257-4448-a1e7-2103334e7d9f admin admin] REQUEST_METHOD: `PUT` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:35:59.516830 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc965d1-b257-4448-a1e7-2103334e7d9f admin admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:35:59.517102 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc965d1-b257-4448-a1e7-2103334e7d9f admin admin] PATH_INFO: `/v3/projects/357e48a5e8204a3baa448d0631acadbe/users/b555f5baa16c46c3bea333667c022764/roles/382636e67fc142a2b2f486340d959e11` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:35:59.521282 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 925/1876] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 10 05:35:59 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 05:35:59.527544 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702d6341-7f5b-48cd-b72b-b39811624202 admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:35:59.538221 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702d6341-7f5b-48cd-b72b-b39811624202 admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:35:59.540528 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc965d1-b257-4448-a1e7-2103334e7d9f admin admin] RBAC: Authorizing `identity:create_grant(project_id=357e48a5e8204a3baa448d0631acadbe, user_id=b555f5baa16c46c3bea333667c022764, role_id=382636e67fc142a2b2f486340d959e11)` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:35:59.544641 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc965d1-b257-4448-a1e7-2103334e7d9f admin admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:35:59.551965 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fef361b-9a77-4aec-a4d9-111beaad4d69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:35:59.553308 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fef361b-9a77-4aec-a4d9-111beaad4d69 admin admin] REQUEST_METHOD: `PUT` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:35:59.554637 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fef361b-9a77-4aec-a4d9-111beaad4d69 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:35:59.554923 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fef361b-9a77-4aec-a4d9-111beaad4d69 admin admin] PATH_INFO: `/v3/projects/37aa078348fe4f26831aaac5977292f1/users/168e77fed59d4ec68e5f169a79ef7e9f/roles/199ac1dd842441d7913c6ee89d8fbecc` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:35:59.557141 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fef361b-9a77-4aec-a4d9-111beaad4d69 admin admin] RBAC: Authorizing `identity:create_grant(project_id=37aa078348fe4f26831aaac5977292f1, user_id=168e77fed59d4ec68e5f169a79ef7e9f, role_id=199ac1dd842441d7913c6ee89d8fbecc)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:35:59.559945 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fef361b-9a77-4aec-a4d9-111beaad4d69 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:35:59.573592 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 952/1877] 10.222.0.23 () {60 vars in 1482 bytes} [Tue May 10 05:35:59 2022] PUT /identity/v3/projects/357e48a5e8204a3baa448d0631acadbe/users/b555f5baa16c46c3bea333667c022764/roles/382636e67fc142a2b2f486340d959e11 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 05:35:59.588835 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 926/1878] 10.222.0.23 () {60 vars in 1482 bytes} [Tue May 10 05:35:59 2022] PUT /identity/v3/projects/37aa078348fe4f26831aaac5977292f1/users/168e77fed59d4ec68e5f169a79ef7e9f/roles/199ac1dd842441d7913c6ee89d8fbecc => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 05:35:59.599098 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3207b9fe-7b58-4e15-aa84-272deadf1e2a None None] REQUEST_METHOD: `POST` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:35:59.602216 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b35aeac-7fe3-47b1-a9b0-075cee6117e1 None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:35:59.602525 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b35aeac-7fe3-47b1-a9b0-075cee6117e1 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:35:59.602808 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b35aeac-7fe3-47b1-a9b0-075cee6117e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:35:59.607860 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3207b9fe-7b58-4e15-aa84-272deadf1e2a None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:35:59.608579 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3207b9fe-7b58-4e15-aa84-272deadf1e2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:35:59.669059 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-1b35aeac-7fe3-47b1-a9b0-075cee6117e1 None None] MFA Rules not processed for user `168e77fed59d4ec68e5f169a79ef7e9f`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:35:59.671404 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-1b35aeac-7fe3-47b1-a9b0-075cee6117e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:35:59.679996 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.auth.core [None req-3207b9fe-7b58-4e15-aa84-272deadf1e2a None None] MFA Rules not processed for user `b555f5baa16c46c3bea333667c022764`. Rule list: `[]` (Enabled: `True`). {{(pid=79879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:35:59.681483 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-3207b9fe-7b58-4e15-aa84-272deadf1e2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:35:59.770346 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 953/1879] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 10 05:35:59 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 05:35:59.774916 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3207b9fe-7b58-4e15-aa84-272deadf1e2a None None] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:35:59.800583 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 927/1880] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 10 05:35:59 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 05:35:59.811725 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b35aeac-7fe3-47b1-a9b0-075cee6117e1 None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:35:59.813293 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-1b35aeac-7fe3-47b1-a9b0-075cee6117e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:35:59.884954 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3207b9fe-7b58-4e15-aa84-272deadf1e2a None None] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:35:59.889667 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3513e72c-8a93-4c9b-98fb-60b641316839 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:35:59.891094 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3513e72c-8a93-4c9b-98fb-60b641316839 admin admin] REQUEST_METHOD: `POST` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:35:59.891951 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3513e72c-8a93-4c9b-98fb-60b641316839 admin admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:35:59.892497 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3513e72c-8a93-4c9b-98fb-60b641316839 admin admin] PATH_INFO: `/v3/projects` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:35:59.893596 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3513e72c-8a93-4c9b-98fb-60b641316839 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:35:59.895727 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3513e72c-8a93-4c9b-98fb-60b641316839 admin admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:35:59.936893 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 954/1881] 10.222.0.23 () {60 vars in 1152 bytes} [Tue May 10 05:35:59 2022] POST /identity/v3/projects => generated 377 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 05:35:59.941306 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3513e72c-8a93-4c9b-98fb-60b641316839 admin admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:35:59.952132 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b35aeac-7fe3-47b1-a9b0-075cee6117e1 None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:36:00.010971 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3513e72c-8a93-4c9b-98fb-60b641316839 admin admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:36:00.012408 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb7fe6d-2519-4f92-9716-8edc275d6f41 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355be413675540a39ccb00e1a0722316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f23435f783540199d6dcfd0417c090e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:36:00.013517 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb7fe6d-2519-4f92-9716-8edc275d6f41 service cinder] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:36:00.014200 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb7fe6d-2519-4f92-9716-8edc275d6f41 service cinder] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:36:00.014475 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb7fe6d-2519-4f92-9716-8edc275d6f41 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:36:00.017108 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95586c7-6bd4-407d-81d0-15924fad84c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:36:00.017990 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95586c7-6bd4-407d-81d0-15924fad84c2 admin admin] REQUEST_METHOD: `POST` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:36:00.018368 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95586c7-6bd4-407d-81d0-15924fad84c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:36:00.018976 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95586c7-6bd4-407d-81d0-15924fad84c2 admin admin] PATH_INFO: `/v3/users` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:36:00.019786 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95586c7-6bd4-407d-81d0-15924fad84c2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:36:00.022347 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95586c7-6bd4-407d-81d0-15924fad84c2 admin admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:36:00.047826 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 955/1882] 10.222.0.23 () {60 vars in 1143 bytes} [Tue May 10 05:35:59 2022] POST /identity/v3/users => generated 295 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 05:36:00.048794 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95586c7-6bd4-407d-81d0-15924fad84c2 admin admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:36:00.060214 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95586c7-6bd4-407d-81d0-15924fad84c2 admin admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:36:00.065684 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c052b9-354f-4492-a881-71fdeb21e142 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:36:00.066271 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c052b9-354f-4492-a881-71fdeb21e142 admin admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:36:00.066788 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c052b9-354f-4492-a881-71fdeb21e142 admin admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:36:00.066788 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c052b9-354f-4492-a881-71fdeb21e142 admin admin] PATH_INFO: `/v3/roles` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:36:00.067902 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c052b9-354f-4492-a881-71fdeb21e142 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:36:00.069742 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c052b9-354f-4492-a881-71fdeb21e142 admin admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:36:00.082210 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 956/1883] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 10 05:36:00 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 05:36:00.086261 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c052b9-354f-4492-a881-71fdeb21e142 admin admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:36:00.088069 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb7fe6d-2519-4f92-9716-8edc275d6f41 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:36:00.089634 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb7fe6d-2519-4f92-9716-8edc275d6f41 service cinder] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:36:00.097859 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c052b9-354f-4492-a881-71fdeb21e142 admin admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:36:00.102234 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 928/1884] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 10 05:35:59 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 05:36:00.103509 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a90b8f-9384-4fb2-93a5-4805d81f0b18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:36:00.104525 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a90b8f-9384-4fb2-93a5-4805d81f0b18 admin admin] REQUEST_METHOD: `PUT` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:36:00.104900 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a90b8f-9384-4fb2-93a5-4805d81f0b18 admin admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:36:00.105247 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a90b8f-9384-4fb2-93a5-4805d81f0b18 admin admin] PATH_INFO: `/v3/projects/1e0dd769e0e545f2a0c382699e8038b2/users/697b4f5da9a04252895155a6655f47f7/roles/199ac1dd842441d7913c6ee89d8fbecc` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:36:00.129739 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a90b8f-9384-4fb2-93a5-4805d81f0b18 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e0dd769e0e545f2a0c382699e8038b2, user_id=697b4f5da9a04252895155a6655f47f7, role_id=199ac1dd842441d7913c6ee89d8fbecc)` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:36:00.135174 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a90b8f-9384-4fb2-93a5-4805d81f0b18 admin admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:36:00.155211 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 957/1885] 10.222.0.23 () {60 vars in 1482 bytes} [Tue May 10 05:36:00 2022] PUT /identity/v3/projects/1e0dd769e0e545f2a0c382699e8038b2/users/697b4f5da9a04252895155a6655f47f7/roles/199ac1dd842441d7913c6ee89d8fbecc => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 05:36:00.159804 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb7fe6d-2519-4f92-9716-8edc275d6f41 service cinder] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:36:00.175391 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb7fe6d-2519-4f92-9716-8edc275d6f41 service cinder] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:36:00.240259 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31690a19-dc0a-4485-9cb2-49f790881f4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:36:00.240844 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31690a19-dc0a-4485-9cb2-49f790881f4c admin admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:36:00.241128 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31690a19-dc0a-4485-9cb2-49f790881f4c admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:36:00.241450 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31690a19-dc0a-4485-9cb2-49f790881f4c admin admin] PATH_INFO: `/v3/roles` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:36:00.242192 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31690a19-dc0a-4485-9cb2-49f790881f4c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:36:00.243988 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31690a19-dc0a-4485-9cb2-49f790881f4c admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:36:00.260220 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 929/1886] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 10 05:36:00 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 05:36:00.262811 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a90b8f-9384-4fb2-93a5-4805d81f0b18 admin admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:36:00.300164 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31690a19-dc0a-4485-9cb2-49f790881f4c admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:36:00.302295 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-31690a19-dc0a-4485-9cb2-49f790881f4c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:36:00.302439 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a90b8f-9384-4fb2-93a5-4805d81f0b18 admin admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:36:00.323648 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31690a19-dc0a-4485-9cb2-49f790881f4c admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:36:00.334768 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c52837-2a60-4f98-bcfe-c6a21348f667 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:36:00.336990 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c52837-2a60-4f98-bcfe-c6a21348f667 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:36:00.337274 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c52837-2a60-4f98-bcfe-c6a21348f667 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:36:00.337560 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c52837-2a60-4f98-bcfe-c6a21348f667 admin admin] PATH_INFO: `/v3/projects/855610fee45b447f818ba2e08439f40a` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:36:00.339296 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bc6e46-1bc1-4e52-8adc-4be34602a257 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:36:00.340280 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bc6e46-1bc1-4e52-8adc-4be34602a257 admin admin] REQUEST_METHOD: `PUT` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:36:00.340561 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bc6e46-1bc1-4e52-8adc-4be34602a257 admin admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:36:00.340837 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bc6e46-1bc1-4e52-8adc-4be34602a257 admin admin] PATH_INFO: `/v3/projects/1e0dd769e0e545f2a0c382699e8038b2/users/697b4f5da9a04252895155a6655f47f7/roles/199ac1dd842441d7913c6ee89d8fbecc` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:36:00.342444 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c52837-2a60-4f98-bcfe-c6a21348f667 admin admin] RBAC: Authorizing `identity:delete_project(project_id=855610fee45b447f818ba2e08439f40a)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:36:00.345692 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c52837-2a60-4f98-bcfe-c6a21348f667 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:36:00.351297 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92bc6e46-1bc1-4e52-8adc-4be34602a257 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e0dd769e0e545f2a0c382699e8038b2, user_id=697b4f5da9a04252895155a6655f47f7, role_id=199ac1dd842441d7913c6ee89d8fbecc)` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:36:00.356292 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92bc6e46-1bc1-4e52-8adc-4be34602a257 admin admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:36:00.407681 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 958/1887] 10.222.0.23 () {60 vars in 1482 bytes} [Tue May 10 05:36:00 2022] PUT /identity/v3/projects/1e0dd769e0e545f2a0c382699e8038b2/users/697b4f5da9a04252895155a6655f47f7/roles/199ac1dd842441d7913c6ee89d8fbecc => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 05:36:00.407988 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-b7c52837-2a60-4f98-bcfe-c6a21348f667 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '855610fee45b447f818ba2e08439f40a', 'request_id': 'req-b7c52837-2a60-4f98-bcfe-c6a21348f667'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:36:00.416185 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcdfca9-f532-4efa-8d2b-f5f7f9302b68 None None] REQUEST_METHOD: `POST` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:36:00.416472 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcdfca9-f532-4efa-8d2b-f5f7f9302b68 None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:36:00.416749 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcdfca9-f532-4efa-8d2b-f5f7f9302b68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:36:00.434276 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-b7c52837-2a60-4f98-bcfe-c6a21348f667 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '855610fee45b447f818ba2e08439f40a', 'request_id': 'req-b7c52837-2a60-4f98-bcfe-c6a21348f667'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:36:00.452278 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-b7c52837-2a60-4f98-bcfe-c6a21348f667 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '855610fee45b447f818ba2e08439f40a', 'request_id': 'req-b7c52837-2a60-4f98-bcfe-c6a21348f667'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:36:00.460662 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.auth.core [None req-cfcdfca9-f532-4efa-8d2b-f5f7f9302b68 None None] MFA Rules not processed for user `697b4f5da9a04252895155a6655f47f7`. Rule list: `[]` (Enabled: `True`). {{(pid=79879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:36:00.462171 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-cfcdfca9-f532-4efa-8d2b-f5f7f9302b68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:36:00.479918 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-b7c52837-2a60-4f98-bcfe-c6a21348f667 admin admin] The token cache is being invalidate because project 855610fee45b447f818ba2e08439f40a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79880) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 05:36:00.481361 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-b7c52837-2a60-4f98-bcfe-c6a21348f667 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:36:00.482861 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-b7c52837-2a60-4f98-bcfe-c6a21348f667 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:36:00.489675 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 930/1888] 10.222.0.23 () {58 vars in 1232 bytes} [Tue May 10 05:36:00 2022] DELETE /identity/v3/projects/855610fee45b447f818ba2e08439f40a => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 05:36:00.490641 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c52837-2a60-4f98-bcfe-c6a21348f667 admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:36:00.492575 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-b7c52837-2a60-4f98-bcfe-c6a21348f667 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:36:00.585576 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 959/1889] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 10 05:36:00 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 05:36:00.609340 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcdfca9-f532-4efa-8d2b-f5f7f9302b68 None None] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:36:00.611051 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-cfcdfca9-f532-4efa-8d2b-f5f7f9302b68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:36:00.633797 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c52837-2a60-4f98-bcfe-c6a21348f667 admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:36:00.639545 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e060df5c-82aa-44ac-adc4-57b20acfdd52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:36:00.640510 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e060df5c-82aa-44ac-adc4-57b20acfdd52 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:36:00.640908 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e060df5c-82aa-44ac-adc4-57b20acfdd52 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:36:00.641392 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e060df5c-82aa-44ac-adc4-57b20acfdd52 admin admin] PATH_INFO: `/v3/users/e2230c2bc8814d95a3d9d8ec68b829dd` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:36:00.645510 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e060df5c-82aa-44ac-adc4-57b20acfdd52 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e2230c2bc8814d95a3d9d8ec68b829dd)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:36:00.647597 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e060df5c-82aa-44ac-adc4-57b20acfdd52 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:36:00.670653 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcdfca9-f532-4efa-8d2b-f5f7f9302b68 None None] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:36:00.674368 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d39dac-278d-4ffb-8313-5c48ee80fa78 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355be413675540a39ccb00e1a0722316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f23435f783540199d6dcfd0417c090e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:36:00.675053 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d39dac-278d-4ffb-8313-5c48ee80fa78 service cinder] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:36:00.675360 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d39dac-278d-4ffb-8313-5c48ee80fa78 service cinder] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:36:00.675818 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d39dac-278d-4ffb-8313-5c48ee80fa78 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:36:00.685754 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d39dac-278d-4ffb-8313-5c48ee80fa78 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:36:00.687195 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d39dac-278d-4ffb-8313-5c48ee80fa78 service cinder] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:36:00.696698 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 960/1890] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 10 05:36:00 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 05:36:00.697304 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d39dac-278d-4ffb-8313-5c48ee80fa78 service cinder] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:36:00.697413 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-e060df5c-82aa-44ac-adc4-57b20acfdd52 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e2230c2bc8814d95a3d9d8ec68b829dd'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:36:00.698555 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-29d39dac-278d-4ffb-8313-5c48ee80fa78 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:36:00.710276 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-e060df5c-82aa-44ac-adc4-57b20acfdd52 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e2230c2bc8814d95a3d9d8ec68b829dd'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:36:00.711144 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-e060df5c-82aa-44ac-adc4-57b20acfdd52 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e2230c2bc8814d95a3d9d8ec68b829dd'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:36:00.712465 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d39dac-278d-4ffb-8313-5c48ee80fa78 service cinder] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:36:00.717836 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99b873e-b2a5-4112-974b-6d91bd9e2db6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:36:00.718760 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99b873e-b2a5-4112-974b-6d91bd9e2db6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:36:00.719034 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99b873e-b2a5-4112-974b-6d91bd9e2db6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:36:00.719341 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99b873e-b2a5-4112-974b-6d91bd9e2db6 admin admin] PATH_INFO: `/v3/users/f3175ca0687f4a6b928e1db31d78e534` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:36:00.720191 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-e060df5c-82aa-44ac-adc4-57b20acfdd52 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e2230c2bc8814d95a3d9d8ec68b829dd'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:36:00.720631 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99b873e-b2a5-4112-974b-6d91bd9e2db6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f3175ca0687f4a6b928e1db31d78e534)` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:36:00.721181 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-e060df5c-82aa-44ac-adc4-57b20acfdd52 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e2230c2bc8814d95a3d9d8ec68b829dd'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:36:00.722926 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99b873e-b2a5-4112-974b-6d91bd9e2db6 admin admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:36:00.739665 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 931/1891] 10.222.0.23 () {58 vars in 1223 bytes} [Tue May 10 05:36:00 2022] DELETE /identity/v3/users/e2230c2bc8814d95a3d9d8ec68b829dd => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 05:36:00.741297 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e060df5c-82aa-44ac-adc4-57b20acfdd52 admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:36:00.742632 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-e060df5c-82aa-44ac-adc4-57b20acfdd52 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:36:00.773910 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-b99b873e-b2a5-4112-974b-6d91bd9e2db6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f3175ca0687f4a6b928e1db31d78e534'} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:36:00.784273 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-b99b873e-b2a5-4112-974b-6d91bd9e2db6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f3175ca0687f4a6b928e1db31d78e534'} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:36:00.784690 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-b99b873e-b2a5-4112-974b-6d91bd9e2db6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f3175ca0687f4a6b928e1db31d78e534'} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:36:00.800047 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-b99b873e-b2a5-4112-974b-6d91bd9e2db6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f3175ca0687f4a6b928e1db31d78e534'} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:36:00.807706 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-b99b873e-b2a5-4112-974b-6d91bd9e2db6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f3175ca0687f4a6b928e1db31d78e534'} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:36:00.814796 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 961/1892] 10.222.0.23 () {58 vars in 1223 bytes} [Tue May 10 05:36:00 2022] DELETE /identity/v3/users/f3175ca0687f4a6b928e1db31d78e534 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 05:36:00.818856 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e060df5c-82aa-44ac-adc4-57b20acfdd52 admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:36:00.820296 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e418cb-4f21-4a98-aaef-cf0a434131f5 None None] REQUEST_METHOD: `POST` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:36:00.820687 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e418cb-4f21-4a98-aaef-cf0a434131f5 None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:36:00.820980 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e418cb-4f21-4a98-aaef-cf0a434131f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:36:00.839406 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.auth.core [None req-58e418cb-4f21-4a98-aaef-cf0a434131f5 None None] MFA Rules not processed for user `44883b22532e44049d846938dc2cf423`. Rule list: `[]` (Enabled: `True`). {{(pid=79879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:36:00.841309 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-58e418cb-4f21-4a98-aaef-cf0a434131f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:36:00.873332 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec31718e-0486-4f34-a77c-668402059cc2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355be413675540a39ccb00e1a0722316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f23435f783540199d6dcfd0417c090e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:36:00.874009 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec31718e-0486-4f34-a77c-668402059cc2 service cinder] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:36:00.874277 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec31718e-0486-4f34-a77c-668402059cc2 service cinder] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:36:00.874549 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec31718e-0486-4f34-a77c-668402059cc2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:36:00.876874 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-ec31718e-0486-4f34-a77c-668402059cc2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:36:00.902856 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 962/1893] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 10 05:36:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 05:36:00.912743 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e418cb-4f21-4a98-aaef-cf0a434131f5 None None] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:36:00.914908 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-58e418cb-4f21-4a98-aaef-cf0a434131f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:36:00.945621 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec31718e-0486-4f34-a77c-668402059cc2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:36:00.947897 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec31718e-0486-4f34-a77c-668402059cc2 service cinder] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:36:00.957637 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 932/1894] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 10 05:36:00 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 05:36:00.974229 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e418cb-4f21-4a98-aaef-cf0a434131f5 None None] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:36:00.978163 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b7c0e4-8a8e-46a4-a027-d149247d85ec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c8461cfdd9648b8abcaf8d34b7a102a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f23435f783540199d6dcfd0417c090e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:36:00.978816 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b7c0e4-8a8e-46a4-a027-d149247d85ec service neutron] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:36:00.979099 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b7c0e4-8a8e-46a4-a027-d149247d85ec service neutron] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:36:00.979698 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b7c0e4-8a8e-46a4-a027-d149247d85ec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:36:00.988775 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b7c0e4-8a8e-46a4-a027-d149247d85ec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:36:00.990393 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b7c0e4-8a8e-46a4-a027-d149247d85ec service neutron] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:36:01.001148 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 963/1895] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 10 05:36:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 05:36:01.046217 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec31718e-0486-4f34-a77c-668402059cc2 service cinder] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:36:01.051137 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-ec31718e-0486-4f34-a77c-668402059cc2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:36:01.068022 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec31718e-0486-4f34-a77c-668402059cc2 service cinder] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:36:01.073760 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2872db0c-c29a-4595-b5dd-9679c3f49b66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:36:01.075520 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2872db0c-c29a-4595-b5dd-9679c3f49b66 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:36:01.076997 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2872db0c-c29a-4595-b5dd-9679c3f49b66 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:36:01.077215 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2872db0c-c29a-4595-b5dd-9679c3f49b66 admin admin] PATH_INFO: `/v3/projects/df3cd8b6961e4c61a2d9bbf239b2a5d6` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:36:01.078869 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2872db0c-c29a-4595-b5dd-9679c3f49b66 admin admin] RBAC: Authorizing `identity:delete_project(project_id=df3cd8b6961e4c61a2d9bbf239b2a5d6)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:36:01.081984 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2872db0c-c29a-4595-b5dd-9679c3f49b66 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:36:01.141346 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-2872db0c-c29a-4595-b5dd-9679c3f49b66 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'df3cd8b6961e4c61a2d9bbf239b2a5d6', 'request_id': 'req-2872db0c-c29a-4595-b5dd-9679c3f49b66'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:36:01.148054 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-2872db0c-c29a-4595-b5dd-9679c3f49b66 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'df3cd8b6961e4c61a2d9bbf239b2a5d6', 'request_id': 'req-2872db0c-c29a-4595-b5dd-9679c3f49b66'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:36:01.157263 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-2872db0c-c29a-4595-b5dd-9679c3f49b66 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'df3cd8b6961e4c61a2d9bbf239b2a5d6', 'request_id': 'req-2872db0c-c29a-4595-b5dd-9679c3f49b66'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:36:01.169537 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-2872db0c-c29a-4595-b5dd-9679c3f49b66 admin admin] The token cache is being invalidate because project df3cd8b6961e4c61a2d9bbf239b2a5d6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79880) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 05:36:01.169898 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-2872db0c-c29a-4595-b5dd-9679c3f49b66 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:36:01.170610 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-2872db0c-c29a-4595-b5dd-9679c3f49b66 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:36:01.172395 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 933/1896] 10.222.0.23 () {58 vars in 1232 bytes} [Tue May 10 05:36:01 2022] DELETE /identity/v3/projects/df3cd8b6961e4c61a2d9bbf239b2a5d6 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 05:36:01.177282 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1659e5b-bdfc-4961-af69-a35948aefc7a None None] REQUEST_METHOD: `POST` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:36:01.177717 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1659e5b-bdfc-4961-af69-a35948aefc7a None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:36:01.177999 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1659e5b-bdfc-4961-af69-a35948aefc7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:36:01.203134 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.auth.core [None req-f1659e5b-bdfc-4961-af69-a35948aefc7a None None] MFA Rules not processed for user `44883b22532e44049d846938dc2cf423`. Rule list: `[]` (Enabled: `True`). {{(pid=79879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:36:01.204515 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-f1659e5b-bdfc-4961-af69-a35948aefc7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:36:01.271798 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 964/1897] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 10 05:36:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 05:36:01.279720 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22973aea-8006-48e5-afff-fb2a28f60ee6 None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:36:01.280098 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22973aea-8006-48e5-afff-fb2a28f60ee6 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:36:01.280394 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22973aea-8006-48e5-afff-fb2a28f60ee6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:36:01.320532 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-22973aea-8006-48e5-afff-fb2a28f60ee6 None None] MFA Rules not processed for user `44883b22532e44049d846938dc2cf423`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:36:01.325083 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-22973aea-8006-48e5-afff-fb2a28f60ee6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:36:01.340094 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 934/1898] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 10 05:36:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 05:36:01.346105 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1659e5b-bdfc-4961-af69-a35948aefc7a None None] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:36:01.354111 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22973aea-8006-48e5-afff-fb2a28f60ee6 None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:36:01.358230 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1659e5b-bdfc-4961-af69-a35948aefc7a None None] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:36:01.360081 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-22973aea-8006-48e5-afff-fb2a28f60ee6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:36:01.363953 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8e9e42-2fe6-4368-8b61-3ac18054a530 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:36:01.364914 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8e9e42-2fe6-4368-8b61-3ac18054a530 admin admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:36:01.365390 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8e9e42-2fe6-4368-8b61-3ac18054a530 admin admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:36:01.366105 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8e9e42-2fe6-4368-8b61-3ac18054a530 admin admin] PATH_INFO: `/v3/domains` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:36:01.367541 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8e9e42-2fe6-4368-8b61-3ac18054a530 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:36:01.368054 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8e9e42-2fe6-4368-8b61-3ac18054a530 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:36:01.370061 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8e9e42-2fe6-4368-8b61-3ac18054a530 admin admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:36:01.390237 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 965/1899] 10.222.0.23 () {58 vars in 1152 bytes} [Tue May 10 05:36:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:36:01.390486 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22973aea-8006-48e5-afff-fb2a28f60ee6 None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:36:01.394493 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8e9e42-2fe6-4368-8b61-3ac18054a530 admin admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:36:01.398537 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5df5c15-8a82-4966-9307-e776174c91ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:36:01.400758 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5df5c15-8a82-4966-9307-e776174c91ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:36:01.401185 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5df5c15-8a82-4966-9307-e776174c91ee admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:36:01.401448 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5df5c15-8a82-4966-9307-e776174c91ee admin admin] PATH_INFO: `/v3/projects/b915f47a796e47a6acd4988ea0222da6` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:36:01.403129 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5df5c15-8a82-4966-9307-e776174c91ee admin admin] RBAC: Authorizing `identity:delete_project(project_id=b915f47a796e47a6acd4988ea0222da6)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:36:01.405431 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5df5c15-8a82-4966-9307-e776174c91ee admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:36:01.421324 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8e9e42-2fe6-4368-8b61-3ac18054a530 admin admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:36:01.429285 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6513ce3-8558-4097-80f2-19d495955f8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:36:01.430081 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6513ce3-8558-4097-80f2-19d495955f8e admin admin] REQUEST_METHOD: `POST` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:36:01.430433 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6513ce3-8558-4097-80f2-19d495955f8e admin admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:36:01.430776 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6513ce3-8558-4097-80f2-19d495955f8e admin admin] PATH_INFO: `/v3/projects` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:36:01.431656 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6513ce3-8558-4097-80f2-19d495955f8e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:36:01.433909 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6513ce3-8558-4097-80f2-19d495955f8e admin admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:36:01.464321 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 966/1900] 10.222.0.23 () {60 vars in 1152 bytes} [Tue May 10 05:36:01 2022] POST /identity/v3/projects => generated 363 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 05:36:01.468363 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6513ce3-8558-4097-80f2-19d495955f8e admin admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:36:01.474999 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-e5df5c15-8a82-4966-9307-e776174c91ee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b915f47a796e47a6acd4988ea0222da6', 'request_id': 'req-e5df5c15-8a82-4966-9307-e776174c91ee'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:36:01.485043 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-e5df5c15-8a82-4966-9307-e776174c91ee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b915f47a796e47a6acd4988ea0222da6', 'request_id': 'req-e5df5c15-8a82-4966-9307-e776174c91ee'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:36:01.495996 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-e5df5c15-8a82-4966-9307-e776174c91ee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b915f47a796e47a6acd4988ea0222da6', 'request_id': 'req-e5df5c15-8a82-4966-9307-e776174c91ee'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:36:01.507278 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-e5df5c15-8a82-4966-9307-e776174c91ee admin admin] The token cache is being invalidate because project b915f47a796e47a6acd4988ea0222da6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79880) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 05:36:01.508247 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-e5df5c15-8a82-4966-9307-e776174c91ee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:36:01.508439 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-e5df5c15-8a82-4966-9307-e776174c91ee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:36:01.511710 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 935/1901] 10.222.0.23 () {58 vars in 1232 bytes} [Tue May 10 05:36:01 2022] DELETE /identity/v3/projects/b915f47a796e47a6acd4988ea0222da6 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 05:36:01.514064 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5df5c15-8a82-4966-9307-e776174c91ee admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:36:01.515597 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-e5df5c15-8a82-4966-9307-e776174c91ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:36:01.544086 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6513ce3-8558-4097-80f2-19d495955f8e admin admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:36:01.549978 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b11536-6a33-4b56-a534-42e6ae02946f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:36:01.550695 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b11536-6a33-4b56-a534-42e6ae02946f admin admin] REQUEST_METHOD: `POST` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:36:01.550974 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b11536-6a33-4b56-a534-42e6ae02946f admin admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:36:01.551247 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b11536-6a33-4b56-a534-42e6ae02946f admin admin] PATH_INFO: `/v3/users` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:36:01.552011 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b11536-6a33-4b56-a534-42e6ae02946f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:36:01.555347 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b11536-6a33-4b56-a534-42e6ae02946f admin admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:36:01.587832 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 967/1902] 10.222.0.23 () {60 vars in 1143 bytes} [Tue May 10 05:36:01 2022] POST /identity/v3/users => generated 282 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 05:36:01.589540 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b11536-6a33-4b56-a534-42e6ae02946f admin admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:36:01.591209 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-43b11536-6a33-4b56-a534-42e6ae02946f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:36:01.601506 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5df5c15-8a82-4966-9307-e776174c91ee admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:36:01.610748 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b11536-6a33-4b56-a534-42e6ae02946f admin admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:36:01.611428 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff913bf2-c68c-4dbc-9b29-1dbb1bf448a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:36:01.612486 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff913bf2-c68c-4dbc-9b29-1dbb1bf448a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:36:01.612766 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff913bf2-c68c-4dbc-9b29-1dbb1bf448a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:36:01.616711 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff913bf2-c68c-4dbc-9b29-1dbb1bf448a0 admin admin] PATH_INFO: `/v3/users/168e77fed59d4ec68e5f169a79ef7e9f` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:36:01.616825 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780e9bf7-9a06-476b-b8ca-df89e38d98d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:36:01.617788 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780e9bf7-9a06-476b-b8ca-df89e38d98d6 admin admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:36:01.617956 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff913bf2-c68c-4dbc-9b29-1dbb1bf448a0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=168e77fed59d4ec68e5f169a79ef7e9f)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:36:01.618241 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780e9bf7-9a06-476b-b8ca-df89e38d98d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:36:01.618687 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780e9bf7-9a06-476b-b8ca-df89e38d98d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:36:01.619525 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780e9bf7-9a06-476b-b8ca-df89e38d98d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:36:01.620339 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff913bf2-c68c-4dbc-9b29-1dbb1bf448a0 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:36:01.621492 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780e9bf7-9a06-476b-b8ca-df89e38d98d6 admin admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:36:01.635871 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 968/1903] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 10 05:36:01 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 05:36:01.638231 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780e9bf7-9a06-476b-b8ca-df89e38d98d6 admin admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:36:01.650832 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780e9bf7-9a06-476b-b8ca-df89e38d98d6 admin admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:36:01.657626 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03161789-6730-4d4a-b004-9219d716dc71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:36:01.658495 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03161789-6730-4d4a-b004-9219d716dc71 admin admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:36:01.658873 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03161789-6730-4d4a-b004-9219d716dc71 admin admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:36:01.659207 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03161789-6730-4d4a-b004-9219d716dc71 admin admin] PATH_INFO: `/v3/roles` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:36:01.660097 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03161789-6730-4d4a-b004-9219d716dc71 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:36:01.661964 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03161789-6730-4d4a-b004-9219d716dc71 admin admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:36:01.674864 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-ff913bf2-c68c-4dbc-9b29-1dbb1bf448a0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '168e77fed59d4ec68e5f169a79ef7e9f'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:36:01.687001 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 969/1904] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 10 05:36:01 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 05:36:01.688265 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-ff913bf2-c68c-4dbc-9b29-1dbb1bf448a0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '168e77fed59d4ec68e5f169a79ef7e9f'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:36:01.689001 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-ff913bf2-c68c-4dbc-9b29-1dbb1bf448a0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '168e77fed59d4ec68e5f169a79ef7e9f'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:36:01.691879 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03161789-6730-4d4a-b004-9219d716dc71 admin admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:36:01.695455 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-03161789-6730-4d4a-b004-9219d716dc71 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:36:01.703744 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-ff913bf2-c68c-4dbc-9b29-1dbb1bf448a0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '168e77fed59d4ec68e5f169a79ef7e9f'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:36:01.703744 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-ff913bf2-c68c-4dbc-9b29-1dbb1bf448a0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '168e77fed59d4ec68e5f169a79ef7e9f'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:36:01.711703 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03161789-6730-4d4a-b004-9219d716dc71 admin admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:36:01.712809 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 936/1905] 10.222.0.23 () {58 vars in 1223 bytes} [Tue May 10 05:36:01 2022] DELETE /identity/v3/users/168e77fed59d4ec68e5f169a79ef7e9f => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 05:36:01.778990 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83befabe-1e73-4800-b271-ef42ca9f6ba4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:36:01.779858 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83befabe-1e73-4800-b271-ef42ca9f6ba4 admin admin] REQUEST_METHOD: `PUT` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:36:01.780142 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83befabe-1e73-4800-b271-ef42ca9f6ba4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:36:01.780413 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83befabe-1e73-4800-b271-ef42ca9f6ba4 admin admin] PATH_INFO: `/v3/projects/4a0157c057674108ae80b15adae64762/users/fbed727f523144859c2f5afda3f0ce12/roles/382636e67fc142a2b2f486340d959e11` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:36:01.798374 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83befabe-1e73-4800-b271-ef42ca9f6ba4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4a0157c057674108ae80b15adae64762, user_id=fbed727f523144859c2f5afda3f0ce12, role_id=382636e67fc142a2b2f486340d959e11)` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:36:01.802674 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83befabe-1e73-4800-b271-ef42ca9f6ba4 admin admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:36:01.816566 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 970/1906] 10.222.0.23 () {60 vars in 1482 bytes} [Tue May 10 05:36:01 2022] PUT /identity/v3/projects/4a0157c057674108ae80b15adae64762/users/fbed727f523144859c2f5afda3f0ce12/roles/382636e67fc142a2b2f486340d959e11 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 05:36:01.828374 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9c31f5-9163-44b8-9fe1-ba3dccd6ebc6 None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:36:01.829050 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9c31f5-9163-44b8-9fe1-ba3dccd6ebc6 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:36:01.829679 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9c31f5-9163-44b8-9fe1-ba3dccd6ebc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:36:01.870484 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-5e9c31f5-9163-44b8-9fe1-ba3dccd6ebc6 None None] MFA Rules not processed for user `fbed727f523144859c2f5afda3f0ce12`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:36:01.871867 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-5e9c31f5-9163-44b8-9fe1-ba3dccd6ebc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:36:01.934422 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 937/1907] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 10 05:36:01 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 05:36:01.939043 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83befabe-1e73-4800-b271-ef42ca9f6ba4 admin admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:36:01.981049 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9c31f5-9163-44b8-9fe1-ba3dccd6ebc6 None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:36:01.982584 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-5e9c31f5-9163-44b8-9fe1-ba3dccd6ebc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:36:02.002769 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83befabe-1e73-4800-b271-ef42ca9f6ba4 admin admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:36:02.007525 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35874c2d-cd71-4aa6-9561-66217b41a04d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:36:02.008235 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35874c2d-cd71-4aa6-9561-66217b41a04d admin admin] REQUEST_METHOD: `POST` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:36:02.008517 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35874c2d-cd71-4aa6-9561-66217b41a04d admin admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:36:02.008792 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35874c2d-cd71-4aa6-9561-66217b41a04d admin admin] PATH_INFO: `/v3/projects` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:36:02.009522 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35874c2d-cd71-4aa6-9561-66217b41a04d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:36:02.011438 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35874c2d-cd71-4aa6-9561-66217b41a04d admin admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:36:02.040332 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 971/1908] 10.222.0.23 () {60 vars in 1152 bytes} [Tue May 10 05:36:01 2022] POST /identity/v3/projects => generated 365 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 05:36:02.041327 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35874c2d-cd71-4aa6-9561-66217b41a04d admin admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:36:02.050839 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9c31f5-9163-44b8-9fe1-ba3dccd6ebc6 None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:36:02.105441 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35874c2d-cd71-4aa6-9561-66217b41a04d admin admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:36:02.109596 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a4a05a-b8c5-4a0f-bb5f-741ef68704fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:36:02.110050 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a61c015-30b8-4628-9e9e-efd859776a01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:36:02.110693 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a4a05a-b8c5-4a0f-bb5f-741ef68704fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:36:02.110788 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a61c015-30b8-4628-9e9e-efd859776a01 admin admin] REQUEST_METHOD: `POST` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:36:02.110993 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a61c015-30b8-4628-9e9e-efd859776a01 admin admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:36:02.111249 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a4a05a-b8c5-4a0f-bb5f-741ef68704fd admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:36:02.111336 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a61c015-30b8-4628-9e9e-efd859776a01 admin admin] PATH_INFO: `/v3/users` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:36:02.111718 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a4a05a-b8c5-4a0f-bb5f-741ef68704fd admin admin] PATH_INFO: `/v3/projects/37aa078348fe4f26831aaac5977292f1` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:36:02.111991 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a61c015-30b8-4628-9e9e-efd859776a01 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:36:02.113073 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a4a05a-b8c5-4a0f-bb5f-741ef68704fd admin admin] RBAC: Authorizing `identity:delete_project(project_id=37aa078348fe4f26831aaac5977292f1)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:36:02.114571 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a61c015-30b8-4628-9e9e-efd859776a01 admin admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:36:02.115071 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a4a05a-b8c5-4a0f-bb5f-741ef68704fd admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:36:02.137970 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 972/1909] 10.222.0.23 () {60 vars in 1143 bytes} [Tue May 10 05:36:02 2022] POST /identity/v3/users => generated 289 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 05:36:02.139325 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a61c015-30b8-4628-9e9e-efd859776a01 admin admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:36:02.149899 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a61c015-30b8-4628-9e9e-efd859776a01 admin admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:36:02.162449 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-97a4a05a-b8c5-4a0f-bb5f-741ef68704fd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '37aa078348fe4f26831aaac5977292f1', 'request_id': 'req-97a4a05a-b8c5-4a0f-bb5f-741ef68704fd'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:36:02.168431 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-97a4a05a-b8c5-4a0f-bb5f-741ef68704fd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '37aa078348fe4f26831aaac5977292f1', 'request_id': 'req-97a4a05a-b8c5-4a0f-bb5f-741ef68704fd'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:36:02.177199 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-97a4a05a-b8c5-4a0f-bb5f-741ef68704fd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '37aa078348fe4f26831aaac5977292f1', 'request_id': 'req-97a4a05a-b8c5-4a0f-bb5f-741ef68704fd'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:36:02.187402 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-97a4a05a-b8c5-4a0f-bb5f-741ef68704fd admin admin] The token cache is being invalidate because project 37aa078348fe4f26831aaac5977292f1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79880) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 05:36:02.187729 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-97a4a05a-b8c5-4a0f-bb5f-741ef68704fd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:36:02.188373 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-97a4a05a-b8c5-4a0f-bb5f-741ef68704fd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:36:02.189967 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 938/1910] 10.222.0.23 () {58 vars in 1232 bytes} [Tue May 10 05:36:01 2022] DELETE /identity/v3/projects/37aa078348fe4f26831aaac5977292f1 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 05:36:02.194812 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51fe860-a5a7-4ecd-9553-26253ba77b77 None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:36:02.195162 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51fe860-a5a7-4ecd-9553-26253ba77b77 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:36:02.195473 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51fe860-a5a7-4ecd-9553-26253ba77b77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:36:02.203469 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb4b96c-057f-4014-b037-4d7a144a9242 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:36:02.204249 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb4b96c-057f-4014-b037-4d7a144a9242 admin admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:36:02.204527 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb4b96c-057f-4014-b037-4d7a144a9242 admin admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:36:02.204809 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb4b96c-057f-4014-b037-4d7a144a9242 admin admin] PATH_INFO: `/v3/roles` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:36:02.205522 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb4b96c-057f-4014-b037-4d7a144a9242 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:36:02.207107 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb4b96c-057f-4014-b037-4d7a144a9242 admin admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:36:02.213048 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-a51fe860-a5a7-4ecd-9553-26253ba77b77 None None] MFA Rules not processed for user `44883b22532e44049d846938dc2cf423`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:36:02.214214 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-a51fe860-a5a7-4ecd-9553-26253ba77b77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:36:02.217516 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 973/1911] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 10 05:36:02 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 05:36:02.221418 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb4b96c-057f-4014-b037-4d7a144a9242 admin admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:36:02.223084 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-6fb4b96c-057f-4014-b037-4d7a144a9242 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:36:02.225386 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 939/1912] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 10 05:36:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 05:36:02.233528 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f447a6-5eea-4de9-b747-d26cf85d68b4 None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:36:02.233818 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f447a6-5eea-4de9-b747-d26cf85d68b4 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:36:02.234098 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f447a6-5eea-4de9-b747-d26cf85d68b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:36:02.235951 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb4b96c-057f-4014-b037-4d7a144a9242 admin admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:36:02.240589 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d203c9-71c0-4e7e-9603-13cb3a78ec06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:36:02.241462 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d203c9-71c0-4e7e-9603-13cb3a78ec06 admin admin] REQUEST_METHOD: `PUT` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:36:02.241748 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d203c9-71c0-4e7e-9603-13cb3a78ec06 admin admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:36:02.242023 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d203c9-71c0-4e7e-9603-13cb3a78ec06 admin admin] PATH_INFO: `/v3/projects/760f055515564b91a38a61129ef28310/users/24746368eb20432a85414716119ad855/roles/199ac1dd842441d7913c6ee89d8fbecc` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:36:02.251832 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-f0f447a6-5eea-4de9-b747-d26cf85d68b4 None None] MFA Rules not processed for user `44883b22532e44049d846938dc2cf423`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:36:02.253031 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-f0f447a6-5eea-4de9-b747-d26cf85d68b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:36:02.256697 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d203c9-71c0-4e7e-9603-13cb3a78ec06 admin admin] RBAC: Authorizing `identity:create_grant(project_id=760f055515564b91a38a61129ef28310, user_id=24746368eb20432a85414716119ad855, role_id=199ac1dd842441d7913c6ee89d8fbecc)` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:36:02.259355 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d203c9-71c0-4e7e-9603-13cb3a78ec06 admin admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:36:02.261898 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 940/1913] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 10 05:36:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 05:36:02.266595 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f447a6-5eea-4de9-b747-d26cf85d68b4 None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:36:02.273213 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 974/1914] 10.222.0.23 () {60 vars in 1482 bytes} [Tue May 10 05:36:02 2022] PUT /identity/v3/projects/760f055515564b91a38a61129ef28310/users/24746368eb20432a85414716119ad855/roles/199ac1dd842441d7913c6ee89d8fbecc => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 05:36:02.275770 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f447a6-5eea-4de9-b747-d26cf85d68b4 None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:36:02.276900 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d203c9-71c0-4e7e-9603-13cb3a78ec06 admin admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:36:02.330314 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d94d75a-e7c4-4bc3-84ea-e40bf6406a48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:36:02.330899 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d94d75a-e7c4-4bc3-84ea-e40bf6406a48 admin admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:36:02.331179 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d94d75a-e7c4-4bc3-84ea-e40bf6406a48 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:36:02.331831 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d94d75a-e7c4-4bc3-84ea-e40bf6406a48 admin admin] PATH_INFO: `/v3/domains` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:36:02.333738 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d94d75a-e7c4-4bc3-84ea-e40bf6406a48 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:36:02.334054 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d94d75a-e7c4-4bc3-84ea-e40bf6406a48 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:36:02.335677 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d94d75a-e7c4-4bc3-84ea-e40bf6406a48 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:36:02.336691 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d203c9-71c0-4e7e-9603-13cb3a78ec06 admin admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:36:02.341593 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360cc18d-b044-434b-8ca8-b30fa777ea1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:36:02.342259 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360cc18d-b044-434b-8ca8-b30fa777ea1a admin admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:36:02.342563 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360cc18d-b044-434b-8ca8-b30fa777ea1a admin admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:36:02.342834 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360cc18d-b044-434b-8ca8-b30fa777ea1a admin admin] PATH_INFO: `/v3/roles` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:36:02.343594 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360cc18d-b044-434b-8ca8-b30fa777ea1a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:36:02.345217 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360cc18d-b044-434b-8ca8-b30fa777ea1a admin admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:36:02.350859 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 941/1915] 10.222.0.23 () {58 vars in 1152 bytes} [Tue May 10 05:36:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 05:36:02.351857 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d94d75a-e7c4-4bc3-84ea-e40bf6406a48 admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:36:02.358742 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 975/1916] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 10 05:36:02 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 05:36:02.359675 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360cc18d-b044-434b-8ca8-b30fa777ea1a admin admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:36:02.361916 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d94d75a-e7c4-4bc3-84ea-e40bf6406a48 admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:36:02.367485 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d736efc0-aafb-489c-9247-c416ed793843 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:36:02.368399 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d736efc0-aafb-489c-9247-c416ed793843 admin admin] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:36:02.368703 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d736efc0-aafb-489c-9247-c416ed793843 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:36:02.368977 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d736efc0-aafb-489c-9247-c416ed793843 admin admin] PATH_INFO: `/v3/projects` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:36:02.369662 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d736efc0-aafb-489c-9247-c416ed793843 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:36:02.369849 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360cc18d-b044-434b-8ca8-b30fa777ea1a admin admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:36:02.380106 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d736efc0-aafb-489c-9247-c416ed793843 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:36:02.380365 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6a6118-0e3c-4df7-96ea-a609dd1d1cd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:36:02.380365 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6a6118-0e3c-4df7-96ea-a609dd1d1cd2 admin admin] REQUEST_METHOD: `PUT` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:36:02.380365 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6a6118-0e3c-4df7-96ea-a609dd1d1cd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:36:02.380365 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6a6118-0e3c-4df7-96ea-a609dd1d1cd2 admin admin] PATH_INFO: `/v3/projects/760f055515564b91a38a61129ef28310/users/24746368eb20432a85414716119ad855/roles/199ac1dd842441d7913c6ee89d8fbecc` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:36:02.380692 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6a6118-0e3c-4df7-96ea-a609dd1d1cd2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=760f055515564b91a38a61129ef28310, user_id=24746368eb20432a85414716119ad855, role_id=199ac1dd842441d7913c6ee89d8fbecc)` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:36:02.381046 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6a6118-0e3c-4df7-96ea-a609dd1d1cd2 admin admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:36:02.391853 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 976/1917] 10.222.0.23 () {60 vars in 1482 bytes} [Tue May 10 05:36:02 2022] PUT /identity/v3/projects/760f055515564b91a38a61129ef28310/users/24746368eb20432a85414716119ad855/roles/199ac1dd842441d7913c6ee89d8fbecc => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 05:36:02.398689 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 942/1918] 10.222.0.23 () {60 vars in 1152 bytes} [Tue May 10 05:36:02 2022] POST /identity/v3/projects => generated 375 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 05:36:02.403054 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3878c2cc-27b7-4581-8909-fedeb0b2b1bd None None] REQUEST_METHOD: `POST` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:36:02.403372 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3878c2cc-27b7-4581-8909-fedeb0b2b1bd None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:36:02.403707 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3878c2cc-27b7-4581-8909-fedeb0b2b1bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:36:02.404496 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d736efc0-aafb-489c-9247-c416ed793843 admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:36:02.430851 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.auth.core [None req-3878c2cc-27b7-4581-8909-fedeb0b2b1bd None None] MFA Rules not processed for user `24746368eb20432a85414716119ad855`. Rule list: `[]` (Enabled: `True`). {{(pid=79879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:36:02.432094 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-3878c2cc-27b7-4581-8909-fedeb0b2b1bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:36:02.462258 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d736efc0-aafb-489c-9247-c416ed793843 admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:36:02.466900 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc78ffe-392b-4092-ab96-babb1615ec07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:36:02.467684 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc78ffe-392b-4092-ab96-babb1615ec07 admin admin] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:36:02.467870 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc78ffe-392b-4092-ab96-babb1615ec07 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:36:02.468144 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc78ffe-392b-4092-ab96-babb1615ec07 admin admin] PATH_INFO: `/v3/users` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:36:02.468830 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc78ffe-392b-4092-ab96-babb1615ec07 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:36:02.470770 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc78ffe-392b-4092-ab96-babb1615ec07 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:36:02.494263 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 943/1919] 10.222.0.23 () {60 vars in 1143 bytes} [Tue May 10 05:36:02 2022] POST /identity/v3/users => generated 288 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 05:36:02.495510 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc78ffe-392b-4092-ab96-babb1615ec07 admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:36:02.499671 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 977/1920] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 10 05:36:02 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 05:36:02.506582 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc78ffe-392b-4092-ab96-babb1615ec07 admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:36:02.510808 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3878c2cc-27b7-4581-8909-fedeb0b2b1bd None None] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:36:02.511533 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e93268-61d8-4879-8dd9-e7cf3648ea39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:36:02.512169 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-3878c2cc-27b7-4581-8909-fedeb0b2b1bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:36:02.512284 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e93268-61d8-4879-8dd9-e7cf3648ea39 admin admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:36:02.512500 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e93268-61d8-4879-8dd9-e7cf3648ea39 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:36:02.512778 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e93268-61d8-4879-8dd9-e7cf3648ea39 admin admin] PATH_INFO: `/v3/roles` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:36:02.513667 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e93268-61d8-4879-8dd9-e7cf3648ea39 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:36:02.515269 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e93268-61d8-4879-8dd9-e7cf3648ea39 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:36:02.525628 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 944/1921] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 10 05:36:02 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 05:36:02.531442 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e93268-61d8-4879-8dd9-e7cf3648ea39 admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:36:02.540998 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e93268-61d8-4879-8dd9-e7cf3648ea39 admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:36:02.545874 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8eaf9ec-2626-490f-9fd0-39951adc9dbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:36:02.546607 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8eaf9ec-2626-490f-9fd0-39951adc9dbf admin admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:36:02.546890 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8eaf9ec-2626-490f-9fd0-39951adc9dbf admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:36:02.547165 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8eaf9ec-2626-490f-9fd0-39951adc9dbf admin admin] PATH_INFO: `/v3/roles` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:36:02.547955 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8eaf9ec-2626-490f-9fd0-39951adc9dbf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:36:02.550219 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8eaf9ec-2626-490f-9fd0-39951adc9dbf admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:36:02.561850 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 945/1922] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 10 05:36:02 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 05:36:02.565440 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3878c2cc-27b7-4581-8909-fedeb0b2b1bd None None] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:36:02.566006 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8eaf9ec-2626-490f-9fd0-39951adc9dbf admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:36:02.569030 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96b4ceb-6800-4be8-8360-34923c4d12e7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355be413675540a39ccb00e1a0722316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f23435f783540199d6dcfd0417c090e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:36:02.569676 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96b4ceb-6800-4be8-8360-34923c4d12e7 service cinder] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:36:02.569961 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96b4ceb-6800-4be8-8360-34923c4d12e7 service cinder] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:36:02.570234 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96b4ceb-6800-4be8-8360-34923c4d12e7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:36:02.575142 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8eaf9ec-2626-490f-9fd0-39951adc9dbf admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:36:02.579201 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96b4ceb-6800-4be8-8360-34923c4d12e7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:36:02.579704 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12989926-cb75-46fa-aaf7-cbee1ae4b863 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:36:02.580611 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12989926-cb75-46fa-aaf7-cbee1ae4b863 admin admin] REQUEST_METHOD: `PUT` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:36:02.580731 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96b4ceb-6800-4be8-8360-34923c4d12e7 service cinder] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:36:02.580832 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12989926-cb75-46fa-aaf7-cbee1ae4b863 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:36:02.581086 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12989926-cb75-46fa-aaf7-cbee1ae4b863 admin admin] PATH_INFO: `/v3/projects/e497fdc758d84a5cb7bf6dd585469caf/users/4a179be1242844abba5a425dd0b5d86c/roles/382636e67fc142a2b2f486340d959e11` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:36:02.590814 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 978/1923] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 10 05:36:02 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 05:36:02.596182 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12989926-cb75-46fa-aaf7-cbee1ae4b863 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e497fdc758d84a5cb7bf6dd585469caf, user_id=4a179be1242844abba5a425dd0b5d86c, role_id=382636e67fc142a2b2f486340d959e11)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:36:02.599409 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12989926-cb75-46fa-aaf7-cbee1ae4b863 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:36:02.618085 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 946/1924] 10.222.0.23 () {60 vars in 1482 bytes} [Tue May 10 05:36:02 2022] PUT /identity/v3/projects/e497fdc758d84a5cb7bf6dd585469caf/users/4a179be1242844abba5a425dd0b5d86c/roles/382636e67fc142a2b2f486340d959e11 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 05:36:02.630073 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77f0ccb-6759-4c89-b38a-c4f39874db01 None None] REQUEST_METHOD: `POST` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:36:02.630571 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77f0ccb-6759-4c89-b38a-c4f39874db01 None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:36:02.630990 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77f0ccb-6759-4c89-b38a-c4f39874db01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:36:02.667378 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.auth.core [None req-d77f0ccb-6759-4c89-b38a-c4f39874db01 None None] MFA Rules not processed for user `4a179be1242844abba5a425dd0b5d86c`. Rule list: `[]` (Enabled: `True`). {{(pid=79879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:36:02.673179 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-d77f0ccb-6759-4c89-b38a-c4f39874db01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:36:02.682099 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12989926-cb75-46fa-aaf7-cbee1ae4b863 admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:36:02.683897 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-12989926-cb75-46fa-aaf7-cbee1ae4b863 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:36:02.739844 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 979/1925] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 10 05:36:02 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 05:36:02.743900 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77f0ccb-6759-4c89-b38a-c4f39874db01 None None] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:36:02.746401 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12989926-cb75-46fa-aaf7-cbee1ae4b863 admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:36:02.750341 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4e048f-55e7-4ce6-8a1a-de5abb8c8cd0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355be413675540a39ccb00e1a0722316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f23435f783540199d6dcfd0417c090e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:36:02.751080 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4e048f-55e7-4ce6-8a1a-de5abb8c8cd0 service cinder] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:36:02.751345 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4e048f-55e7-4ce6-8a1a-de5abb8c8cd0 service cinder] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:36:02.751647 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4e048f-55e7-4ce6-8a1a-de5abb8c8cd0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:36:02.753494 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-3c4e048f-55e7-4ce6-8a1a-de5abb8c8cd0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:36:02.812636 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4e048f-55e7-4ce6-8a1a-de5abb8c8cd0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:36:02.814290 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77f0ccb-6759-4c89-b38a-c4f39874db01 None None] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:36:02.815438 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4e048f-55e7-4ce6-8a1a-de5abb8c8cd0 service cinder] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:36:02.819677 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0e1167-445f-40a6-9b75-282d9716ba9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:36:02.820686 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0e1167-445f-40a6-9b75-282d9716ba9f admin admin] REQUEST_METHOD: `POST` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:36:02.821261 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0e1167-445f-40a6-9b75-282d9716ba9f admin admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:36:02.821602 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0e1167-445f-40a6-9b75-282d9716ba9f admin admin] PATH_INFO: `/v3/projects` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:36:02.827946 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 947/1926] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 10 05:36:02 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 05:36:02.833382 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0e1167-445f-40a6-9b75-282d9716ba9f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:36:02.835265 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0e1167-445f-40a6-9b75-282d9716ba9f admin admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:36:02.872050 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 980/1927] 10.222.0.23 () {60 vars in 1152 bytes} [Tue May 10 05:36:02 2022] POST /identity/v3/projects => generated 375 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 05:36:02.876479 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4e048f-55e7-4ce6-8a1a-de5abb8c8cd0 service cinder] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:36:02.889087 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4e048f-55e7-4ce6-8a1a-de5abb8c8cd0 service cinder] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:36:02.984248 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176ad573-65d2-4a32-82ef-1c0f0dc2603e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:36:02.985074 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176ad573-65d2-4a32-82ef-1c0f0dc2603e admin admin] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:36:02.985341 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176ad573-65d2-4a32-82ef-1c0f0dc2603e admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:36:02.985635 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176ad573-65d2-4a32-82ef-1c0f0dc2603e admin admin] PATH_INFO: `/v3/users` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:36:02.986366 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176ad573-65d2-4a32-82ef-1c0f0dc2603e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:36:02.989481 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176ad573-65d2-4a32-82ef-1c0f0dc2603e admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:36:03.015500 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 948/1928] 10.222.0.23 () {60 vars in 1143 bytes} [Tue May 10 05:36:02 2022] POST /identity/v3/users => generated 294 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 05:36:03.019509 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0e1167-445f-40a6-9b75-282d9716ba9f admin admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:36:03.033581 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0e1167-445f-40a6-9b75-282d9716ba9f admin admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:36:03.042716 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4e38a0-09c9-4b6c-b11b-a0d89ecd538c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:36:03.044242 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4e38a0-09c9-4b6c-b11b-a0d89ecd538c admin admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:36:03.044677 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4e38a0-09c9-4b6c-b11b-a0d89ecd538c admin admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:36:03.045400 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4e38a0-09c9-4b6c-b11b-a0d89ecd538c admin admin] PATH_INFO: `/v3/roles` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:36:03.046441 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4e38a0-09c9-4b6c-b11b-a0d89ecd538c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:36:03.048473 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4e38a0-09c9-4b6c-b11b-a0d89ecd538c admin admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:36:03.063216 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 981/1929] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 10 05:36:03 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 05:36:03.064819 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176ad573-65d2-4a32-82ef-1c0f0dc2603e admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:36:03.074624 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176ad573-65d2-4a32-82ef-1c0f0dc2603e admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:36:03.079169 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda8fa7e-abd0-4d81-b36c-2d049713190a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:36:03.080081 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda8fa7e-abd0-4d81-b36c-2d049713190a admin admin] REQUEST_METHOD: `PUT` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:36:03.080363 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda8fa7e-abd0-4d81-b36c-2d049713190a admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:36:03.080637 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda8fa7e-abd0-4d81-b36c-2d049713190a admin admin] PATH_INFO: `/v3/projects/c43de84b55f849e39823373b8dc3891a/users/204d2e947eee4ec3be96f574c2031e80/roles/199ac1dd842441d7913c6ee89d8fbecc` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:36:03.094922 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda8fa7e-abd0-4d81-b36c-2d049713190a admin admin] RBAC: Authorizing `identity:create_grant(project_id=c43de84b55f849e39823373b8dc3891a, user_id=204d2e947eee4ec3be96f574c2031e80, role_id=199ac1dd842441d7913c6ee89d8fbecc)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:36:03.097843 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda8fa7e-abd0-4d81-b36c-2d049713190a admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:36:03.118115 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 949/1930] 10.222.0.23 () {60 vars in 1482 bytes} [Tue May 10 05:36:03 2022] PUT /identity/v3/projects/c43de84b55f849e39823373b8dc3891a/users/204d2e947eee4ec3be96f574c2031e80/roles/199ac1dd842441d7913c6ee89d8fbecc => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 05:36:03.124707 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4e38a0-09c9-4b6c-b11b-a0d89ecd538c admin admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:36:03.135501 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4e38a0-09c9-4b6c-b11b-a0d89ecd538c admin admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:36:03.203131 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1e3b24-c867-4306-974d-b61eed1750aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:36:03.203905 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1e3b24-c867-4306-974d-b61eed1750aa admin admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:36:03.204184 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1e3b24-c867-4306-974d-b61eed1750aa admin admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:36:03.204454 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1e3b24-c867-4306-974d-b61eed1750aa admin admin] PATH_INFO: `/v3/roles` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:36:03.205184 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1e3b24-c867-4306-974d-b61eed1750aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:36:03.206770 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1e3b24-c867-4306-974d-b61eed1750aa admin admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:36:03.216371 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 982/1931] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 10 05:36:03 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 05:36:03.221560 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda8fa7e-abd0-4d81-b36c-2d049713190a admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:36:03.232076 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda8fa7e-abd0-4d81-b36c-2d049713190a admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:36:03.236991 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45d6af0-4d57-4c9b-ab14-6b6d1302bfbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:36:03.237866 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45d6af0-4d57-4c9b-ab14-6b6d1302bfbd admin admin] REQUEST_METHOD: `PUT` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:36:03.238139 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45d6af0-4d57-4c9b-ab14-6b6d1302bfbd admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:36:03.238409 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45d6af0-4d57-4c9b-ab14-6b6d1302bfbd admin admin] PATH_INFO: `/v3/projects/c43de84b55f849e39823373b8dc3891a/users/204d2e947eee4ec3be96f574c2031e80/roles/199ac1dd842441d7913c6ee89d8fbecc` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:36:03.240424 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45d6af0-4d57-4c9b-ab14-6b6d1302bfbd admin admin] RBAC: Authorizing `identity:create_grant(project_id=c43de84b55f849e39823373b8dc3891a, user_id=204d2e947eee4ec3be96f574c2031e80, role_id=199ac1dd842441d7913c6ee89d8fbecc)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:36:03.243023 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45d6af0-4d57-4c9b-ab14-6b6d1302bfbd admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:36:03.253383 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 950/1932] 10.222.0.23 () {60 vars in 1482 bytes} [Tue May 10 05:36:03 2022] PUT /identity/v3/projects/c43de84b55f849e39823373b8dc3891a/users/204d2e947eee4ec3be96f574c2031e80/roles/199ac1dd842441d7913c6ee89d8fbecc => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 05:36:03.269584 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce297c21-f1b9-46df-999e-baa041796a84 None None] REQUEST_METHOD: `POST` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:36:03.269870 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce297c21-f1b9-46df-999e-baa041796a84 None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:36:03.270142 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce297c21-f1b9-46df-999e-baa041796a84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:36:03.297545 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.auth.core [None req-ce297c21-f1b9-46df-999e-baa041796a84 None None] MFA Rules not processed for user `204d2e947eee4ec3be96f574c2031e80`. Rule list: `[]` (Enabled: `True`). {{(pid=79879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:36:03.298736 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-ce297c21-f1b9-46df-999e-baa041796a84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:36:03.367966 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 983/1933] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 10 05:36:03 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 05:36:03.380388 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45d6af0-4d57-4c9b-ab14-6b6d1302bfbd admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:36:03.436752 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45d6af0-4d57-4c9b-ab14-6b6d1302bfbd admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:36:03.440754 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc009c8-c6d6-4a85-85fb-b1b614453765 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355be413675540a39ccb00e1a0722316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f23435f783540199d6dcfd0417c090e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:36:03.441406 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc009c8-c6d6-4a85-85fb-b1b614453765 service cinder] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:36:03.441690 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc009c8-c6d6-4a85-85fb-b1b614453765 service cinder] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:36:03.442023 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc009c8-c6d6-4a85-85fb-b1b614453765 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:36:03.499794 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc009c8-c6d6-4a85-85fb-b1b614453765 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:36:03.501335 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc009c8-c6d6-4a85-85fb-b1b614453765 service cinder] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:36:03.510325 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 951/1934] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 10 05:36:03 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 05:36:06.115355 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c175c74-7dc5-49a4-84a9-08f69d98f213 None None] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:36:06.116324 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c175c74-7dc5-49a4-84a9-08f69d98f213 None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:36:06.117061 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c175c74-7dc5-49a4-84a9-08f69d98f213 None None] PATH_INFO: `/` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:36:06.118635 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 984/1935] 10.222.0.23 () {54 vars in 921 bytes} [Tue May 10 05:36:06 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 05:36:06.185649 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac33529-a3d2-48d6-ac2a-83aef49efe5b None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:36:06.186497 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac33529-a3d2-48d6-ac2a-83aef49efe5b None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:36:06.186835 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac33529-a3d2-48d6-ac2a-83aef49efe5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:36:06.220943 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-5ac33529-a3d2-48d6-ac2a-83aef49efe5b None None] MFA Rules not processed for user `7f50f224ca944983aecfde86375473da`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:36:06.225888 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-5ac33529-a3d2-48d6-ac2a-83aef49efe5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:36:06.409399 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 952/1936] 10.222.0.23 () {58 vars in 1018 bytes} [Tue May 10 05:36:06 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 05:36:06.424580 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c175c74-7dc5-49a4-84a9-08f69d98f213 None None] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:36:06.449739 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac33529-a3d2-48d6-ac2a-83aef49efe5b None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:36:06.449739 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-5ac33529-a3d2-48d6-ac2a-83aef49efe5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:36:06.504615 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac33529-a3d2-48d6-ac2a-83aef49efe5b None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:36:06.510888 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c63769d-9fe0-43d4-92ef-840c0ef8f046 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f50f224ca944983aecfde86375473da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f23435f783540199d6dcfd0417c090e', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:36:06.511778 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c63769d-9fe0-43d4-92ef-840c0ef8f046 service nova] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:36:06.512162 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c63769d-9fe0-43d4-92ef-840c0ef8f046 service nova] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:36:06.512573 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c63769d-9fe0-43d4-92ef-840c0ef8f046 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:36:06.524923 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c63769d-9fe0-43d4-92ef-840c0ef8f046 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:36:06.526742 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c63769d-9fe0-43d4-92ef-840c0ef8f046 service nova] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:36:06.541907 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 953/1937] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 10 05:36:06 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 05:36:06.543674 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c63769d-9fe0-43d4-92ef-840c0ef8f046 service nova] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:36:06.545078 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-3c63769d-9fe0-43d4-92ef-840c0ef8f046 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:36:06.571809 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c175c74-7dc5-49a4-84a9-08f69d98f213 None None] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:36:06.579094 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfd093a-097e-474f-923f-cf0963fca9a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:36:06.581034 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfd093a-097e-474f-923f-cf0963fca9a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:36:06.582078 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfd093a-097e-474f-923f-cf0963fca9a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:36:06.582563 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfd093a-097e-474f-923f-cf0963fca9a1 admin admin] PATH_INFO: `/v3/users/4a179be1242844abba5a425dd0b5d86c` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:36:06.585720 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfd093a-097e-474f-923f-cf0963fca9a1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4a179be1242844abba5a425dd0b5d86c)` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:36:06.590028 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfd093a-097e-474f-923f-cf0963fca9a1 admin admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:36:06.624608 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c63769d-9fe0-43d4-92ef-840c0ef8f046 service nova] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:36:06.629451 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0a81be-11a4-42a7-a99d-c07bda09ccbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:36:06.630333 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0a81be-11a4-42a7-a99d-c07bda09ccbc admin admin] REQUEST_METHOD: `DELETE` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:36:06.630615 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0a81be-11a4-42a7-a99d-c07bda09ccbc admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:36:06.630886 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0a81be-11a4-42a7-a99d-c07bda09ccbc admin admin] PATH_INFO: `/v3/users/78e9f65f6bfd42bf9e264b28ffbd4c93` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:36:06.632108 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0a81be-11a4-42a7-a99d-c07bda09ccbc admin admin] RBAC: Authorizing `identity:delete_user(user_id=78e9f65f6bfd42bf9e264b28ffbd4c93)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:36:06.634032 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0a81be-11a4-42a7-a99d-c07bda09ccbc admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:36:06.642812 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-ccfd093a-097e-474f-923f-cf0963fca9a1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4a179be1242844abba5a425dd0b5d86c'} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:36:06.651761 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-ccfd093a-097e-474f-923f-cf0963fca9a1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4a179be1242844abba5a425dd0b5d86c'} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:36:06.652492 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-ccfd093a-097e-474f-923f-cf0963fca9a1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4a179be1242844abba5a425dd0b5d86c'} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:36:06.665289 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-ccfd093a-097e-474f-923f-cf0963fca9a1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4a179be1242844abba5a425dd0b5d86c'} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:36:06.672101 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-ccfd093a-097e-474f-923f-cf0963fca9a1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4a179be1242844abba5a425dd0b5d86c'} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:36:06.678036 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 985/1938] 10.222.0.23 () {58 vars in 1223 bytes} [Tue May 10 05:36:06 2022] DELETE /identity/v3/users/4a179be1242844abba5a425dd0b5d86c => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 05:36:06.682346 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dbaf17-76d3-4487-a693-478519deac45 None None] REQUEST_METHOD: `POST` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:36:06.682639 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dbaf17-76d3-4487-a693-478519deac45 None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:36:06.682918 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dbaf17-76d3-4487-a693-478519deac45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:36:06.684874 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-ce0a81be-11a4-42a7-a99d-c07bda09ccbc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '78e9f65f6bfd42bf9e264b28ffbd4c93'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:36:06.700097 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-ce0a81be-11a4-42a7-a99d-c07bda09ccbc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '78e9f65f6bfd42bf9e264b28ffbd4c93'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:36:06.701357 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-ce0a81be-11a4-42a7-a99d-c07bda09ccbc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '78e9f65f6bfd42bf9e264b28ffbd4c93'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:36:06.702620 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.auth.core [None req-84dbaf17-76d3-4487-a693-478519deac45 None None] MFA Rules not processed for user `44883b22532e44049d846938dc2cf423`. Rule list: `[]` (Enabled: `True`). {{(pid=79879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:36:06.704045 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-84dbaf17-76d3-4487-a693-478519deac45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:36:06.708952 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-ce0a81be-11a4-42a7-a99d-c07bda09ccbc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '78e9f65f6bfd42bf9e264b28ffbd4c93'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:36:06.709603 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-ce0a81be-11a4-42a7-a99d-c07bda09ccbc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '78e9f65f6bfd42bf9e264b28ffbd4c93'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:36:06.729486 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 954/1939] 10.222.0.23 () {58 vars in 1223 bytes} [Tue May 10 05:36:06 2022] DELETE /identity/v3/users/78e9f65f6bfd42bf9e264b28ffbd4c93 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 05:36:06.734370 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5486cf-db37-48cd-a661-bbd2a05d6b4a None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:36:06.734666 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5486cf-db37-48cd-a661-bbd2a05d6b4a None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:36:06.735013 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5486cf-db37-48cd-a661-bbd2a05d6b4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:36:06.755910 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-aa5486cf-db37-48cd-a661-bbd2a05d6b4a None None] MFA Rules not processed for user `44883b22532e44049d846938dc2cf423`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:36:06.757359 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-aa5486cf-db37-48cd-a661-bbd2a05d6b4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:36:06.781184 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 986/1940] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 10 05:36:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 05:36:06.788319 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84dbaf17-76d3-4487-a693-478519deac45 None None] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:36:06.789762 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-84dbaf17-76d3-4487-a693-478519deac45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:36:06.821548 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 955/1941] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 10 05:36:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 05:36:06.841874 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5486cf-db37-48cd-a661-bbd2a05d6b4a None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:36:06.844422 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-aa5486cf-db37-48cd-a661-bbd2a05d6b4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:36:06.852209 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84dbaf17-76d3-4487-a693-478519deac45 None None] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:36:06.912403 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88009e74-4d3e-4823-a4c1-ef295fd044cc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c8461cfdd9648b8abcaf8d34b7a102a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f23435f783540199d6dcfd0417c090e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:36:06.913062 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88009e74-4d3e-4823-a4c1-ef295fd044cc service neutron] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:36:06.913339 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88009e74-4d3e-4823-a4c1-ef295fd044cc service neutron] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:36:06.913735 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88009e74-4d3e-4823-a4c1-ef295fd044cc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:36:06.915034 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5486cf-db37-48cd-a661-bbd2a05d6b4a None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:36:06.919986 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909a637b-7345-4e1a-bbf8-8d3606e2a72d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c8461cfdd9648b8abcaf8d34b7a102a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f23435f783540199d6dcfd0417c090e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:36:06.920648 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909a637b-7345-4e1a-bbf8-8d3606e2a72d service neutron] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:36:06.920932 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909a637b-7345-4e1a-bbf8-8d3606e2a72d service neutron] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:36:06.921205 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909a637b-7345-4e1a-bbf8-8d3606e2a72d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:36:06.924051 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88009e74-4d3e-4823-a4c1-ef295fd044cc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:36:06.925477 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88009e74-4d3e-4823-a4c1-ef295fd044cc service neutron] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:36:06.934956 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 987/1942] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 10 05:36:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 05:36:06.939601 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909a637b-7345-4e1a-bbf8-8d3606e2a72d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:36:06.941089 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909a637b-7345-4e1a-bbf8-8d3606e2a72d service neutron] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:36:06.950651 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 956/1943] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 10 05:36:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 05:36:07.218410 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88009e74-4d3e-4823-a4c1-ef295fd044cc service neutron] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:36:07.219998 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-88009e74-4d3e-4823-a4c1-ef295fd044cc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:36:07.234581 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88009e74-4d3e-4823-a4c1-ef295fd044cc service neutron] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:36:07.240209 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544a0725-02e4-4351-8287-255828f57a6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:36:07.242269 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544a0725-02e4-4351-8287-255828f57a6a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:36:07.242684 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544a0725-02e4-4351-8287-255828f57a6a admin admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:36:07.244307 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544a0725-02e4-4351-8287-255828f57a6a admin admin] PATH_INFO: `/v3/projects/e497fdc758d84a5cb7bf6dd585469caf` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:36:07.246601 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544a0725-02e4-4351-8287-255828f57a6a admin admin] RBAC: Authorizing `identity:delete_project(project_id=e497fdc758d84a5cb7bf6dd585469caf)` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:36:07.249033 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544a0725-02e4-4351-8287-255828f57a6a admin admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:36:07.260749 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909a637b-7345-4e1a-bbf8-8d3606e2a72d service neutron] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:36:07.262539 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-909a637b-7345-4e1a-bbf8-8d3606e2a72d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:36:07.277747 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909a637b-7345-4e1a-bbf8-8d3606e2a72d service neutron] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:36:07.283877 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bdcc78-a144-4e70-9fca-2a085a40a873 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:36:07.284932 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bdcc78-a144-4e70-9fca-2a085a40a873 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:36:07.285539 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bdcc78-a144-4e70-9fca-2a085a40a873 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:36:07.285887 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bdcc78-a144-4e70-9fca-2a085a40a873 admin admin] PATH_INFO: `/v3/projects/d3990bb8176647ef9f9d6d33b66dce76` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:36:07.287117 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3bdcc78-a144-4e70-9fca-2a085a40a873 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d3990bb8176647ef9f9d6d33b66dce76)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:36:07.289412 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3bdcc78-a144-4e70-9fca-2a085a40a873 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:36:07.317896 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-544a0725-02e4-4351-8287-255828f57a6a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e497fdc758d84a5cb7bf6dd585469caf', 'request_id': 'req-544a0725-02e4-4351-8287-255828f57a6a'} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:36:07.327379 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-544a0725-02e4-4351-8287-255828f57a6a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e497fdc758d84a5cb7bf6dd585469caf', 'request_id': 'req-544a0725-02e4-4351-8287-255828f57a6a'} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:36:07.336344 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-544a0725-02e4-4351-8287-255828f57a6a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e497fdc758d84a5cb7bf6dd585469caf', 'request_id': 'req-544a0725-02e4-4351-8287-255828f57a6a'} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:36:07.349924 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-544a0725-02e4-4351-8287-255828f57a6a admin admin] The token cache is being invalidate because project e497fdc758d84a5cb7bf6dd585469caf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79879) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 05:36:07.350275 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-544a0725-02e4-4351-8287-255828f57a6a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:36:07.350986 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-544a0725-02e4-4351-8287-255828f57a6a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:36:07.353112 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 988/1944] 10.222.0.23 () {58 vars in 1232 bytes} [Tue May 10 05:36:07 2022] DELETE /identity/v3/projects/e497fdc758d84a5cb7bf6dd585469caf => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 05:36:07.353415 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-d3bdcc78-a144-4e70-9fca-2a085a40a873 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd3990bb8176647ef9f9d6d33b66dce76', 'request_id': 'req-d3bdcc78-a144-4e70-9fca-2a085a40a873'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:36:07.360629 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544a0725-02e4-4351-8287-255828f57a6a admin admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:36:07.361329 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-d3bdcc78-a144-4e70-9fca-2a085a40a873 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd3990bb8176647ef9f9d6d33b66dce76', 'request_id': 'req-d3bdcc78-a144-4e70-9fca-2a085a40a873'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:36:07.364084 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-544a0725-02e4-4351-8287-255828f57a6a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:36:07.379637 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-d3bdcc78-a144-4e70-9fca-2a085a40a873 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd3990bb8176647ef9f9d6d33b66dce76', 'request_id': 'req-d3bdcc78-a144-4e70-9fca-2a085a40a873'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:36:07.395732 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-d3bdcc78-a144-4e70-9fca-2a085a40a873 admin admin] The token cache is being invalidate because project d3990bb8176647ef9f9d6d33b66dce76 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79880) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 05:36:07.396149 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-d3bdcc78-a144-4e70-9fca-2a085a40a873 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:36:07.396801 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-d3bdcc78-a144-4e70-9fca-2a085a40a873 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:36:07.398388 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 957/1945] 10.222.0.23 () {58 vars in 1232 bytes} [Tue May 10 05:36:07 2022] DELETE /identity/v3/projects/d3990bb8176647ef9f9d6d33b66dce76 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 05:36:07.402155 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bdcc78-a144-4e70-9fca-2a085a40a873 admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:36:07.403436 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-d3bdcc78-a144-4e70-9fca-2a085a40a873 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:36:07.434022 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544a0725-02e4-4351-8287-255828f57a6a admin admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:36:07.483745 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bdcc78-a144-4e70-9fca-2a085a40a873 admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:36:07.489746 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9a2f03-bbc6-49d3-9504-2cf492d5cdcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:36:07.490796 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9a2f03-bbc6-49d3-9504-2cf492d5cdcf admin admin] REQUEST_METHOD: `DELETE` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:36:07.490891 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9a2f03-bbc6-49d3-9504-2cf492d5cdcf admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:36:07.491177 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9a2f03-bbc6-49d3-9504-2cf492d5cdcf admin admin] PATH_INFO: `/v3/users/b555f5baa16c46c3bea333667c022764` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:36:07.492967 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9a2f03-bbc6-49d3-9504-2cf492d5cdcf admin admin] RBAC: Authorizing `identity:delete_user(user_id=b555f5baa16c46c3bea333667c022764)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:36:07.495609 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9a2f03-bbc6-49d3-9504-2cf492d5cdcf admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:36:07.501758 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b94f3cc-9d27-4df3-adfc-a63a36fefbdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:36:07.502665 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b94f3cc-9d27-4df3-adfc-a63a36fefbdf admin admin] REQUEST_METHOD: `DELETE` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:36:07.502947 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b94f3cc-9d27-4df3-adfc-a63a36fefbdf admin admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:36:07.503274 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b94f3cc-9d27-4df3-adfc-a63a36fefbdf admin admin] PATH_INFO: `/v3/users/204d2e947eee4ec3be96f574c2031e80` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:36:07.504541 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b94f3cc-9d27-4df3-adfc-a63a36fefbdf admin admin] RBAC: Authorizing `identity:delete_user(user_id=204d2e947eee4ec3be96f574c2031e80)` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:36:07.508958 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b94f3cc-9d27-4df3-adfc-a63a36fefbdf admin admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:36:07.546485 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-4f9a2f03-bbc6-49d3-9504-2cf492d5cdcf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b555f5baa16c46c3bea333667c022764'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:36:07.560381 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-4f9a2f03-bbc6-49d3-9504-2cf492d5cdcf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b555f5baa16c46c3bea333667c022764'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:36:07.561714 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-4f9a2f03-bbc6-49d3-9504-2cf492d5cdcf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b555f5baa16c46c3bea333667c022764'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:36:07.563773 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-8b94f3cc-9d27-4df3-adfc-a63a36fefbdf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '204d2e947eee4ec3be96f574c2031e80'} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:36:07.568325 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-4f9a2f03-bbc6-49d3-9504-2cf492d5cdcf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b555f5baa16c46c3bea333667c022764'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:36:07.569160 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-4f9a2f03-bbc6-49d3-9504-2cf492d5cdcf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b555f5baa16c46c3bea333667c022764'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:36:07.576996 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-8b94f3cc-9d27-4df3-adfc-a63a36fefbdf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '204d2e947eee4ec3be96f574c2031e80'} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:36:07.577960 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-8b94f3cc-9d27-4df3-adfc-a63a36fefbdf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '204d2e947eee4ec3be96f574c2031e80'} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:36:07.586555 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 958/1946] 10.222.0.23 () {58 vars in 1223 bytes} [Tue May 10 05:36:07 2022] DELETE /identity/v3/users/b555f5baa16c46c3bea333667c022764 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 05:36:07.591074 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-8b94f3cc-9d27-4df3-adfc-a63a36fefbdf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '204d2e947eee4ec3be96f574c2031e80'} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:36:07.598593 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-8b94f3cc-9d27-4df3-adfc-a63a36fefbdf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '204d2e947eee4ec3be96f574c2031e80'} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:36:07.605386 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 989/1947] 10.222.0.23 () {58 vars in 1223 bytes} [Tue May 10 05:36:07 2022] DELETE /identity/v3/users/204d2e947eee4ec3be96f574c2031e80 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 05:36:07.854194 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9a2f03-bbc6-49d3-9504-2cf492d5cdcf admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:36:07.856024 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-4f9a2f03-bbc6-49d3-9504-2cf492d5cdcf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:36:07.890695 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b94f3cc-9d27-4df3-adfc-a63a36fefbdf admin admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:36:07.892214 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-8b94f3cc-9d27-4df3-adfc-a63a36fefbdf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:36:07.938810 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9a2f03-bbc6-49d3-9504-2cf492d5cdcf admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:36:07.976459 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b94f3cc-9d27-4df3-adfc-a63a36fefbdf admin admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:36:07.982390 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc104027-818e-45a0-96ca-8fcf47f821a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:36:07.983415 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc104027-818e-45a0-96ca-8fcf47f821a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:36:07.983815 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc104027-818e-45a0-96ca-8fcf47f821a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:36:07.984185 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc104027-818e-45a0-96ca-8fcf47f821a0 admin admin] PATH_INFO: `/v3/projects/c43de84b55f849e39823373b8dc3891a` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:36:07.985830 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc104027-818e-45a0-96ca-8fcf47f821a0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c43de84b55f849e39823373b8dc3891a)` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:36:07.988013 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc104027-818e-45a0-96ca-8fcf47f821a0 admin admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:36:07.995615 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962db940-ead6-4208-8332-ea4e61a37aaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:36:07.996767 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962db940-ead6-4208-8332-ea4e61a37aaf admin admin] REQUEST_METHOD: `DELETE` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:36:07.997048 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962db940-ead6-4208-8332-ea4e61a37aaf admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:36:07.997323 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962db940-ead6-4208-8332-ea4e61a37aaf admin admin] PATH_INFO: `/v3/projects/357e48a5e8204a3baa448d0631acadbe` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:36:07.998867 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962db940-ead6-4208-8332-ea4e61a37aaf admin admin] RBAC: Authorizing `identity:delete_project(project_id=357e48a5e8204a3baa448d0631acadbe)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:36:08.000924 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962db940-ead6-4208-8332-ea4e61a37aaf admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:36:08.044515 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-cc104027-818e-45a0-96ca-8fcf47f821a0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c43de84b55f849e39823373b8dc3891a', 'request_id': 'req-cc104027-818e-45a0-96ca-8fcf47f821a0'} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:36:08.052094 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-cc104027-818e-45a0-96ca-8fcf47f821a0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c43de84b55f849e39823373b8dc3891a', 'request_id': 'req-cc104027-818e-45a0-96ca-8fcf47f821a0'} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:36:08.053254 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-962db940-ead6-4208-8332-ea4e61a37aaf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '357e48a5e8204a3baa448d0631acadbe', 'request_id': 'req-962db940-ead6-4208-8332-ea4e61a37aaf'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:36:08.060281 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-cc104027-818e-45a0-96ca-8fcf47f821a0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c43de84b55f849e39823373b8dc3891a', 'request_id': 'req-cc104027-818e-45a0-96ca-8fcf47f821a0'} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:36:08.063693 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-962db940-ead6-4208-8332-ea4e61a37aaf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '357e48a5e8204a3baa448d0631acadbe', 'request_id': 'req-962db940-ead6-4208-8332-ea4e61a37aaf'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:36:08.073309 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-962db940-ead6-4208-8332-ea4e61a37aaf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '357e48a5e8204a3baa448d0631acadbe', 'request_id': 'req-962db940-ead6-4208-8332-ea4e61a37aaf'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:36:08.074879 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-cc104027-818e-45a0-96ca-8fcf47f821a0 admin admin] The token cache is being invalidate because project c43de84b55f849e39823373b8dc3891a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79879) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 05:36:08.075348 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-cc104027-818e-45a0-96ca-8fcf47f821a0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:36:08.076216 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-cc104027-818e-45a0-96ca-8fcf47f821a0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:36:08.079595 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 990/1948] 10.222.0.23 () {58 vars in 1232 bytes} [Tue May 10 05:36:07 2022] DELETE /identity/v3/projects/c43de84b55f849e39823373b8dc3891a => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 05:36:08.085782 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be7f165-3cc0-4c2d-90b9-b14eeed25ce2 None None] REQUEST_METHOD: `POST` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:36:08.086181 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be7f165-3cc0-4c2d-90b9-b14eeed25ce2 None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:36:08.086578 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be7f165-3cc0-4c2d-90b9-b14eeed25ce2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:36:08.089926 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-962db940-ead6-4208-8332-ea4e61a37aaf admin admin] The token cache is being invalidate because project 357e48a5e8204a3baa448d0631acadbe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79880) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 05:36:08.090219 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-962db940-ead6-4208-8332-ea4e61a37aaf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:36:08.090862 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-962db940-ead6-4208-8332-ea4e61a37aaf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:36:08.092763 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 959/1949] 10.222.0.23 () {58 vars in 1232 bytes} [Tue May 10 05:36:07 2022] DELETE /identity/v3/projects/357e48a5e8204a3baa448d0631acadbe => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 05:36:08.096492 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962db940-ead6-4208-8332-ea4e61a37aaf admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:36:08.097861 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-962db940-ead6-4208-8332-ea4e61a37aaf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:36:08.106423 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.auth.core [None req-0be7f165-3cc0-4c2d-90b9-b14eeed25ce2 None None] MFA Rules not processed for user `44883b22532e44049d846938dc2cf423`. Rule list: `[]` (Enabled: `True`). {{(pid=79879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:36:08.107716 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-0be7f165-3cc0-4c2d-90b9-b14eeed25ce2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:36:08.174851 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962db940-ead6-4208-8332-ea4e61a37aaf admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:36:08.179473 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 991/1950] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 10 05:36:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 05:36:08.179810 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd2f1bc-6261-41de-a958-0b0c7eb45bd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:36:08.180639 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd2f1bc-6261-41de-a958-0b0c7eb45bd9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:36:08.180922 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd2f1bc-6261-41de-a958-0b0c7eb45bd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:36:08.181228 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd2f1bc-6261-41de-a958-0b0c7eb45bd9 admin admin] PATH_INFO: `/v3/users/697b4f5da9a04252895155a6655f47f7` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:36:08.182464 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd2f1bc-6261-41de-a958-0b0c7eb45bd9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=697b4f5da9a04252895155a6655f47f7)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:36:08.184424 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd2f1bc-6261-41de-a958-0b0c7eb45bd9 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:36:08.187009 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248fcd03-0e82-4b82-a881-d1ce088524ee None None] REQUEST_METHOD: `POST` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:36:08.187304 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248fcd03-0e82-4b82-a881-d1ce088524ee None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:36:08.187609 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248fcd03-0e82-4b82-a881-d1ce088524ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:36:08.206445 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.auth.core [None req-248fcd03-0e82-4b82-a881-d1ce088524ee None None] MFA Rules not processed for user `44883b22532e44049d846938dc2cf423`. Rule list: `[]` (Enabled: `True`). {{(pid=79879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:36:08.207671 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-248fcd03-0e82-4b82-a881-d1ce088524ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:36:08.217308 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 992/1951] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 10 05:36:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 05:36:08.221332 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248fcd03-0e82-4b82-a881-d1ce088524ee None None] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:36:08.230157 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248fcd03-0e82-4b82-a881-d1ce088524ee None None] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:36:08.231054 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-afd2f1bc-6261-41de-a958-0b0c7eb45bd9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '697b4f5da9a04252895155a6655f47f7'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:36:08.234688 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955721e8-50a0-4c86-9931-9f786317740b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:36:08.235393 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955721e8-50a0-4c86-9931-9f786317740b admin admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:36:08.235713 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955721e8-50a0-4c86-9931-9f786317740b admin admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:36:08.235993 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955721e8-50a0-4c86-9931-9f786317740b admin admin] PATH_INFO: `/v3/domains` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:36:08.236731 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955721e8-50a0-4c86-9931-9f786317740b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:36:08.237039 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955721e8-50a0-4c86-9931-9f786317740b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:36:08.238641 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955721e8-50a0-4c86-9931-9f786317740b admin admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:36:08.242513 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-afd2f1bc-6261-41de-a958-0b0c7eb45bd9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '697b4f5da9a04252895155a6655f47f7'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:36:08.243239 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-afd2f1bc-6261-41de-a958-0b0c7eb45bd9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '697b4f5da9a04252895155a6655f47f7'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:36:08.251163 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-afd2f1bc-6261-41de-a958-0b0c7eb45bd9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '697b4f5da9a04252895155a6655f47f7'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:36:08.251322 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 993/1952] 10.222.0.23 () {58 vars in 1152 bytes} [Tue May 10 05:36:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 05:36:08.252086 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-afd2f1bc-6261-41de-a958-0b0c7eb45bd9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '697b4f5da9a04252895155a6655f47f7'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:36:08.255913 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955721e8-50a0-4c86-9931-9f786317740b admin admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:36:08.257981 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-955721e8-50a0-4c86-9931-9f786317740b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:36:08.269428 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 960/1953] 10.222.0.23 () {58 vars in 1223 bytes} [Tue May 10 05:36:08 2022] DELETE /identity/v3/users/697b4f5da9a04252895155a6655f47f7 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 05:36:08.273450 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955721e8-50a0-4c86-9931-9f786317740b admin admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:36:08.330780 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da00deb-d100-4b55-8044-986282b3b42f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:36:08.331422 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da00deb-d100-4b55-8044-986282b3b42f admin admin] REQUEST_METHOD: `POST` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:36:08.331741 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da00deb-d100-4b55-8044-986282b3b42f admin admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:36:08.332034 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da00deb-d100-4b55-8044-986282b3b42f admin admin] PATH_INFO: `/v3/projects` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:36:08.332727 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da00deb-d100-4b55-8044-986282b3b42f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:36:08.334705 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da00deb-d100-4b55-8044-986282b3b42f admin admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:36:08.364939 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 994/1954] 10.222.0.23 () {60 vars in 1152 bytes} [Tue May 10 05:36:08 2022] POST /identity/v3/projects => generated 399 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 05:36:08.366235 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd2f1bc-6261-41de-a958-0b0c7eb45bd9 admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:36:08.376899 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd2f1bc-6261-41de-a958-0b0c7eb45bd9 admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:36:08.434336 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d5978f-b143-4ecd-aa0f-6faa5b5fccf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:36:08.435326 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d5978f-b143-4ecd-aa0f-6faa5b5fccf8 admin admin] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:36:08.435749 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d5978f-b143-4ecd-aa0f-6faa5b5fccf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:36:08.436126 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d5978f-b143-4ecd-aa0f-6faa5b5fccf8 admin admin] PATH_INFO: `/v3/users` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:36:08.436940 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d5978f-b143-4ecd-aa0f-6faa5b5fccf8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:36:08.439223 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d5978f-b143-4ecd-aa0f-6faa5b5fccf8 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:36:08.461662 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 961/1955] 10.222.0.23 () {60 vars in 1143 bytes} [Tue May 10 05:36:08 2022] POST /identity/v3/users => generated 300 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 05:36:08.465839 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da00deb-d100-4b55-8044-986282b3b42f admin admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:36:08.479289 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da00deb-d100-4b55-8044-986282b3b42f admin admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:36:08.484161 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec8ff3c-8e47-4cd0-99c9-e6500043d15b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:36:08.484993 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec8ff3c-8e47-4cd0-99c9-e6500043d15b admin admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:36:08.485276 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec8ff3c-8e47-4cd0-99c9-e6500043d15b admin admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:36:08.485544 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec8ff3c-8e47-4cd0-99c9-e6500043d15b admin admin] PATH_INFO: `/v3/roles` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:36:08.486385 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec8ff3c-8e47-4cd0-99c9-e6500043d15b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:36:08.488103 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec8ff3c-8e47-4cd0-99c9-e6500043d15b admin admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:36:08.499275 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 995/1956] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 10 05:36:08 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 05:36:08.503500 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d5978f-b143-4ecd-aa0f-6faa5b5fccf8 admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:36:08.515773 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d5978f-b143-4ecd-aa0f-6faa5b5fccf8 admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:36:08.522100 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789687b1-1437-4da1-8990-9c2ed1aeaa15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:36:08.522849 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789687b1-1437-4da1-8990-9c2ed1aeaa15 admin admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:36:08.523248 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789687b1-1437-4da1-8990-9c2ed1aeaa15 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:36:08.523675 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789687b1-1437-4da1-8990-9c2ed1aeaa15 admin admin] PATH_INFO: `/v3/roles` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:36:08.524565 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789687b1-1437-4da1-8990-9c2ed1aeaa15 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:36:08.526282 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789687b1-1437-4da1-8990-9c2ed1aeaa15 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:36:08.538233 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 962/1957] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 10 05:36:08 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 05:36:08.542783 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec8ff3c-8e47-4cd0-99c9-e6500043d15b admin admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:36:08.554221 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec8ff3c-8e47-4cd0-99c9-e6500043d15b admin admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:36:08.561147 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41a30a4-d72a-49dc-ac17-42f6ac5a379e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:36:08.562111 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41a30a4-d72a-49dc-ac17-42f6ac5a379e admin admin] REQUEST_METHOD: `PUT` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:36:08.562437 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41a30a4-d72a-49dc-ac17-42f6ac5a379e admin admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:36:08.562782 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41a30a4-d72a-49dc-ac17-42f6ac5a379e admin admin] PATH_INFO: `/v3/projects/68484ac6fff0418da13a7f3791f96f17/users/58efe83fe54047baa2cc61e3886e241c/roles/382636e67fc142a2b2f486340d959e11` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:36:08.577296 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789687b1-1437-4da1-8990-9c2ed1aeaa15 admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:36:08.579351 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-789687b1-1437-4da1-8990-9c2ed1aeaa15 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:36:08.589936 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41a30a4-d72a-49dc-ac17-42f6ac5a379e admin admin] RBAC: Authorizing `identity:create_grant(project_id=68484ac6fff0418da13a7f3791f96f17, user_id=58efe83fe54047baa2cc61e3886e241c, role_id=382636e67fc142a2b2f486340d959e11)` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:36:08.593269 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41a30a4-d72a-49dc-ac17-42f6ac5a379e admin admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:36:08.598046 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789687b1-1437-4da1-8990-9c2ed1aeaa15 admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:36:08.604154 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18271ce7-3c42-4745-90a3-ead9fab46855 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:36:08.605368 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18271ce7-3c42-4745-90a3-ead9fab46855 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:36:08.605907 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18271ce7-3c42-4745-90a3-ead9fab46855 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:36:08.606387 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18271ce7-3c42-4745-90a3-ead9fab46855 admin admin] PATH_INFO: `/v3/projects/1e0dd769e0e545f2a0c382699e8038b2` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:36:08.607942 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18271ce7-3c42-4745-90a3-ead9fab46855 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1e0dd769e0e545f2a0c382699e8038b2)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:36:08.610072 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18271ce7-3c42-4745-90a3-ead9fab46855 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:36:08.613063 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 996/1958] 10.222.0.23 () {60 vars in 1482 bytes} [Tue May 10 05:36:08 2022] PUT /identity/v3/projects/68484ac6fff0418da13a7f3791f96f17/users/58efe83fe54047baa2cc61e3886e241c/roles/382636e67fc142a2b2f486340d959e11 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 05:36:08.625677 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0acbf7-767c-4aed-aa7f-272f4f279703 None None] REQUEST_METHOD: `POST` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:36:08.626015 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0acbf7-767c-4aed-aa7f-272f4f279703 None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:36:08.626367 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0acbf7-767c-4aed-aa7f-272f4f279703 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:36:08.657821 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.auth.core [None req-bf0acbf7-767c-4aed-aa7f-272f4f279703 None None] MFA Rules not processed for user `58efe83fe54047baa2cc61e3886e241c`. Rule list: `[]` (Enabled: `True`). {{(pid=79879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:36:08.664567 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-bf0acbf7-767c-4aed-aa7f-272f4f279703 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:36:08.683180 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-18271ce7-3c42-4745-90a3-ead9fab46855 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1e0dd769e0e545f2a0c382699e8038b2', 'request_id': 'req-18271ce7-3c42-4745-90a3-ead9fab46855'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:36:08.700973 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-18271ce7-3c42-4745-90a3-ead9fab46855 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1e0dd769e0e545f2a0c382699e8038b2', 'request_id': 'req-18271ce7-3c42-4745-90a3-ead9fab46855'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:36:08.713725 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-18271ce7-3c42-4745-90a3-ead9fab46855 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1e0dd769e0e545f2a0c382699e8038b2', 'request_id': 'req-18271ce7-3c42-4745-90a3-ead9fab46855'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:36:08.728091 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-18271ce7-3c42-4745-90a3-ead9fab46855 admin admin] The token cache is being invalidate because project 1e0dd769e0e545f2a0c382699e8038b2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79880) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 05:36:08.728237 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-18271ce7-3c42-4745-90a3-ead9fab46855 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:36:08.728884 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-18271ce7-3c42-4745-90a3-ead9fab46855 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:36:08.730506 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 963/1959] 10.222.0.23 () {58 vars in 1232 bytes} [Tue May 10 05:36:08 2022] DELETE /identity/v3/projects/1e0dd769e0e545f2a0c382699e8038b2 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 05:36:08.742355 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52edb32-4249-4f07-a48e-4203b6a6476e None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:36:08.742642 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52edb32-4249-4f07-a48e-4203b6a6476e None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:36:08.742919 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52edb32-4249-4f07-a48e-4203b6a6476e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:36:08.746610 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 997/1960] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 10 05:36:08 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 05:36:08.759691 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0acbf7-767c-4aed-aa7f-272f4f279703 None None] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:36:08.761187 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-bf0acbf7-767c-4aed-aa7f-272f4f279703 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:36:08.762907 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-e52edb32-4249-4f07-a48e-4203b6a6476e None None] MFA Rules not processed for user `44883b22532e44049d846938dc2cf423`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:36:08.764100 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-e52edb32-4249-4f07-a48e-4203b6a6476e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:36:08.815208 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0acbf7-767c-4aed-aa7f-272f4f279703 None None] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:36:08.818836 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05b37b3-94cf-4294-a4e3-21553edb4910 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355be413675540a39ccb00e1a0722316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f23435f783540199d6dcfd0417c090e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:36:08.819489 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05b37b3-94cf-4294-a4e3-21553edb4910 service cinder] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:36:08.819803 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05b37b3-94cf-4294-a4e3-21553edb4910 service cinder] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:36:08.820077 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05b37b3-94cf-4294-a4e3-21553edb4910 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:36:08.820783 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 964/1961] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 10 05:36:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 05:36:08.828789 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05b37b3-94cf-4294-a4e3-21553edb4910 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:36:08.828924 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24f5421-21a7-487d-9a83-ae94db487724 None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:36:08.829152 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24f5421-21a7-487d-9a83-ae94db487724 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:36:08.829427 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24f5421-21a7-487d-9a83-ae94db487724 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:36:08.830243 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05b37b3-94cf-4294-a4e3-21553edb4910 service cinder] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:36:08.839057 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 998/1962] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 10 05:36:08 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 05:36:08.846619 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-b24f5421-21a7-487d-9a83-ae94db487724 None None] MFA Rules not processed for user `44883b22532e44049d846938dc2cf423`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:36:08.847831 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-b24f5421-21a7-487d-9a83-ae94db487724 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:36:08.856081 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 965/1963] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 10 05:36:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 05:36:08.860365 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05b37b3-94cf-4294-a4e3-21553edb4910 service cinder] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:36:08.871338 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05b37b3-94cf-4294-a4e3-21553edb4910 service cinder] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:36:08.876800 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3275b832-249c-40ac-aa93-92ac1ea610e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:36:08.877435 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3275b832-249c-40ac-aa93-92ac1ea610e5 admin admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:36:08.877715 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3275b832-249c-40ac-aa93-92ac1ea610e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:36:08.877990 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3275b832-249c-40ac-aa93-92ac1ea610e5 admin admin] PATH_INFO: `/v3/domains` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:36:08.878723 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3275b832-249c-40ac-aa93-92ac1ea610e5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:36:08.879030 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3275b832-249c-40ac-aa93-92ac1ea610e5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:36:08.880701 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3275b832-249c-40ac-aa93-92ac1ea610e5 admin admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:36:08.892409 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 999/1964] 10.222.0.23 () {58 vars in 1152 bytes} [Tue May 10 05:36:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 05:36:08.896909 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24f5421-21a7-487d-9a83-ae94db487724 None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:36:08.906248 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24f5421-21a7-487d-9a83-ae94db487724 None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:36:08.911506 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ca52e8-42dc-4d5c-b196-c5724672caa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:36:08.912193 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ca52e8-42dc-4d5c-b196-c5724672caa3 admin admin] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:36:08.912470 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ca52e8-42dc-4d5c-b196-c5724672caa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:36:08.912850 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ca52e8-42dc-4d5c-b196-c5724672caa3 admin admin] PATH_INFO: `/v3/projects` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:36:08.913433 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ca52e8-42dc-4d5c-b196-c5724672caa3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:36:08.915326 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ca52e8-42dc-4d5c-b196-c5724672caa3 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:36:08.945501 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 966/1965] 10.222.0.23 () {60 vars in 1152 bytes} [Tue May 10 05:36:08 2022] POST /identity/v3/projects => generated 381 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 05:36:08.947027 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3275b832-249c-40ac-aa93-92ac1ea610e5 admin admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:36:08.961449 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3275b832-249c-40ac-aa93-92ac1ea610e5 admin admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:36:09.025362 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a7dc9e-fd3c-4943-b068-e05a78ce9101 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:36:09.026057 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a7dc9e-fd3c-4943-b068-e05a78ce9101 admin admin] REQUEST_METHOD: `POST` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:36:09.026357 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a7dc9e-fd3c-4943-b068-e05a78ce9101 admin admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:36:09.026657 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a7dc9e-fd3c-4943-b068-e05a78ce9101 admin admin] PATH_INFO: `/v3/users` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:36:09.027339 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a7dc9e-fd3c-4943-b068-e05a78ce9101 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:36:09.029322 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a7dc9e-fd3c-4943-b068-e05a78ce9101 admin admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:36:09.058611 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1000/1966] 10.222.0.23 () {60 vars in 1143 bytes} [Tue May 10 05:36:08 2022] POST /identity/v3/users => generated 291 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 05:36:09.059726 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ca52e8-42dc-4d5c-b196-c5724672caa3 admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:36:09.070617 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ca52e8-42dc-4d5c-b196-c5724672caa3 admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:36:09.075885 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b77bd6-6e10-4f56-9691-310e26baa957 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:36:09.076572 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b77bd6-6e10-4f56-9691-310e26baa957 admin admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:36:09.077044 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b77bd6-6e10-4f56-9691-310e26baa957 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:36:09.077332 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b77bd6-6e10-4f56-9691-310e26baa957 admin admin] PATH_INFO: `/v3/roles` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:36:09.078076 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b77bd6-6e10-4f56-9691-310e26baa957 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:36:09.079813 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b77bd6-6e10-4f56-9691-310e26baa957 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:36:09.091781 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 967/1967] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 10 05:36:09 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 05:36:09.096848 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a7dc9e-fd3c-4943-b068-e05a78ce9101 admin admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:36:09.111819 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a7dc9e-fd3c-4943-b068-e05a78ce9101 admin admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:36:09.118872 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d07b42-67fc-4eaa-afd6-2b362ce068d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:36:09.119867 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d07b42-67fc-4eaa-afd6-2b362ce068d5 admin admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:36:09.120379 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d07b42-67fc-4eaa-afd6-2b362ce068d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:36:09.120966 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d07b42-67fc-4eaa-afd6-2b362ce068d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:36:09.122148 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d07b42-67fc-4eaa-afd6-2b362ce068d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:36:09.124825 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d07b42-67fc-4eaa-afd6-2b362ce068d5 admin admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:36:09.138622 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1001/1968] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 10 05:36:09 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 05:36:09.143081 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b77bd6-6e10-4f56-9691-310e26baa957 admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:36:09.162721 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b77bd6-6e10-4f56-9691-310e26baa957 admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:36:09.170189 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973ac713-bcc9-4d52-92b3-5da45e3346d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:36:09.171894 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973ac713-bcc9-4d52-92b3-5da45e3346d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:36:09.188054 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973ac713-bcc9-4d52-92b3-5da45e3346d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:36:09.189370 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973ac713-bcc9-4d52-92b3-5da45e3346d6 admin admin] PATH_INFO: `/v3/projects/48acb5a345494f8ca2c94f52cb0b5648/users/1db4ce8d9f454bd2b6f262b6f404b683/roles/382636e67fc142a2b2f486340d959e11` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:36:09.249926 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973ac713-bcc9-4d52-92b3-5da45e3346d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=48acb5a345494f8ca2c94f52cb0b5648, user_id=1db4ce8d9f454bd2b6f262b6f404b683, role_id=382636e67fc142a2b2f486340d959e11)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:36:09.253226 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973ac713-bcc9-4d52-92b3-5da45e3346d6 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:36:09.283650 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 968/1969] 10.222.0.23 () {60 vars in 1482 bytes} [Tue May 10 05:36:09 2022] PUT /identity/v3/projects/48acb5a345494f8ca2c94f52cb0b5648/users/1db4ce8d9f454bd2b6f262b6f404b683/roles/382636e67fc142a2b2f486340d959e11 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 05:36:09.294713 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf94ce3c-8f4a-4df5-978a-0d8529269102 None None] REQUEST_METHOD: `POST` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:36:09.295251 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf94ce3c-8f4a-4df5-978a-0d8529269102 None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:36:09.295251 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf94ce3c-8f4a-4df5-978a-0d8529269102 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:36:09.364434 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.auth.core [None req-cf94ce3c-8f4a-4df5-978a-0d8529269102 None None] MFA Rules not processed for user `1db4ce8d9f454bd2b6f262b6f404b683`. Rule list: `[]` (Enabled: `True`). {{(pid=79879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:36:09.365859 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-cf94ce3c-8f4a-4df5-978a-0d8529269102 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:36:09.556280 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1002/1970] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 10 05:36:09 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 05:36:09.560700 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973ac713-bcc9-4d52-92b3-5da45e3346d6 admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:36:09.681541 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973ac713-bcc9-4d52-92b3-5da45e3346d6 admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:36:09.686888 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889880b4-f876-48cb-8528-0d4861815e9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:36:09.687785 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889880b4-f876-48cb-8528-0d4861815e9a admin admin] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:36:09.688112 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889880b4-f876-48cb-8528-0d4861815e9a admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:36:09.688386 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889880b4-f876-48cb-8528-0d4861815e9a admin admin] PATH_INFO: `/v3/projects` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:36:09.689143 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889880b4-f876-48cb-8528-0d4861815e9a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:36:09.691181 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889880b4-f876-48cb-8528-0d4861815e9a admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:36:09.718682 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 969/1971] 10.222.0.23 () {60 vars in 1152 bytes} [Tue May 10 05:36:09 2022] POST /identity/v3/projects => generated 383 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 05:36:09.723100 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf94ce3c-8f4a-4df5-978a-0d8529269102 None None] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:36:09.734331 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf94ce3c-8f4a-4df5-978a-0d8529269102 None None] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:36:09.802851 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6302596a-8692-4a0b-bb9c-71875e8f024f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:36:09.803770 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6302596a-8692-4a0b-bb9c-71875e8f024f admin admin] REQUEST_METHOD: `POST` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:36:09.804052 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6302596a-8692-4a0b-bb9c-71875e8f024f admin admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:36:09.804332 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6302596a-8692-4a0b-bb9c-71875e8f024f admin admin] PATH_INFO: `/v3/users` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:36:09.805024 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6302596a-8692-4a0b-bb9c-71875e8f024f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:36:09.806954 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6302596a-8692-4a0b-bb9c-71875e8f024f admin admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:36:09.832155 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1003/1972] 10.222.0.23 () {60 vars in 1143 bytes} [Tue May 10 05:36:09 2022] POST /identity/v3/users => generated 298 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 05:36:09.837772 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889880b4-f876-48cb-8528-0d4861815e9a admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:36:09.851890 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889880b4-f876-48cb-8528-0d4861815e9a admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:36:09.856702 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45e59cd-2662-47a9-af50-e2728851047d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:36:09.857453 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45e59cd-2662-47a9-af50-e2728851047d admin admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:36:09.863911 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45e59cd-2662-47a9-af50-e2728851047d admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:36:09.867788 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45e59cd-2662-47a9-af50-e2728851047d admin admin] PATH_INFO: `/v3/roles` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:36:09.868656 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45e59cd-2662-47a9-af50-e2728851047d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:36:09.870315 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45e59cd-2662-47a9-af50-e2728851047d admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:36:09.882737 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 970/1973] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 10 05:36:09 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 05:36:09.886676 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6302596a-8692-4a0b-bb9c-71875e8f024f admin admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:36:09.896583 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6302596a-8692-4a0b-bb9c-71875e8f024f admin admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:36:09.901195 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760bfa9e-c219-4da8-87e6-bae360c0d29e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:36:09.902091 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760bfa9e-c219-4da8-87e6-bae360c0d29e admin admin] REQUEST_METHOD: `PUT` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:36:09.902374 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760bfa9e-c219-4da8-87e6-bae360c0d29e admin admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:36:09.902652 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760bfa9e-c219-4da8-87e6-bae360c0d29e admin admin] PATH_INFO: `/v3/projects/186b9e921a0341f5a3dffc1ca78fc838/users/81253779848d4bae89186a6003f9f62e/roles/199ac1dd842441d7913c6ee89d8fbecc` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:36:09.917064 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760bfa9e-c219-4da8-87e6-bae360c0d29e admin admin] RBAC: Authorizing `identity:create_grant(project_id=186b9e921a0341f5a3dffc1ca78fc838, user_id=81253779848d4bae89186a6003f9f62e, role_id=199ac1dd842441d7913c6ee89d8fbecc)` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:36:09.919775 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760bfa9e-c219-4da8-87e6-bae360c0d29e admin admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:36:09.937102 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1004/1974] 10.222.0.23 () {60 vars in 1482 bytes} [Tue May 10 05:36:09 2022] PUT /identity/v3/projects/186b9e921a0341f5a3dffc1ca78fc838/users/81253779848d4bae89186a6003f9f62e/roles/199ac1dd842441d7913c6ee89d8fbecc => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 05:36:09.941955 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45e59cd-2662-47a9-af50-e2728851047d admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:36:09.952840 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45e59cd-2662-47a9-af50-e2728851047d admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:36:10.008630 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f386fed-f4d7-4845-aab5-e738f04dea97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:36:10.009306 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f386fed-f4d7-4845-aab5-e738f04dea97 admin admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:36:10.009588 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f386fed-f4d7-4845-aab5-e738f04dea97 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:36:10.009861 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f386fed-f4d7-4845-aab5-e738f04dea97 admin admin] PATH_INFO: `/v3/roles` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:36:10.010567 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f386fed-f4d7-4845-aab5-e738f04dea97 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:36:10.012190 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f386fed-f4d7-4845-aab5-e738f04dea97 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:36:10.021785 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 971/1975] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 10 05:36:09 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 05:36:10.026127 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760bfa9e-c219-4da8-87e6-bae360c0d29e admin admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:36:10.036503 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760bfa9e-c219-4da8-87e6-bae360c0d29e admin admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:36:10.041162 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d47197e-603f-4a8c-ba98-b0bba29248d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:36:10.042043 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d47197e-603f-4a8c-ba98-b0bba29248d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:36:10.042327 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d47197e-603f-4a8c-ba98-b0bba29248d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:36:10.042604 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d47197e-603f-4a8c-ba98-b0bba29248d6 admin admin] PATH_INFO: `/v3/projects/186b9e921a0341f5a3dffc1ca78fc838/users/81253779848d4bae89186a6003f9f62e/roles/199ac1dd842441d7913c6ee89d8fbecc` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:36:10.044945 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d47197e-603f-4a8c-ba98-b0bba29248d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=186b9e921a0341f5a3dffc1ca78fc838, user_id=81253779848d4bae89186a6003f9f62e, role_id=199ac1dd842441d7913c6ee89d8fbecc)` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:36:10.047605 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d47197e-603f-4a8c-ba98-b0bba29248d6 admin admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:36:10.058805 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1005/1976] 10.222.0.23 () {60 vars in 1482 bytes} [Tue May 10 05:36:10 2022] PUT /identity/v3/projects/186b9e921a0341f5a3dffc1ca78fc838/users/81253779848d4bae89186a6003f9f62e/roles/199ac1dd842441d7913c6ee89d8fbecc => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 05:36:10.069067 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d723c03-3076-4ed0-b6a7-63fac09a3e2f None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:36:10.069355 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d723c03-3076-4ed0-b6a7-63fac09a3e2f None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:36:10.069629 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d723c03-3076-4ed0-b6a7-63fac09a3e2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:36:10.099120 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-0d723c03-3076-4ed0-b6a7-63fac09a3e2f None None] MFA Rules not processed for user `81253779848d4bae89186a6003f9f62e`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:36:10.100400 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-0d723c03-3076-4ed0-b6a7-63fac09a3e2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:36:10.170389 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 972/1977] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 10 05:36:10 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 05:36:10.182597 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d47197e-603f-4a8c-ba98-b0bba29248d6 admin admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:36:10.184341 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-1d47197e-603f-4a8c-ba98-b0bba29248d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:36:10.243128 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d47197e-603f-4a8c-ba98-b0bba29248d6 admin admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:36:10.247739 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26043e3-040a-466a-b473-1b7dfeba1830 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355be413675540a39ccb00e1a0722316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f23435f783540199d6dcfd0417c090e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:36:10.248408 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26043e3-040a-466a-b473-1b7dfeba1830 service cinder] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:36:10.248685 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26043e3-040a-466a-b473-1b7dfeba1830 service cinder] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:36:10.248961 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26043e3-040a-466a-b473-1b7dfeba1830 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:36:10.258506 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26043e3-040a-466a-b473-1b7dfeba1830 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:36:10.259997 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26043e3-040a-466a-b473-1b7dfeba1830 service cinder] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:36:10.269402 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1006/1978] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 10 05:36:10 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 05:36:10.357662 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d723c03-3076-4ed0-b6a7-63fac09a3e2f None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:36:10.367111 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d723c03-3076-4ed0-b6a7-63fac09a3e2f None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:36:10.370785 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224a7026-c852-4d75-a530-3a8b45c4e586 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355be413675540a39ccb00e1a0722316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f23435f783540199d6dcfd0417c090e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:36:10.371429 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224a7026-c852-4d75-a530-3a8b45c4e586 service cinder] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:36:10.371817 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224a7026-c852-4d75-a530-3a8b45c4e586 service cinder] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:36:10.372088 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224a7026-c852-4d75-a530-3a8b45c4e586 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:36:10.438780 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224a7026-c852-4d75-a530-3a8b45c4e586 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:36:10.440280 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224a7026-c852-4d75-a530-3a8b45c4e586 service cinder] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:36:10.451684 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 973/1979] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 10 05:36:10 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 05:36:10.706995 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26043e3-040a-466a-b473-1b7dfeba1830 service cinder] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:36:10.767265 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26043e3-040a-466a-b473-1b7dfeba1830 service cinder] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:36:10.772055 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e596f99-4714-4782-a139-066f4dea40e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:36:10.772920 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e596f99-4714-4782-a139-066f4dea40e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:36:10.773199 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e596f99-4714-4782-a139-066f4dea40e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:36:10.773472 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e596f99-4714-4782-a139-066f4dea40e4 admin admin] PATH_INFO: `/v3/users/1db4ce8d9f454bd2b6f262b6f404b683` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:36:10.774672 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e596f99-4714-4782-a139-066f4dea40e4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1db4ce8d9f454bd2b6f262b6f404b683)` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:36:10.776634 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e596f99-4714-4782-a139-066f4dea40e4 admin admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:36:10.823754 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-9e596f99-4714-4782-a139-066f4dea40e4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1db4ce8d9f454bd2b6f262b6f404b683'} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:36:10.832239 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-9e596f99-4714-4782-a139-066f4dea40e4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1db4ce8d9f454bd2b6f262b6f404b683'} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:36:10.832849 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-9e596f99-4714-4782-a139-066f4dea40e4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1db4ce8d9f454bd2b6f262b6f404b683'} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:36:10.845522 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-9e596f99-4714-4782-a139-066f4dea40e4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1db4ce8d9f454bd2b6f262b6f404b683'} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:36:10.856493 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-9e596f99-4714-4782-a139-066f4dea40e4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1db4ce8d9f454bd2b6f262b6f404b683'} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:36:10.862534 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1007/1980] 10.222.0.23 () {58 vars in 1223 bytes} [Tue May 10 05:36:10 2022] DELETE /identity/v3/users/1db4ce8d9f454bd2b6f262b6f404b683 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 05:36:10.867394 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e9fb8f-bf6f-4589-a23c-dfb071926e5d None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:36:10.867693 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e9fb8f-bf6f-4589-a23c-dfb071926e5d None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:36:10.867941 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e9fb8f-bf6f-4589-a23c-dfb071926e5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:36:10.886571 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-f1e9fb8f-bf6f-4589-a23c-dfb071926e5d None None] MFA Rules not processed for user `44883b22532e44049d846938dc2cf423`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:36:10.887805 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-f1e9fb8f-bf6f-4589-a23c-dfb071926e5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:36:10.952126 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 974/1981] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 10 05:36:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 05:36:10.961735 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e596f99-4714-4782-a139-066f4dea40e4 admin admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:36:10.963315 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-9e596f99-4714-4782-a139-066f4dea40e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:36:11.030382 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e596f99-4714-4782-a139-066f4dea40e4 admin admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:36:11.034491 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a9aa0d-900b-4fc4-818f-f7252ccb57a0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c8461cfdd9648b8abcaf8d34b7a102a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f23435f783540199d6dcfd0417c090e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:36:11.035155 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a9aa0d-900b-4fc4-818f-f7252ccb57a0 service neutron] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:36:11.035426 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a9aa0d-900b-4fc4-818f-f7252ccb57a0 service neutron] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:36:11.035731 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a9aa0d-900b-4fc4-818f-f7252ccb57a0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:36:11.054373 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a9aa0d-900b-4fc4-818f-f7252ccb57a0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:36:11.056701 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a9aa0d-900b-4fc4-818f-f7252ccb57a0 service neutron] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:36:11.069970 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1008/1982] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 10 05:36:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 05:36:11.338109 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e9fb8f-bf6f-4589-a23c-dfb071926e5d None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:36:11.339549 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-f1e9fb8f-bf6f-4589-a23c-dfb071926e5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:36:11.351393 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e9fb8f-bf6f-4589-a23c-dfb071926e5d None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:36:11.356592 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3a8641-1e4e-4413-8566-08ae36c1006e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:36:11.357471 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3a8641-1e4e-4413-8566-08ae36c1006e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:36:11.357749 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3a8641-1e4e-4413-8566-08ae36c1006e admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:36:11.358332 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3a8641-1e4e-4413-8566-08ae36c1006e admin admin] PATH_INFO: `/v3/projects/48acb5a345494f8ca2c94f52cb0b5648` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:36:11.359466 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3a8641-1e4e-4413-8566-08ae36c1006e admin admin] RBAC: Authorizing `identity:delete_project(project_id=48acb5a345494f8ca2c94f52cb0b5648)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:36:11.361415 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3a8641-1e4e-4413-8566-08ae36c1006e admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:36:11.407769 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-5f3a8641-1e4e-4413-8566-08ae36c1006e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '48acb5a345494f8ca2c94f52cb0b5648', 'request_id': 'req-5f3a8641-1e4e-4413-8566-08ae36c1006e'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:36:11.413569 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-5f3a8641-1e4e-4413-8566-08ae36c1006e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '48acb5a345494f8ca2c94f52cb0b5648', 'request_id': 'req-5f3a8641-1e4e-4413-8566-08ae36c1006e'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:36:11.422141 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-5f3a8641-1e4e-4413-8566-08ae36c1006e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '48acb5a345494f8ca2c94f52cb0b5648', 'request_id': 'req-5f3a8641-1e4e-4413-8566-08ae36c1006e'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:36:11.433725 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-5f3a8641-1e4e-4413-8566-08ae36c1006e admin admin] The token cache is being invalidate because project 48acb5a345494f8ca2c94f52cb0b5648 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79880) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 05:36:11.434002 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-5f3a8641-1e4e-4413-8566-08ae36c1006e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:36:11.434627 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-5f3a8641-1e4e-4413-8566-08ae36c1006e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:36:11.436220 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 975/1983] 10.222.0.23 () {58 vars in 1232 bytes} [Tue May 10 05:36:11 2022] DELETE /identity/v3/projects/48acb5a345494f8ca2c94f52cb0b5648 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 05:36:11.442379 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a9aa0d-900b-4fc4-818f-f7252ccb57a0 service neutron] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:36:11.456374 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a9aa0d-900b-4fc4-818f-f7252ccb57a0 service neutron] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:36:11.517810 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1574e250-1374-4378-b741-3b76c220c73c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:36:11.518857 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1574e250-1374-4378-b741-3b76c220c73c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:36:11.519201 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1574e250-1374-4378-b741-3b76c220c73c admin admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:36:11.519858 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1574e250-1374-4378-b741-3b76c220c73c admin admin] PATH_INFO: `/v3/users/81253779848d4bae89186a6003f9f62e` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:36:11.521872 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1574e250-1374-4378-b741-3b76c220c73c admin admin] RBAC: Authorizing `identity:delete_user(user_id=81253779848d4bae89186a6003f9f62e)` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:36:11.524954 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1574e250-1374-4378-b741-3b76c220c73c admin admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:36:11.577017 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-1574e250-1374-4378-b741-3b76c220c73c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '81253779848d4bae89186a6003f9f62e'} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:36:11.585797 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-1574e250-1374-4378-b741-3b76c220c73c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '81253779848d4bae89186a6003f9f62e'} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:36:11.586472 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-1574e250-1374-4378-b741-3b76c220c73c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '81253779848d4bae89186a6003f9f62e'} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:36:11.598100 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-1574e250-1374-4378-b741-3b76c220c73c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '81253779848d4bae89186a6003f9f62e'} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:36:11.605253 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-1574e250-1374-4378-b741-3b76c220c73c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '81253779848d4bae89186a6003f9f62e'} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:36:11.611549 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1009/1984] 10.222.0.23 () {58 vars in 1223 bytes} [Tue May 10 05:36:11 2022] DELETE /identity/v3/users/81253779848d4bae89186a6003f9f62e => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 05:36:11.874624 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3a8641-1e4e-4413-8566-08ae36c1006e admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:36:11.876414 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-5f3a8641-1e4e-4413-8566-08ae36c1006e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:36:11.893174 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3a8641-1e4e-4413-8566-08ae36c1006e admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:36:11.950048 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f906bfb-a945-4ca9-8532-e5d6cf6f7977 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:36:11.951068 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f906bfb-a945-4ca9-8532-e5d6cf6f7977 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:36:11.951350 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f906bfb-a945-4ca9-8532-e5d6cf6f7977 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:36:11.951644 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f906bfb-a945-4ca9-8532-e5d6cf6f7977 admin admin] PATH_INFO: `/v3/projects/186b9e921a0341f5a3dffc1ca78fc838` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:36:11.952842 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f906bfb-a945-4ca9-8532-e5d6cf6f7977 admin admin] RBAC: Authorizing `identity:delete_project(project_id=186b9e921a0341f5a3dffc1ca78fc838)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:36:11.954779 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f906bfb-a945-4ca9-8532-e5d6cf6f7977 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:36:12.000755 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-2f906bfb-a945-4ca9-8532-e5d6cf6f7977 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '186b9e921a0341f5a3dffc1ca78fc838', 'request_id': 'req-2f906bfb-a945-4ca9-8532-e5d6cf6f7977'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:36:12.006630 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-2f906bfb-a945-4ca9-8532-e5d6cf6f7977 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '186b9e921a0341f5a3dffc1ca78fc838', 'request_id': 'req-2f906bfb-a945-4ca9-8532-e5d6cf6f7977'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:36:12.016077 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-2f906bfb-a945-4ca9-8532-e5d6cf6f7977 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '186b9e921a0341f5a3dffc1ca78fc838', 'request_id': 'req-2f906bfb-a945-4ca9-8532-e5d6cf6f7977'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:36:12.026218 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-2f906bfb-a945-4ca9-8532-e5d6cf6f7977 admin admin] The token cache is being invalidate because project 186b9e921a0341f5a3dffc1ca78fc838 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79880) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 05:36:12.026498 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-2f906bfb-a945-4ca9-8532-e5d6cf6f7977 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:36:12.027171 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-2f906bfb-a945-4ca9-8532-e5d6cf6f7977 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:36:12.028811 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 976/1985] 10.222.0.23 () {58 vars in 1232 bytes} [Tue May 10 05:36:11 2022] DELETE /identity/v3/projects/186b9e921a0341f5a3dffc1ca78fc838 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 05:36:12.033827 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83c7d0b-807c-4d73-8275-abd3981210b8 None None] REQUEST_METHOD: `POST` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:36:12.034286 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83c7d0b-807c-4d73-8275-abd3981210b8 None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:36:12.034372 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83c7d0b-807c-4d73-8275-abd3981210b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:36:12.052498 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.auth.core [None req-b83c7d0b-807c-4d73-8275-abd3981210b8 None None] MFA Rules not processed for user `44883b22532e44049d846938dc2cf423`. Rule list: `[]` (Enabled: `True`). {{(pid=79879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:36:12.053785 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-b83c7d0b-807c-4d73-8275-abd3981210b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:36:12.131317 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1010/1986] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 10 05:36:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 05:36:12.139291 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cda0d1-e172-4589-9758-57240b7ff5e1 None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:36:12.139595 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cda0d1-e172-4589-9758-57240b7ff5e1 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:36:12.139876 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cda0d1-e172-4589-9758-57240b7ff5e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:36:12.161826 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-18cda0d1-e172-4589-9758-57240b7ff5e1 None None] MFA Rules not processed for user `44883b22532e44049d846938dc2cf423`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:36:12.163111 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-18cda0d1-e172-4589-9758-57240b7ff5e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:36:12.172024 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 977/1987] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 10 05:36:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 05:36:12.176814 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83c7d0b-807c-4d73-8275-abd3981210b8 None None] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:36:12.186760 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83c7d0b-807c-4d73-8275-abd3981210b8 None None] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:36:12.191490 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bab80a-2fce-4403-a43c-1f1f5aec3c4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:36:12.192211 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bab80a-2fce-4403-a43c-1f1f5aec3c4e admin admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:36:12.192494 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bab80a-2fce-4403-a43c-1f1f5aec3c4e admin admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:36:12.192767 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bab80a-2fce-4403-a43c-1f1f5aec3c4e admin admin] PATH_INFO: `/v3/domains` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:36:12.193509 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87bab80a-2fce-4403-a43c-1f1f5aec3c4e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:36:12.193815 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87bab80a-2fce-4403-a43c-1f1f5aec3c4e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:36:12.195450 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87bab80a-2fce-4403-a43c-1f1f5aec3c4e admin admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:36:12.208534 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1011/1988] 10.222.0.23 () {58 vars in 1152 bytes} [Tue May 10 05:36:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:36:12.212762 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cda0d1-e172-4589-9758-57240b7ff5e1 None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:36:12.222577 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cda0d1-e172-4589-9758-57240b7ff5e1 None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:36:12.228013 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82ff757-adb0-41a2-b38f-5ab7d9c23a37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:36:12.228693 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82ff757-adb0-41a2-b38f-5ab7d9c23a37 admin admin] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:36:12.228976 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82ff757-adb0-41a2-b38f-5ab7d9c23a37 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:36:12.229248 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82ff757-adb0-41a2-b38f-5ab7d9c23a37 admin admin] PATH_INFO: `/v3/projects` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:36:12.229949 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82ff757-adb0-41a2-b38f-5ab7d9c23a37 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:36:12.231890 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82ff757-adb0-41a2-b38f-5ab7d9c23a37 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:36:12.260497 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 978/1989] 10.222.0.23 () {60 vars in 1152 bytes} [Tue May 10 05:36:12 2022] POST /identity/v3/projects => generated 383 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 05:36:12.265232 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bab80a-2fce-4403-a43c-1f1f5aec3c4e admin admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:36:12.287901 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bab80a-2fce-4403-a43c-1f1f5aec3c4e admin admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:36:12.369928 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d33444-31ea-4981-8267-0eb22d476af1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:36:12.370611 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d33444-31ea-4981-8267-0eb22d476af1 admin admin] REQUEST_METHOD: `POST` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:36:12.370889 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d33444-31ea-4981-8267-0eb22d476af1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:36:12.371162 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d33444-31ea-4981-8267-0eb22d476af1 admin admin] PATH_INFO: `/v3/users` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:36:12.371899 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d33444-31ea-4981-8267-0eb22d476af1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:36:12.374125 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d33444-31ea-4981-8267-0eb22d476af1 admin admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:36:12.399609 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1012/1990] 10.222.0.23 () {60 vars in 1143 bytes} [Tue May 10 05:36:12 2022] POST /identity/v3/users => generated 292 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 05:36:12.402693 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82ff757-adb0-41a2-b38f-5ab7d9c23a37 admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:36:12.413056 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82ff757-adb0-41a2-b38f-5ab7d9c23a37 admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:36:12.417883 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5260380f-844b-474a-ad14-3390ac45a648 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:36:12.418741 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5260380f-844b-474a-ad14-3390ac45a648 admin admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:36:12.419327 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5260380f-844b-474a-ad14-3390ac45a648 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:36:12.419934 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5260380f-844b-474a-ad14-3390ac45a648 admin admin] PATH_INFO: `/v3/roles` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:36:12.421415 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5260380f-844b-474a-ad14-3390ac45a648 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:36:12.423253 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5260380f-844b-474a-ad14-3390ac45a648 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:36:12.437106 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 979/1991] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 10 05:36:12 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 05:36:12.441732 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d33444-31ea-4981-8267-0eb22d476af1 admin admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:36:12.455008 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d33444-31ea-4981-8267-0eb22d476af1 admin admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:36:12.461332 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dda2ebe-add3-4c21-ae28-2306ba14cc7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:36:12.462026 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dda2ebe-add3-4c21-ae28-2306ba14cc7c admin admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:36:12.462314 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dda2ebe-add3-4c21-ae28-2306ba14cc7c admin admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:36:12.462592 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dda2ebe-add3-4c21-ae28-2306ba14cc7c admin admin] PATH_INFO: `/v3/roles` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:36:12.463343 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dda2ebe-add3-4c21-ae28-2306ba14cc7c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:36:12.465126 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dda2ebe-add3-4c21-ae28-2306ba14cc7c admin admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:36:12.481924 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1013/1992] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 10 05:36:12 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 05:36:12.486280 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5260380f-844b-474a-ad14-3390ac45a648 admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:36:12.496921 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5260380f-844b-474a-ad14-3390ac45a648 admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:36:12.501898 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdc4d1c-3a1e-4fe7-b2ea-cca56ed3da36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:36:12.502788 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdc4d1c-3a1e-4fe7-b2ea-cca56ed3da36 admin admin] REQUEST_METHOD: `PUT` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:36:12.503062 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdc4d1c-3a1e-4fe7-b2ea-cca56ed3da36 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:36:12.503327 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdc4d1c-3a1e-4fe7-b2ea-cca56ed3da36 admin admin] PATH_INFO: `/v3/projects/7acc301c90b848e69cdcb6c34b9d640d/users/132b4ab645ca4af48f9665589f2a58f7/roles/382636e67fc142a2b2f486340d959e11` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:36:12.517865 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecdc4d1c-3a1e-4fe7-b2ea-cca56ed3da36 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7acc301c90b848e69cdcb6c34b9d640d, user_id=132b4ab645ca4af48f9665589f2a58f7, role_id=382636e67fc142a2b2f486340d959e11)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:36:12.520840 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecdc4d1c-3a1e-4fe7-b2ea-cca56ed3da36 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:36:12.537595 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 980/1993] 10.222.0.23 () {60 vars in 1482 bytes} [Tue May 10 05:36:12 2022] PUT /identity/v3/projects/7acc301c90b848e69cdcb6c34b9d640d/users/132b4ab645ca4af48f9665589f2a58f7/roles/382636e67fc142a2b2f486340d959e11 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 05:36:12.549747 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c6a3ba-ec71-43c6-aee1-780063a5bb74 None None] REQUEST_METHOD: `POST` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:36:12.550131 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c6a3ba-ec71-43c6-aee1-780063a5bb74 None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:36:12.550533 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c6a3ba-ec71-43c6-aee1-780063a5bb74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:36:12.589118 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.auth.core [None req-b8c6a3ba-ec71-43c6-aee1-780063a5bb74 None None] MFA Rules not processed for user `132b4ab645ca4af48f9665589f2a58f7`. Rule list: `[]` (Enabled: `True`). {{(pid=79879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:36:12.590331 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-b8c6a3ba-ec71-43c6-aee1-780063a5bb74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:36:12.661225 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1014/1994] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 10 05:36:12 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 05:36:12.665855 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdc4d1c-3a1e-4fe7-b2ea-cca56ed3da36 admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:36:12.741314 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdc4d1c-3a1e-4fe7-b2ea-cca56ed3da36 admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:36:12.746102 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d59ab7-326f-4da9-8bbe-c8eacfdd51db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:36:12.746765 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d59ab7-326f-4da9-8bbe-c8eacfdd51db admin admin] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:36:12.747346 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d59ab7-326f-4da9-8bbe-c8eacfdd51db admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:36:12.747346 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d59ab7-326f-4da9-8bbe-c8eacfdd51db admin admin] PATH_INFO: `/v3/projects` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:36:12.748444 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d59ab7-326f-4da9-8bbe-c8eacfdd51db admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:36:12.750394 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d59ab7-326f-4da9-8bbe-c8eacfdd51db admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:36:12.776920 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 981/1995] 10.222.0.23 () {60 vars in 1152 bytes} [Tue May 10 05:36:12 2022] POST /identity/v3/projects => generated 383 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 05:36:12.780797 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c6a3ba-ec71-43c6-aee1-780063a5bb74 None None] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:36:12.792736 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c6a3ba-ec71-43c6-aee1-780063a5bb74 None None] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:36:12.864954 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2ea9bb-7393-44de-bf72-e9ff7eec72ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:36:12.865667 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2ea9bb-7393-44de-bf72-e9ff7eec72ed admin admin] REQUEST_METHOD: `POST` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:36:12.865880 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2ea9bb-7393-44de-bf72-e9ff7eec72ed admin admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:36:12.866163 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2ea9bb-7393-44de-bf72-e9ff7eec72ed admin admin] PATH_INFO: `/v3/users` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:36:12.866931 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2ea9bb-7393-44de-bf72-e9ff7eec72ed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:36:12.868977 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2ea9bb-7393-44de-bf72-e9ff7eec72ed admin admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:36:12.891632 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1015/1996] 10.222.0.23 () {60 vars in 1143 bytes} [Tue May 10 05:36:12 2022] POST /identity/v3/users => generated 298 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 05:36:12.894573 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d59ab7-326f-4da9-8bbe-c8eacfdd51db admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:36:12.904895 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d59ab7-326f-4da9-8bbe-c8eacfdd51db admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:36:12.909867 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6509f4a5-21ca-46f2-8c6c-6ddac4ccbdc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:36:12.910543 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6509f4a5-21ca-46f2-8c6c-6ddac4ccbdc3 admin admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:36:12.910873 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6509f4a5-21ca-46f2-8c6c-6ddac4ccbdc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:36:12.911174 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6509f4a5-21ca-46f2-8c6c-6ddac4ccbdc3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:36:12.911943 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6509f4a5-21ca-46f2-8c6c-6ddac4ccbdc3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:36:12.913566 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6509f4a5-21ca-46f2-8c6c-6ddac4ccbdc3 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:36:12.927612 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 982/1997] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 10 05:36:12 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 05:36:12.929508 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2ea9bb-7393-44de-bf72-e9ff7eec72ed admin admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:36:12.939842 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2ea9bb-7393-44de-bf72-e9ff7eec72ed admin admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:36:12.944586 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befc62fe-0ba0-4b81-aa05-2c7b8e74e173 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:36:12.945538 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befc62fe-0ba0-4b81-aa05-2c7b8e74e173 admin admin] REQUEST_METHOD: `PUT` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:36:12.945820 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befc62fe-0ba0-4b81-aa05-2c7b8e74e173 admin admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:36:12.946583 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befc62fe-0ba0-4b81-aa05-2c7b8e74e173 admin admin] PATH_INFO: `/v3/projects/09fe6e84ef6f48cf9f8bb30b7b66dcc2/users/22050b75444449f2a2f70b1972a7d9f7/roles/199ac1dd842441d7913c6ee89d8fbecc` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:36:12.970066 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befc62fe-0ba0-4b81-aa05-2c7b8e74e173 admin admin] RBAC: Authorizing `identity:create_grant(project_id=09fe6e84ef6f48cf9f8bb30b7b66dcc2, user_id=22050b75444449f2a2f70b1972a7d9f7, role_id=199ac1dd842441d7913c6ee89d8fbecc)` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:36:12.977437 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befc62fe-0ba0-4b81-aa05-2c7b8e74e173 admin admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:36:12.995265 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1016/1998] 10.222.0.23 () {60 vars in 1482 bytes} [Tue May 10 05:36:12 2022] PUT /identity/v3/projects/09fe6e84ef6f48cf9f8bb30b7b66dcc2/users/22050b75444449f2a2f70b1972a7d9f7/roles/199ac1dd842441d7913c6ee89d8fbecc => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 05:36:13.006508 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6509f4a5-21ca-46f2-8c6c-6ddac4ccbdc3 admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:36:13.013824 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6509f4a5-21ca-46f2-8c6c-6ddac4ccbdc3 admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:36:13.071287 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe2aa75-7fe6-49eb-8a6f-b98771a2ba4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:36:13.072069 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe2aa75-7fe6-49eb-8a6f-b98771a2ba4e admin admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:36:13.072345 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe2aa75-7fe6-49eb-8a6f-b98771a2ba4e admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:36:13.072616 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe2aa75-7fe6-49eb-8a6f-b98771a2ba4e admin admin] PATH_INFO: `/v3/roles` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:36:13.073364 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe2aa75-7fe6-49eb-8a6f-b98771a2ba4e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:36:13.074936 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe2aa75-7fe6-49eb-8a6f-b98771a2ba4e admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:36:13.084793 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 983/1999] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 10 05:36:12 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 05:36:13.088763 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befc62fe-0ba0-4b81-aa05-2c7b8e74e173 admin admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:36:13.099073 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befc62fe-0ba0-4b81-aa05-2c7b8e74e173 admin admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:36:13.103918 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638668f6-4924-45a3-b757-3448ee87f06a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:36:13.104884 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638668f6-4924-45a3-b757-3448ee87f06a admin admin] REQUEST_METHOD: `PUT` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:36:13.105225 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638668f6-4924-45a3-b757-3448ee87f06a admin admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:36:13.105560 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638668f6-4924-45a3-b757-3448ee87f06a admin admin] PATH_INFO: `/v3/projects/09fe6e84ef6f48cf9f8bb30b7b66dcc2/users/22050b75444449f2a2f70b1972a7d9f7/roles/199ac1dd842441d7913c6ee89d8fbecc` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:36:13.107608 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638668f6-4924-45a3-b757-3448ee87f06a admin admin] RBAC: Authorizing `identity:create_grant(project_id=09fe6e84ef6f48cf9f8bb30b7b66dcc2, user_id=22050b75444449f2a2f70b1972a7d9f7, role_id=199ac1dd842441d7913c6ee89d8fbecc)` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:36:13.110888 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638668f6-4924-45a3-b757-3448ee87f06a admin admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:36:13.121919 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1017/2000] 10.222.0.23 () {60 vars in 1482 bytes} [Tue May 10 05:36:13 2022] PUT /identity/v3/projects/09fe6e84ef6f48cf9f8bb30b7b66dcc2/users/22050b75444449f2a2f70b1972a7d9f7/roles/199ac1dd842441d7913c6ee89d8fbecc => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 05:36:13.132869 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd44395-9a75-441e-a5b5-284d6c1c81c4 None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:36:13.133152 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd44395-9a75-441e-a5b5-284d6c1c81c4 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:36:13.133428 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd44395-9a75-441e-a5b5-284d6c1c81c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:36:13.160127 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-ebd44395-9a75-441e-a5b5-284d6c1c81c4 None None] MFA Rules not processed for user `22050b75444449f2a2f70b1972a7d9f7`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:36:13.161401 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-ebd44395-9a75-441e-a5b5-284d6c1c81c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:36:13.231834 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 984/2001] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 10 05:36:13 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 05:36:13.242393 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638668f6-4924-45a3-b757-3448ee87f06a admin admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:36:13.244282 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-638668f6-4924-45a3-b757-3448ee87f06a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:36:13.305473 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638668f6-4924-45a3-b757-3448ee87f06a admin admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:36:13.305676 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3aaa4d-4f8f-43b5-9f95-dc2afda9b869 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355be413675540a39ccb00e1a0722316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f23435f783540199d6dcfd0417c090e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:36:13.306374 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3aaa4d-4f8f-43b5-9f95-dc2afda9b869 service cinder] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:36:13.306596 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3aaa4d-4f8f-43b5-9f95-dc2afda9b869 service cinder] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:36:13.306866 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3aaa4d-4f8f-43b5-9f95-dc2afda9b869 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:36:13.365003 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3aaa4d-4f8f-43b5-9f95-dc2afda9b869 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:36:13.366478 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3aaa4d-4f8f-43b5-9f95-dc2afda9b869 service cinder] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:36:13.376047 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1018/2002] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 10 05:36:13 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 05:36:17.480973 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd44395-9a75-441e-a5b5-284d6c1c81c4 None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:36:17.482661 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-ebd44395-9a75-441e-a5b5-284d6c1c81c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:36:17.546548 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd44395-9a75-441e-a5b5-284d6c1c81c4 None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:36:17.552589 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6016358e-35be-49ea-a31e-bbe598f770e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:36:17.553518 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6016358e-35be-49ea-a31e-bbe598f770e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:36:17.553733 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6016358e-35be-49ea-a31e-bbe598f770e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:36:17.564011 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6016358e-35be-49ea-a31e-bbe598f770e3 admin admin] PATH_INFO: `/v3/users/dc7d2ddacd1e495ebc53dfdcb43cc179` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:36:17.564011 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6016358e-35be-49ea-a31e-bbe598f770e3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dc7d2ddacd1e495ebc53dfdcb43cc179)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:36:17.564011 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6016358e-35be-49ea-a31e-bbe598f770e3 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:36:17.606067 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-6016358e-35be-49ea-a31e-bbe598f770e3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dc7d2ddacd1e495ebc53dfdcb43cc179'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:36:17.617347 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-6016358e-35be-49ea-a31e-bbe598f770e3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dc7d2ddacd1e495ebc53dfdcb43cc179'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:36:17.618024 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-6016358e-35be-49ea-a31e-bbe598f770e3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dc7d2ddacd1e495ebc53dfdcb43cc179'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:36:17.624813 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-6016358e-35be-49ea-a31e-bbe598f770e3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dc7d2ddacd1e495ebc53dfdcb43cc179'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:36:17.625533 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-6016358e-35be-49ea-a31e-bbe598f770e3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dc7d2ddacd1e495ebc53dfdcb43cc179'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:36:17.639813 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 985/2003] 10.222.0.23 () {58 vars in 1223 bytes} [Tue May 10 05:36:17 2022] DELETE /identity/v3/users/dc7d2ddacd1e495ebc53dfdcb43cc179 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 05:36:17.644626 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d043355-8eb0-4f58-a630-aa24ef4f77a2 None None] REQUEST_METHOD: `POST` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:36:17.645088 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d043355-8eb0-4f58-a630-aa24ef4f77a2 None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:36:17.645204 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d043355-8eb0-4f58-a630-aa24ef4f77a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:36:17.662310 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.auth.core [None req-0d043355-8eb0-4f58-a630-aa24ef4f77a2 None None] MFA Rules not processed for user `44883b22532e44049d846938dc2cf423`. Rule list: `[]` (Enabled: `True`). {{(pid=79879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:36:17.663501 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-0d043355-8eb0-4f58-a630-aa24ef4f77a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:36:17.721404 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1019/2004] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 10 05:36:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 05:36:17.730899 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6016358e-35be-49ea-a31e-bbe598f770e3 admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:36:17.732500 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-6016358e-35be-49ea-a31e-bbe598f770e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:36:17.788667 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6016358e-35be-49ea-a31e-bbe598f770e3 admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:36:17.792515 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2a195e-e457-4632-ad33-d488d5fd6a35 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c8461cfdd9648b8abcaf8d34b7a102a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f23435f783540199d6dcfd0417c090e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:36:17.793023 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2a195e-e457-4632-ad33-d488d5fd6a35 service neutron] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:36:17.793289 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2a195e-e457-4632-ad33-d488d5fd6a35 service neutron] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:36:17.793565 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2a195e-e457-4632-ad33-d488d5fd6a35 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:36:17.804531 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2a195e-e457-4632-ad33-d488d5fd6a35 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:36:17.807190 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2a195e-e457-4632-ad33-d488d5fd6a35 service neutron] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:36:17.816715 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 986/2005] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 10 05:36:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 05:36:18.075388 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d043355-8eb0-4f58-a630-aa24ef4f77a2 None None] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:36:18.076984 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-0d043355-8eb0-4f58-a630-aa24ef4f77a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:36:18.089265 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d043355-8eb0-4f58-a630-aa24ef4f77a2 None None] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:36:18.097971 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e468ec3b-3cb6-4425-a327-19c34322736e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:36:18.098881 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e468ec3b-3cb6-4425-a327-19c34322736e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:36:18.099156 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e468ec3b-3cb6-4425-a327-19c34322736e admin admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:36:18.099425 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e468ec3b-3cb6-4425-a327-19c34322736e admin admin] PATH_INFO: `/v3/users/fbed727f523144859c2f5afda3f0ce12` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:36:18.100660 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e468ec3b-3cb6-4425-a327-19c34322736e admin admin] RBAC: Authorizing `identity:delete_user(user_id=fbed727f523144859c2f5afda3f0ce12)` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:36:18.102639 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e468ec3b-3cb6-4425-a327-19c34322736e admin admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:36:18.116435 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2a195e-e457-4632-ad33-d488d5fd6a35 service neutron] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:36:18.117976 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-5b2a195e-e457-4632-ad33-d488d5fd6a35 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:36:18.135507 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2a195e-e457-4632-ad33-d488d5fd6a35 service neutron] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:36:18.141601 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f01ace-ddc3-4d13-8730-34b333cf9865 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:36:18.142469 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f01ace-ddc3-4d13-8730-34b333cf9865 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:36:18.142751 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f01ace-ddc3-4d13-8730-34b333cf9865 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:36:18.143023 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f01ace-ddc3-4d13-8730-34b333cf9865 admin admin] PATH_INFO: `/v3/projects/7144f72dbd3e43ea94bedc38abb35892` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:36:18.144286 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f01ace-ddc3-4d13-8730-34b333cf9865 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7144f72dbd3e43ea94bedc38abb35892)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:36:18.146229 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f01ace-ddc3-4d13-8730-34b333cf9865 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:36:18.152007 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-e468ec3b-3cb6-4425-a327-19c34322736e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fbed727f523144859c2f5afda3f0ce12'} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:36:18.161965 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-e468ec3b-3cb6-4425-a327-19c34322736e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fbed727f523144859c2f5afda3f0ce12'} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:36:18.162653 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-e468ec3b-3cb6-4425-a327-19c34322736e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fbed727f523144859c2f5afda3f0ce12'} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:36:18.186351 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-e468ec3b-3cb6-4425-a327-19c34322736e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fbed727f523144859c2f5afda3f0ce12'} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:36:18.198201 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-e468ec3b-3cb6-4425-a327-19c34322736e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fbed727f523144859c2f5afda3f0ce12'} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:36:18.213647 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1020/2006] 10.222.0.23 () {58 vars in 1223 bytes} [Tue May 10 05:36:18 2022] DELETE /identity/v3/users/fbed727f523144859c2f5afda3f0ce12 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 05:36:18.218123 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef8348e-cc9e-47cb-a511-7c2dc27e8439 None None] REQUEST_METHOD: `POST` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:36:18.218407 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef8348e-cc9e-47cb-a511-7c2dc27e8439 None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:36:18.218669 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef8348e-cc9e-47cb-a511-7c2dc27e8439 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:36:18.228452 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-d0f01ace-ddc3-4d13-8730-34b333cf9865 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7144f72dbd3e43ea94bedc38abb35892', 'request_id': 'req-d0f01ace-ddc3-4d13-8730-34b333cf9865'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:36:18.235734 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-d0f01ace-ddc3-4d13-8730-34b333cf9865 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7144f72dbd3e43ea94bedc38abb35892', 'request_id': 'req-d0f01ace-ddc3-4d13-8730-34b333cf9865'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:36:18.236509 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.auth.core [None req-7ef8348e-cc9e-47cb-a511-7c2dc27e8439 None None] MFA Rules not processed for user `44883b22532e44049d846938dc2cf423`. Rule list: `[]` (Enabled: `True`). {{(pid=79879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:36:18.237707 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-7ef8348e-cc9e-47cb-a511-7c2dc27e8439 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:36:18.244035 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-d0f01ace-ddc3-4d13-8730-34b333cf9865 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7144f72dbd3e43ea94bedc38abb35892', 'request_id': 'req-d0f01ace-ddc3-4d13-8730-34b333cf9865'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:36:18.256993 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-d0f01ace-ddc3-4d13-8730-34b333cf9865 admin admin] The token cache is being invalidate because project 7144f72dbd3e43ea94bedc38abb35892 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79880) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 05:36:18.257292 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-d0f01ace-ddc3-4d13-8730-34b333cf9865 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:36:18.257962 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-d0f01ace-ddc3-4d13-8730-34b333cf9865 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:36:18.260485 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 987/2007] 10.222.0.23 () {58 vars in 1232 bytes} [Tue May 10 05:36:18 2022] DELETE /identity/v3/projects/7144f72dbd3e43ea94bedc38abb35892 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 05:36:18.265236 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f01ace-ddc3-4d13-8730-34b333cf9865 admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:36:18.267409 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-d0f01ace-ddc3-4d13-8730-34b333cf9865 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:36:18.356191 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f01ace-ddc3-4d13-8730-34b333cf9865 admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:36:18.449359 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe15cf2-9c6d-4af0-adb5-d7b35d9d81d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:36:18.450247 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe15cf2-9c6d-4af0-adb5-d7b35d9d81d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:36:18.450526 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe15cf2-9c6d-4af0-adb5-d7b35d9d81d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:36:18.450794 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe15cf2-9c6d-4af0-adb5-d7b35d9d81d6 admin admin] PATH_INFO: `/v3/users/3e3a46bf66904b47b502d955926ce2ab` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:36:18.454625 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1021/2008] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 10 05:36:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 05:36:18.461338 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe15cf2-9c6d-4af0-adb5-d7b35d9d81d6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3e3a46bf66904b47b502d955926ce2ab)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:36:18.466624 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe15cf2-9c6d-4af0-adb5-d7b35d9d81d6 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:36:18.480727 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef8348e-cc9e-47cb-a511-7c2dc27e8439 None None] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:36:18.482332 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-7ef8348e-cc9e-47cb-a511-7c2dc27e8439 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:36:18.558948 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-6fe15cf2-9c6d-4af0-adb5-d7b35d9d81d6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3e3a46bf66904b47b502d955926ce2ab'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:36:18.584038 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef8348e-cc9e-47cb-a511-7c2dc27e8439 None None] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:36:18.590776 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-6fe15cf2-9c6d-4af0-adb5-d7b35d9d81d6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3e3a46bf66904b47b502d955926ce2ab'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:36:18.590959 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e997ca2e-a9f5-4fd4-a877-42968b123fdb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c8461cfdd9648b8abcaf8d34b7a102a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f23435f783540199d6dcfd0417c090e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:36:18.591614 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e997ca2e-a9f5-4fd4-a877-42968b123fdb service neutron] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:36:18.591899 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e997ca2e-a9f5-4fd4-a877-42968b123fdb service neutron] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:36:18.592176 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e997ca2e-a9f5-4fd4-a877-42968b123fdb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:36:18.592996 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-6fe15cf2-9c6d-4af0-adb5-d7b35d9d81d6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3e3a46bf66904b47b502d955926ce2ab'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:36:18.594567 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-e997ca2e-a9f5-4fd4-a877-42968b123fdb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:36:18.602644 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-6fe15cf2-9c6d-4af0-adb5-d7b35d9d81d6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3e3a46bf66904b47b502d955926ce2ab'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:36:18.603538 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-6fe15cf2-9c6d-4af0-adb5-d7b35d9d81d6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3e3a46bf66904b47b502d955926ce2ab'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:36:18.608133 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e997ca2e-a9f5-4fd4-a877-42968b123fdb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:36:18.609536 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e997ca2e-a9f5-4fd4-a877-42968b123fdb service neutron] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:36:18.623792 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 988/2009] 10.222.0.23 () {58 vars in 1223 bytes} [Tue May 10 05:36:18 2022] DELETE /identity/v3/users/3e3a46bf66904b47b502d955926ce2ab => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 05:36:18.629749 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1022/2010] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 10 05:36:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 05:36:19.333713 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe15cf2-9c6d-4af0-adb5-d7b35d9d81d6 admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:36:19.335655 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-6fe15cf2-9c6d-4af0-adb5-d7b35d9d81d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:36:19.374369 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e997ca2e-a9f5-4fd4-a877-42968b123fdb service neutron] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:36:19.375945 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-e997ca2e-a9f5-4fd4-a877-42968b123fdb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:36:19.390690 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e997ca2e-a9f5-4fd4-a877-42968b123fdb service neutron] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:36:19.414457 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe15cf2-9c6d-4af0-adb5-d7b35d9d81d6 admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:36:19.418984 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2ebfec-2664-4997-99bc-b5f90b41d728 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:36:19.419892 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2ebfec-2664-4997-99bc-b5f90b41d728 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:36:19.420173 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2ebfec-2664-4997-99bc-b5f90b41d728 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:36:19.420443 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2ebfec-2664-4997-99bc-b5f90b41d728 admin admin] PATH_INFO: `/v3/projects/4a0157c057674108ae80b15adae64762` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:36:19.421607 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2ebfec-2664-4997-99bc-b5f90b41d728 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4a0157c057674108ae80b15adae64762)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:36:19.423600 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2ebfec-2664-4997-99bc-b5f90b41d728 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:36:19.450983 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832a7219-7d0a-4d15-a266-f78ab9f75e5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:36:19.451961 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832a7219-7d0a-4d15-a266-f78ab9f75e5f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:36:19.452240 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832a7219-7d0a-4d15-a266-f78ab9f75e5f admin admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:36:19.452508 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832a7219-7d0a-4d15-a266-f78ab9f75e5f admin admin] PATH_INFO: `/v3/projects/3abaef2566c045e2b62345ece6cb184c` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:36:19.454315 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832a7219-7d0a-4d15-a266-f78ab9f75e5f admin admin] RBAC: Authorizing `identity:delete_project(project_id=3abaef2566c045e2b62345ece6cb184c)` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:36:19.456415 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832a7219-7d0a-4d15-a266-f78ab9f75e5f admin admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:36:19.472911 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-9f2ebfec-2664-4997-99bc-b5f90b41d728 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4a0157c057674108ae80b15adae64762', 'request_id': 'req-9f2ebfec-2664-4997-99bc-b5f90b41d728'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:36:19.479960 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-9f2ebfec-2664-4997-99bc-b5f90b41d728 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4a0157c057674108ae80b15adae64762', 'request_id': 'req-9f2ebfec-2664-4997-99bc-b5f90b41d728'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:36:19.489069 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-9f2ebfec-2664-4997-99bc-b5f90b41d728 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4a0157c057674108ae80b15adae64762', 'request_id': 'req-9f2ebfec-2664-4997-99bc-b5f90b41d728'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:36:19.500274 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-9f2ebfec-2664-4997-99bc-b5f90b41d728 admin admin] The token cache is being invalidate because project 4a0157c057674108ae80b15adae64762 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79880) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 05:36:19.500787 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-9f2ebfec-2664-4997-99bc-b5f90b41d728 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:36:19.501428 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-9f2ebfec-2664-4997-99bc-b5f90b41d728 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:36:19.503789 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 989/2011] 10.222.0.23 () {58 vars in 1232 bytes} [Tue May 10 05:36:19 2022] DELETE /identity/v3/projects/4a0157c057674108ae80b15adae64762 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 05:36:19.504773 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2ebfec-2664-4997-99bc-b5f90b41d728 admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:36:19.506279 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-9f2ebfec-2664-4997-99bc-b5f90b41d728 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:36:19.507380 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-832a7219-7d0a-4d15-a266-f78ab9f75e5f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3abaef2566c045e2b62345ece6cb184c', 'request_id': 'req-832a7219-7d0a-4d15-a266-f78ab9f75e5f'} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:36:19.514015 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-832a7219-7d0a-4d15-a266-f78ab9f75e5f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3abaef2566c045e2b62345ece6cb184c', 'request_id': 'req-832a7219-7d0a-4d15-a266-f78ab9f75e5f'} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:36:19.520704 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-832a7219-7d0a-4d15-a266-f78ab9f75e5f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3abaef2566c045e2b62345ece6cb184c', 'request_id': 'req-832a7219-7d0a-4d15-a266-f78ab9f75e5f'} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:36:19.530623 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-832a7219-7d0a-4d15-a266-f78ab9f75e5f admin admin] The token cache is being invalidate because project 3abaef2566c045e2b62345ece6cb184c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79879) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 05:36:19.530907 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-832a7219-7d0a-4d15-a266-f78ab9f75e5f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:36:19.531596 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-832a7219-7d0a-4d15-a266-f78ab9f75e5f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:36:19.533344 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1023/2012] 10.222.0.23 () {58 vars in 1232 bytes} [Tue May 10 05:36:19 2022] DELETE /identity/v3/projects/3abaef2566c045e2b62345ece6cb184c => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 05:36:19.533888 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832a7219-7d0a-4d15-a266-f78ab9f75e5f admin admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:36:19.535122 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-832a7219-7d0a-4d15-a266-f78ab9f75e5f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:36:19.574101 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2ebfec-2664-4997-99bc-b5f90b41d728 admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:36:19.595401 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832a7219-7d0a-4d15-a266-f78ab9f75e5f admin admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:36:19.600219 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8ab40e-84dc-4cf2-a832-ce690e74e71d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:36:19.601444 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8ab40e-84dc-4cf2-a832-ce690e74e71d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:36:19.601799 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8ab40e-84dc-4cf2-a832-ce690e74e71d admin admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:36:19.602323 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8ab40e-84dc-4cf2-a832-ce690e74e71d admin admin] PATH_INFO: `/v3/users/24746368eb20432a85414716119ad855` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:36:19.609319 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8ab40e-84dc-4cf2-a832-ce690e74e71d admin admin] RBAC: Authorizing `identity:delete_user(user_id=24746368eb20432a85414716119ad855)` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:36:19.611747 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8ab40e-84dc-4cf2-a832-ce690e74e71d admin admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:36:19.633922 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecf0115-4d30-4af8-9fe3-725e7730e1fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:36:19.634974 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecf0115-4d30-4af8-9fe3-725e7730e1fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:36:19.635265 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecf0115-4d30-4af8-9fe3-725e7730e1fb admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:36:19.635546 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecf0115-4d30-4af8-9fe3-725e7730e1fb admin admin] PATH_INFO: `/v3/users/58efe83fe54047baa2cc61e3886e241c` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:36:19.636918 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aecf0115-4d30-4af8-9fe3-725e7730e1fb admin admin] RBAC: Authorizing `identity:delete_user(user_id=58efe83fe54047baa2cc61e3886e241c)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:36:19.640463 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aecf0115-4d30-4af8-9fe3-725e7730e1fb admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:36:19.662607 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-dc8ab40e-84dc-4cf2-a832-ce690e74e71d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '24746368eb20432a85414716119ad855'} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:36:19.669766 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-dc8ab40e-84dc-4cf2-a832-ce690e74e71d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '24746368eb20432a85414716119ad855'} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:36:19.670921 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-dc8ab40e-84dc-4cf2-a832-ce690e74e71d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '24746368eb20432a85414716119ad855'} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:36:19.683736 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-dc8ab40e-84dc-4cf2-a832-ce690e74e71d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '24746368eb20432a85414716119ad855'} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:36:19.687152 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-aecf0115-4d30-4af8-9fe3-725e7730e1fb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '58efe83fe54047baa2cc61e3886e241c'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:36:19.690500 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-dc8ab40e-84dc-4cf2-a832-ce690e74e71d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '24746368eb20432a85414716119ad855'} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:36:19.696611 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1024/2013] 10.222.0.23 () {58 vars in 1223 bytes} [Tue May 10 05:36:19 2022] DELETE /identity/v3/users/24746368eb20432a85414716119ad855 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 05:36:19.698120 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cf4875-28df-463a-b8ba-fa1dbe07be1f None None] REQUEST_METHOD: `POST` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:36:19.698419 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-aecf0115-4d30-4af8-9fe3-725e7730e1fb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '58efe83fe54047baa2cc61e3886e241c'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:36:19.698521 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cf4875-28df-463a-b8ba-fa1dbe07be1f None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:36:19.698824 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cf4875-28df-463a-b8ba-fa1dbe07be1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:36:19.699928 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-aecf0115-4d30-4af8-9fe3-725e7730e1fb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '58efe83fe54047baa2cc61e3886e241c'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:36:19.707085 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-aecf0115-4d30-4af8-9fe3-725e7730e1fb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '58efe83fe54047baa2cc61e3886e241c'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:36:19.707851 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-aecf0115-4d30-4af8-9fe3-725e7730e1fb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '58efe83fe54047baa2cc61e3886e241c'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:36:19.717126 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.auth.core [None req-87cf4875-28df-463a-b8ba-fa1dbe07be1f None None] MFA Rules not processed for user `44883b22532e44049d846938dc2cf423`. Rule list: `[]` (Enabled: `True`). {{(pid=79879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:36:19.718356 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-87cf4875-28df-463a-b8ba-fa1dbe07be1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:36:19.722506 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 990/2014] 10.222.0.23 () {58 vars in 1223 bytes} [Tue May 10 05:36:19 2022] DELETE /identity/v3/users/58efe83fe54047baa2cc61e3886e241c => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 05:36:19.727350 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6e1e51-ae0b-41dd-9e7c-1eaa8ad5e048 None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:36:19.727858 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6e1e51-ae0b-41dd-9e7c-1eaa8ad5e048 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:36:19.728648 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6e1e51-ae0b-41dd-9e7c-1eaa8ad5e048 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:36:19.752412 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-5f6e1e51-ae0b-41dd-9e7c-1eaa8ad5e048 None None] MFA Rules not processed for user `44883b22532e44049d846938dc2cf423`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:36:19.754701 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-5f6e1e51-ae0b-41dd-9e7c-1eaa8ad5e048 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:36:19.783492 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1025/2015] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 10 05:36:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 05:36:19.790824 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b8671b-c371-4d12-9eef-f740142ea2d9 None None] REQUEST_METHOD: `POST` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:36:19.791208 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b8671b-c371-4d12-9eef-f740142ea2d9 None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:36:19.791607 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b8671b-c371-4d12-9eef-f740142ea2d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:36:19.813426 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.auth.core [None req-c2b8671b-c371-4d12-9eef-f740142ea2d9 None None] MFA Rules not processed for user `44883b22532e44049d846938dc2cf423`. Rule list: `[]` (Enabled: `True`). {{(pid=79879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:36:19.814911 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-c2b8671b-c371-4d12-9eef-f740142ea2d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:36:19.830734 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 991/2016] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 10 05:36:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 05:36:19.838737 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6e1e51-ae0b-41dd-9e7c-1eaa8ad5e048 None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:36:19.843998 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-5f6e1e51-ae0b-41dd-9e7c-1eaa8ad5e048 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:36:19.912335 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1026/2017] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 10 05:36:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 05:36:19.917354 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b8671b-c371-4d12-9eef-f740142ea2d9 None None] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:36:19.923166 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6e1e51-ae0b-41dd-9e7c-1eaa8ad5e048 None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:36:19.931016 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b8671b-c371-4d12-9eef-f740142ea2d9 None None] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:36:19.935353 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad567cd-1473-4050-a220-781280bb7f79 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c8461cfdd9648b8abcaf8d34b7a102a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f23435f783540199d6dcfd0417c090e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:36:19.936063 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad567cd-1473-4050-a220-781280bb7f79 service neutron] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:36:19.936345 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad567cd-1473-4050-a220-781280bb7f79 service neutron] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:36:19.936645 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad567cd-1473-4050-a220-781280bb7f79 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:36:19.938651 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fba36e1-58db-4742-9cf4-f278647a1e81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:36:19.939472 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fba36e1-58db-4742-9cf4-f278647a1e81 admin admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:36:19.939928 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fba36e1-58db-4742-9cf4-f278647a1e81 admin admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:36:19.940347 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fba36e1-58db-4742-9cf4-f278647a1e81 admin admin] PATH_INFO: `/v3/domains` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:36:19.941213 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fba36e1-58db-4742-9cf4-f278647a1e81 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:36:19.941661 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fba36e1-58db-4742-9cf4-f278647a1e81 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:36:19.943916 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fba36e1-58db-4742-9cf4-f278647a1e81 admin admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:36:19.952692 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad567cd-1473-4050-a220-781280bb7f79 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:36:19.955388 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad567cd-1473-4050-a220-781280bb7f79 service neutron] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:36:19.958011 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1027/2018] 10.222.0.23 () {58 vars in 1152 bytes} [Tue May 10 05:36:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:36:19.962244 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fba36e1-58db-4742-9cf4-f278647a1e81 admin admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:36:19.973702 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 992/2019] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 10 05:36:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 05:36:19.982847 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fba36e1-58db-4742-9cf4-f278647a1e81 admin admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:36:19.988917 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7a1f9a-24d1-4685-86e2-8d18af86f781 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:36:19.989792 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7a1f9a-24d1-4685-86e2-8d18af86f781 admin admin] REQUEST_METHOD: `POST` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:36:19.990224 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7a1f9a-24d1-4685-86e2-8d18af86f781 admin admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:36:19.990634 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7a1f9a-24d1-4685-86e2-8d18af86f781 admin admin] PATH_INFO: `/v3/projects` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:36:19.991944 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7a1f9a-24d1-4685-86e2-8d18af86f781 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:36:19.993996 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7a1f9a-24d1-4685-86e2-8d18af86f781 admin admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:36:20.028432 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1028/2020] 10.222.0.23 () {60 vars in 1152 bytes} [Tue May 10 05:36:19 2022] POST /identity/v3/projects => generated 381 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 05:36:20.029458 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad567cd-1473-4050-a220-781280bb7f79 service neutron] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:36:20.030975 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-3ad567cd-1473-4050-a220-781280bb7f79 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:36:20.032126 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7a1f9a-24d1-4685-86e2-8d18af86f781 admin admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:36:20.107772 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7a1f9a-24d1-4685-86e2-8d18af86f781 admin admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:36:20.112845 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad567cd-1473-4050-a220-781280bb7f79 service neutron] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:36:20.114014 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e5d803-5183-423e-b642-6f9fc9d8fe35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:36:20.115761 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e5d803-5183-423e-b642-6f9fc9d8fe35 admin admin] REQUEST_METHOD: `POST` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:36:20.116044 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e5d803-5183-423e-b642-6f9fc9d8fe35 admin admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:36:20.116316 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e5d803-5183-423e-b642-6f9fc9d8fe35 admin admin] PATH_INFO: `/v3/users` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:36:20.117038 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e5d803-5183-423e-b642-6f9fc9d8fe35 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:36:20.119162 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e5d803-5183-423e-b642-6f9fc9d8fe35 admin admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:36:20.174772 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2666bf75-0a04-4594-bf8c-96397fc1c650 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355be413675540a39ccb00e1a0722316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f23435f783540199d6dcfd0417c090e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:36:20.175920 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2666bf75-0a04-4594-bf8c-96397fc1c650 service cinder] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:36:20.176200 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2666bf75-0a04-4594-bf8c-96397fc1c650 service cinder] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:36:20.176471 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2666bf75-0a04-4594-bf8c-96397fc1c650 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:36:20.178971 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1029/2021] 10.222.0.23 () {60 vars in 1143 bytes} [Tue May 10 05:36:20 2022] POST /identity/v3/users => generated 291 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 05:36:20.180039 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-2666bf75-0a04-4594-bf8c-96397fc1c650 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:36:20.183350 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e5d803-5183-423e-b642-6f9fc9d8fe35 admin admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:36:20.195377 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e5d803-5183-423e-b642-6f9fc9d8fe35 admin admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:36:20.225099 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9871ca-ed2c-4277-b123-75cddcc9de31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:36:20.226301 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9871ca-ed2c-4277-b123-75cddcc9de31 admin admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:36:20.226579 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9871ca-ed2c-4277-b123-75cddcc9de31 admin admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:36:20.226851 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9871ca-ed2c-4277-b123-75cddcc9de31 admin admin] PATH_INFO: `/v3/roles` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:36:20.228671 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9871ca-ed2c-4277-b123-75cddcc9de31 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:36:20.230711 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9871ca-ed2c-4277-b123-75cddcc9de31 admin admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:36:20.242643 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1030/2022] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 10 05:36:20 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 05:36:20.247244 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9871ca-ed2c-4277-b123-75cddcc9de31 admin admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:36:20.265046 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2666bf75-0a04-4594-bf8c-96397fc1c650 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:36:20.266751 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2666bf75-0a04-4594-bf8c-96397fc1c650 service cinder] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:36:20.268941 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9871ca-ed2c-4277-b123-75cddcc9de31 admin admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:36:20.273790 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b00a7de-34f8-4abf-aed6-dd5b6f0cb307 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:36:20.274566 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b00a7de-34f8-4abf-aed6-dd5b6f0cb307 admin admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:36:20.274916 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b00a7de-34f8-4abf-aed6-dd5b6f0cb307 admin admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:36:20.275259 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b00a7de-34f8-4abf-aed6-dd5b6f0cb307 admin admin] PATH_INFO: `/v3/roles` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:36:20.276182 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b00a7de-34f8-4abf-aed6-dd5b6f0cb307 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:36:20.277960 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 993/2023] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 10 05:36:20 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 249 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 05:36:20.278070 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b00a7de-34f8-4abf-aed6-dd5b6f0cb307 admin admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:36:20.295622 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1031/2024] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 10 05:36:20 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 05:36:20.297762 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2666bf75-0a04-4594-bf8c-96397fc1c650 service cinder] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:36:20.308232 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2666bf75-0a04-4594-bf8c-96397fc1c650 service cinder] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:36:20.313395 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb36ee53-f67f-4f1d-9284-9582fc844667 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:36:20.314329 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb36ee53-f67f-4f1d-9284-9582fc844667 admin admin] REQUEST_METHOD: `PUT` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:36:20.314606 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb36ee53-f67f-4f1d-9284-9582fc844667 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:36:20.314878 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb36ee53-f67f-4f1d-9284-9582fc844667 admin admin] PATH_INFO: `/v3/projects/ae5e16ebae5349fb9fa55180727f726b/users/0e47399614e3437ca04192dcefb550e9/roles/382636e67fc142a2b2f486340d959e11` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:36:20.333242 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb36ee53-f67f-4f1d-9284-9582fc844667 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae5e16ebae5349fb9fa55180727f726b, user_id=0e47399614e3437ca04192dcefb550e9, role_id=382636e67fc142a2b2f486340d959e11)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:36:20.336229 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb36ee53-f67f-4f1d-9284-9582fc844667 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:36:20.354409 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 994/2025] 10.222.0.23 () {60 vars in 1482 bytes} [Tue May 10 05:36:20 2022] PUT /identity/v3/projects/ae5e16ebae5349fb9fa55180727f726b/users/0e47399614e3437ca04192dcefb550e9/roles/382636e67fc142a2b2f486340d959e11 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 05:36:20.364855 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d389e6-f466-4503-bdea-f25c20674f3a None None] REQUEST_METHOD: `POST` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:36:20.365140 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d389e6-f466-4503-bdea-f25c20674f3a None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:36:20.365415 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d389e6-f466-4503-bdea-f25c20674f3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:36:20.394623 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.auth.core [None req-d7d389e6-f466-4503-bdea-f25c20674f3a None None] MFA Rules not processed for user `0e47399614e3437ca04192dcefb550e9`. Rule list: `[]` (Enabled: `True`). {{(pid=79879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:36:20.395904 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-d7d389e6-f466-4503-bdea-f25c20674f3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:36:20.505588 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb36ee53-f67f-4f1d-9284-9582fc844667 admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:36:20.508607 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-eb36ee53-f67f-4f1d-9284-9582fc844667 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:36:20.546320 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1032/2026] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 10 05:36:20 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 05:36:20.547452 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d389e6-f466-4503-bdea-f25c20674f3a None None] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:36:20.666055 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb36ee53-f67f-4f1d-9284-9582fc844667 admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:36:20.677721 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4329a3c3-2e67-4c26-abd9-2d1fd059210f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:36:20.678618 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4329a3c3-2e67-4c26-abd9-2d1fd059210f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:36:20.678895 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4329a3c3-2e67-4c26-abd9-2d1fd059210f admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:36:20.681690 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4329a3c3-2e67-4c26-abd9-2d1fd059210f admin admin] PATH_INFO: `/v3/projects/760f055515564b91a38a61129ef28310` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:36:20.683772 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4329a3c3-2e67-4c26-abd9-2d1fd059210f admin admin] RBAC: Authorizing `identity:delete_project(project_id=760f055515564b91a38a61129ef28310)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:36:20.686711 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4329a3c3-2e67-4c26-abd9-2d1fd059210f admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:36:20.687287 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d389e6-f466-4503-bdea-f25c20674f3a None None] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:36:20.692696 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e51405-d540-4ff7-884e-03d6ef9e900f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:36:20.693378 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e51405-d540-4ff7-884e-03d6ef9e900f admin admin] REQUEST_METHOD: `POST` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:36:20.694024 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e51405-d540-4ff7-884e-03d6ef9e900f admin admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:36:20.694024 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e51405-d540-4ff7-884e-03d6ef9e900f admin admin] PATH_INFO: `/v3/projects` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:36:20.695041 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e51405-d540-4ff7-884e-03d6ef9e900f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:36:20.697101 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e51405-d540-4ff7-884e-03d6ef9e900f admin admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:36:20.737131 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1033/2027] 10.222.0.23 () {60 vars in 1152 bytes} [Tue May 10 05:36:20 2022] POST /identity/v3/projects => generated 381 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 05:36:20.738426 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e51405-d540-4ff7-884e-03d6ef9e900f admin admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:36:20.811354 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-4329a3c3-2e67-4c26-abd9-2d1fd059210f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '760f055515564b91a38a61129ef28310', 'request_id': 'req-4329a3c3-2e67-4c26-abd9-2d1fd059210f'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:36:20.831268 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-4329a3c3-2e67-4c26-abd9-2d1fd059210f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '760f055515564b91a38a61129ef28310', 'request_id': 'req-4329a3c3-2e67-4c26-abd9-2d1fd059210f'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:36:20.840783 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-4329a3c3-2e67-4c26-abd9-2d1fd059210f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '760f055515564b91a38a61129ef28310', 'request_id': 'req-4329a3c3-2e67-4c26-abd9-2d1fd059210f'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:36:20.861650 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-4329a3c3-2e67-4c26-abd9-2d1fd059210f admin admin] The token cache is being invalidate because project 760f055515564b91a38a61129ef28310 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79880) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 05:36:20.861931 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-4329a3c3-2e67-4c26-abd9-2d1fd059210f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:36:20.862769 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-4329a3c3-2e67-4c26-abd9-2d1fd059210f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:36:20.872337 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 995/2028] 10.222.0.23 () {58 vars in 1232 bytes} [Tue May 10 05:36:20 2022] DELETE /identity/v3/projects/760f055515564b91a38a61129ef28310 => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 05:36:20.874204 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cd18d4-0e1d-4931-875a-cd6c8723350b None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:36:20.874520 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cd18d4-0e1d-4931-875a-cd6c8723350b None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:36:20.874747 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cd18d4-0e1d-4931-875a-cd6c8723350b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:36:20.892882 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e51405-d540-4ff7-884e-03d6ef9e900f admin admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:36:20.903423 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-33cd18d4-0e1d-4931-875a-cd6c8723350b None None] MFA Rules not processed for user `44883b22532e44049d846938dc2cf423`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:36:20.904750 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-33cd18d4-0e1d-4931-875a-cd6c8723350b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:36:20.956290 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444abd5b-61c6-4218-bf1b-966b6e26cbb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:36:20.956969 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444abd5b-61c6-4218-bf1b-966b6e26cbb5 admin admin] REQUEST_METHOD: `POST` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:36:20.957252 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444abd5b-61c6-4218-bf1b-966b6e26cbb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:36:20.957527 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444abd5b-61c6-4218-bf1b-966b6e26cbb5 admin admin] PATH_INFO: `/v3/users` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:36:20.958225 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444abd5b-61c6-4218-bf1b-966b6e26cbb5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:36:20.960217 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444abd5b-61c6-4218-bf1b-966b6e26cbb5 admin admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:36:20.989035 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1034/2029] 10.222.0.23 () {60 vars in 1143 bytes} [Tue May 10 05:36:20 2022] POST /identity/v3/users => generated 297 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 05:36:20.993886 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444abd5b-61c6-4218-bf1b-966b6e26cbb5 admin admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:36:20.999721 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-444abd5b-61c6-4218-bf1b-966b6e26cbb5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:36:21.021602 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444abd5b-61c6-4218-bf1b-966b6e26cbb5 admin admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:36:21.028048 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f748a520-8c4a-4e4e-b515-f3005a2754bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:36:21.028895 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f748a520-8c4a-4e4e-b515-f3005a2754bd admin admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:36:21.029243 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f748a520-8c4a-4e4e-b515-f3005a2754bd admin admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:36:21.029595 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f748a520-8c4a-4e4e-b515-f3005a2754bd admin admin] PATH_INFO: `/v3/roles` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:36:21.030533 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f748a520-8c4a-4e4e-b515-f3005a2754bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:36:21.032685 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f748a520-8c4a-4e4e-b515-f3005a2754bd admin admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:36:21.044290 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 996/2030] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 10 05:36:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 05:36:21.045458 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cd18d4-0e1d-4931-875a-cd6c8723350b None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:36:21.046866 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-33cd18d4-0e1d-4931-875a-cd6c8723350b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:36:21.059002 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1035/2031] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 10 05:36:20 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 05:36:21.061388 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223729ec-5b86-45d9-8554-9e1c20caf912 None None] REQUEST_METHOD: `POST` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:36:21.061766 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223729ec-5b86-45d9-8554-9e1c20caf912 None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:36:21.062192 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223729ec-5b86-45d9-8554-9e1c20caf912 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:36:21.066766 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cd18d4-0e1d-4931-875a-cd6c8723350b None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:36:21.075010 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e942c16-819d-43f4-8392-a367083423c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:36:21.076520 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e942c16-819d-43f4-8392-a367083423c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:36:21.076968 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e942c16-819d-43f4-8392-a367083423c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:36:21.077272 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e942c16-819d-43f4-8392-a367083423c5 admin admin] PATH_INFO: `/v3/projects/68484ac6fff0418da13a7f3791f96f17` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:36:21.078953 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e942c16-819d-43f4-8392-a367083423c5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=68484ac6fff0418da13a7f3791f96f17)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:36:21.082501 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e942c16-819d-43f4-8392-a367083423c5 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:36:21.083818 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.auth.core [None req-223729ec-5b86-45d9-8554-9e1c20caf912 None None] MFA Rules not processed for user `44883b22532e44049d846938dc2cf423`. Rule list: `[]` (Enabled: `True`). {{(pid=79879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:36:21.085325 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-223729ec-5b86-45d9-8554-9e1c20caf912 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:36:21.096464 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1036/2032] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 10 05:36:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 05:36:21.097628 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223729ec-5b86-45d9-8554-9e1c20caf912 None None] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:36:21.107693 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223729ec-5b86-45d9-8554-9e1c20caf912 None None] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:36:21.112663 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e95189-910b-44b0-bc09-650e68811e72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:36:21.113623 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e95189-910b-44b0-bc09-650e68811e72 admin admin] REQUEST_METHOD: `PUT` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:36:21.113974 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e95189-910b-44b0-bc09-650e68811e72 admin admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:36:21.114255 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e95189-910b-44b0-bc09-650e68811e72 admin admin] PATH_INFO: `/v3/projects/1583374ec3b7485ea8a682bf7fda3c33/users/51f5555a83f04c13834179e21c59c136/roles/199ac1dd842441d7913c6ee89d8fbecc` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:36:21.131119 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e95189-910b-44b0-bc09-650e68811e72 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1583374ec3b7485ea8a682bf7fda3c33, user_id=51f5555a83f04c13834179e21c59c136, role_id=199ac1dd842441d7913c6ee89d8fbecc)` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:36:21.133830 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e95189-910b-44b0-bc09-650e68811e72 admin admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:36:21.144281 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-4e942c16-819d-43f4-8392-a367083423c5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '68484ac6fff0418da13a7f3791f96f17', 'request_id': 'req-4e942c16-819d-43f4-8392-a367083423c5'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:36:21.148819 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1037/2033] 10.222.0.23 () {60 vars in 1482 bytes} [Tue May 10 05:36:21 2022] PUT /identity/v3/projects/1583374ec3b7485ea8a682bf7fda3c33/users/51f5555a83f04c13834179e21c59c136/roles/199ac1dd842441d7913c6ee89d8fbecc => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 05:36:21.150163 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e95189-910b-44b0-bc09-650e68811e72 admin admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:36:21.151667 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-4e942c16-819d-43f4-8392-a367083423c5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '68484ac6fff0418da13a7f3791f96f17', 'request_id': 'req-4e942c16-819d-43f4-8392-a367083423c5'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:36:21.159488 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-4e942c16-819d-43f4-8392-a367083423c5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '68484ac6fff0418da13a7f3791f96f17', 'request_id': 'req-4e942c16-819d-43f4-8392-a367083423c5'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:36:21.172004 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-4e942c16-819d-43f4-8392-a367083423c5 admin admin] The token cache is being invalidate because project 68484ac6fff0418da13a7f3791f96f17 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79880) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 05:36:21.172520 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-4e942c16-819d-43f4-8392-a367083423c5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:36:21.173413 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-4e942c16-819d-43f4-8392-a367083423c5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:36:21.175511 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 997/2034] 10.222.0.23 () {58 vars in 1232 bytes} [Tue May 10 05:36:21 2022] DELETE /identity/v3/projects/68484ac6fff0418da13a7f3791f96f17 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 05:36:21.176378 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e942c16-819d-43f4-8392-a367083423c5 admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:36:21.201608 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-4e942c16-819d-43f4-8392-a367083423c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:36:21.227103 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e95189-910b-44b0-bc09-650e68811e72 admin admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:36:21.232172 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369753b4-0fcd-4d49-8e5a-87a1fcbff5ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:36:21.233353 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369753b4-0fcd-4d49-8e5a-87a1fcbff5ec admin admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:36:21.233721 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369753b4-0fcd-4d49-8e5a-87a1fcbff5ec admin admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:36:21.234110 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369753b4-0fcd-4d49-8e5a-87a1fcbff5ec admin admin] PATH_INFO: `/v3/domains` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:36:21.235289 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369753b4-0fcd-4d49-8e5a-87a1fcbff5ec admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:36:21.235371 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369753b4-0fcd-4d49-8e5a-87a1fcbff5ec admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:36:21.237462 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369753b4-0fcd-4d49-8e5a-87a1fcbff5ec admin admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:36:21.256152 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1038/2035] 10.222.0.23 () {58 vars in 1152 bytes} [Tue May 10 05:36:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:36:21.257598 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369753b4-0fcd-4d49-8e5a-87a1fcbff5ec admin admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:36:21.259459 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-369753b4-0fcd-4d49-8e5a-87a1fcbff5ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:36:21.274006 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369753b4-0fcd-4d49-8e5a-87a1fcbff5ec admin admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:36:21.283762 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103d1c49-c800-4599-8830-7fc15e46c2ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:36:21.284745 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103d1c49-c800-4599-8830-7fc15e46c2ed admin admin] REQUEST_METHOD: `POST` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:36:21.285126 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103d1c49-c800-4599-8830-7fc15e46c2ed admin admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:36:21.285500 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103d1c49-c800-4599-8830-7fc15e46c2ed admin admin] PATH_INFO: `/v3/projects` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:36:21.286601 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103d1c49-c800-4599-8830-7fc15e46c2ed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:36:21.289035 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103d1c49-c800-4599-8830-7fc15e46c2ed admin admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:36:21.321448 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e942c16-819d-43f4-8392-a367083423c5 admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:36:21.323781 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1039/2036] 10.222.0.23 () {60 vars in 1152 bytes} [Tue May 10 05:36:21 2022] POST /identity/v3/projects => generated 383 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 05:36:21.327626 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103d1c49-c800-4599-8830-7fc15e46c2ed admin admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:36:21.387053 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa72b8f-90ff-47e9-a70e-727e42bf0db9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:36:21.387664 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa72b8f-90ff-47e9-a70e-727e42bf0db9 admin admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:36:21.387945 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa72b8f-90ff-47e9-a70e-727e42bf0db9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:36:21.388259 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa72b8f-90ff-47e9-a70e-727e42bf0db9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:36:21.388992 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa72b8f-90ff-47e9-a70e-727e42bf0db9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:36:21.390639 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa72b8f-90ff-47e9-a70e-727e42bf0db9 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:36:21.394784 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103d1c49-c800-4599-8830-7fc15e46c2ed admin admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:36:21.399853 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ab206f-b32c-4563-90ec-ac26c74cd26a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:36:21.400261 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 998/2037] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 10 05:36:21 2022] GET /identity/v3/roles => generated 1420 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 05:36:21.400526 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ab206f-b32c-4563-90ec-ac26c74cd26a admin admin] REQUEST_METHOD: `POST` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:36:21.400808 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ab206f-b32c-4563-90ec-ac26c74cd26a admin admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:36:21.401078 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ab206f-b32c-4563-90ec-ac26c74cd26a admin admin] PATH_INFO: `/v3/users` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:36:21.401775 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ab206f-b32c-4563-90ec-ac26c74cd26a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:36:21.404045 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ab206f-b32c-4563-90ec-ac26c74cd26a admin admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:36:21.404442 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa72b8f-90ff-47e9-a70e-727e42bf0db9 admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:36:21.413844 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa72b8f-90ff-47e9-a70e-727e42bf0db9 admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:36:21.419195 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3275f138-9236-4545-bae2-b4b052a3564b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:36:21.420222 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3275f138-9236-4545-bae2-b4b052a3564b admin admin] REQUEST_METHOD: `PUT` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:36:21.420621 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3275f138-9236-4545-bae2-b4b052a3564b admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:36:21.420902 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3275f138-9236-4545-bae2-b4b052a3564b admin admin] PATH_INFO: `/v3/projects/1583374ec3b7485ea8a682bf7fda3c33/users/51f5555a83f04c13834179e21c59c136/roles/199ac1dd842441d7913c6ee89d8fbecc` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:36:21.422956 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3275f138-9236-4545-bae2-b4b052a3564b admin admin] RBAC: Authorizing `identity:create_grant(project_id=1583374ec3b7485ea8a682bf7fda3c33, user_id=51f5555a83f04c13834179e21c59c136, role_id=199ac1dd842441d7913c6ee89d8fbecc)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:36:21.425656 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3275f138-9236-4545-bae2-b4b052a3564b admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:36:21.427184 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1040/2038] 10.222.0.23 () {60 vars in 1143 bytes} [Tue May 10 05:36:21 2022] POST /identity/v3/users => generated 292 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 05:36:21.431278 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ab206f-b32c-4563-90ec-ac26c74cd26a admin admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:36:21.441956 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ab206f-b32c-4563-90ec-ac26c74cd26a admin admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:36:21.447775 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 999/2039] 10.222.0.23 () {60 vars in 1482 bytes} [Tue May 10 05:36:21 2022] PUT /identity/v3/projects/1583374ec3b7485ea8a682bf7fda3c33/users/51f5555a83f04c13834179e21c59c136/roles/199ac1dd842441d7913c6ee89d8fbecc => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 05:36:21.450012 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a688d806-92bc-4236-a2e5-fba4e7217356 None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:36:21.450423 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a688d806-92bc-4236-a2e5-fba4e7217356 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:36:21.450731 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a688d806-92bc-4236-a2e5-fba4e7217356 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:36:21.478128 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-a688d806-92bc-4236-a2e5-fba4e7217356 None None] MFA Rules not processed for user `51f5555a83f04c13834179e21c59c136`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:36:21.479557 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-a688d806-92bc-4236-a2e5-fba4e7217356 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:36:21.512270 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d33bff0-983e-47c5-aefc-45462027c1e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:36:21.513921 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d33bff0-983e-47c5-aefc-45462027c1e5 admin admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:36:21.514215 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d33bff0-983e-47c5-aefc-45462027c1e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:36:21.515129 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d33bff0-983e-47c5-aefc-45462027c1e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:36:21.516311 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d33bff0-983e-47c5-aefc-45462027c1e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:36:21.517983 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d33bff0-983e-47c5-aefc-45462027c1e5 admin admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:36:21.532954 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1041/2040] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 10 05:36:21 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 05:36:21.544778 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d33bff0-983e-47c5-aefc-45462027c1e5 admin admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:36:21.558053 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1000/2041] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 10 05:36:21 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 05:36:21.563670 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d33bff0-983e-47c5-aefc-45462027c1e5 admin admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:36:21.569169 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63560b2b-4ee8-47c1-b4d8-eaf18e09b3bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:36:21.569838 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63560b2b-4ee8-47c1-b4d8-eaf18e09b3bb admin admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:36:21.570122 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63560b2b-4ee8-47c1-b4d8-eaf18e09b3bb admin admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:36:21.570410 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63560b2b-4ee8-47c1-b4d8-eaf18e09b3bb admin admin] PATH_INFO: `/v3/roles` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:36:21.571142 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63560b2b-4ee8-47c1-b4d8-eaf18e09b3bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:36:21.573825 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a688d806-92bc-4236-a2e5-fba4e7217356 None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:36:21.575878 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-a688d806-92bc-4236-a2e5-fba4e7217356 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:36:21.578722 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63560b2b-4ee8-47c1-b4d8-eaf18e09b3bb admin admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:36:21.612590 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1042/2042] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 10 05:36:21 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 05:36:21.616683 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63560b2b-4ee8-47c1-b4d8-eaf18e09b3bb admin admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:36:21.641590 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63560b2b-4ee8-47c1-b4d8-eaf18e09b3bb admin admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:36:21.648735 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafd2b33-482e-41ae-9491-b3c75ad81eee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:36:21.649833 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafd2b33-482e-41ae-9491-b3c75ad81eee admin admin] REQUEST_METHOD: `PUT` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:36:21.650233 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafd2b33-482e-41ae-9491-b3c75ad81eee admin admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:36:21.650520 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafd2b33-482e-41ae-9491-b3c75ad81eee admin admin] PATH_INFO: `/v3/projects/1e013ced58534990acf659d445ccbcec/users/2c03c6cf574d4e2ab0df534077fcfb18/roles/382636e67fc142a2b2f486340d959e11` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:36:21.652322 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a688d806-92bc-4236-a2e5-fba4e7217356 None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:36:21.657860 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8dc85bb-65a7-4946-be07-da660b90471f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355be413675540a39ccb00e1a0722316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f23435f783540199d6dcfd0417c090e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:36:21.658592 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dc85bb-65a7-4946-be07-da660b90471f service cinder] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:36:21.658940 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dc85bb-65a7-4946-be07-da660b90471f service cinder] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:36:21.659385 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dc85bb-65a7-4946-be07-da660b90471f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:36:21.671527 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cafd2b33-482e-41ae-9491-b3c75ad81eee admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e013ced58534990acf659d445ccbcec, user_id=2c03c6cf574d4e2ab0df534077fcfb18, role_id=382636e67fc142a2b2f486340d959e11)` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:36:21.674346 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cafd2b33-482e-41ae-9491-b3c75ad81eee admin admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:36:21.677561 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8dc85bb-65a7-4946-be07-da660b90471f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:36:21.679025 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8dc85bb-65a7-4946-be07-da660b90471f service cinder] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:36:21.692422 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1001/2043] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 10 05:36:21 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 05:36:21.703631 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1043/2044] 10.222.0.23 () {60 vars in 1482 bytes} [Tue May 10 05:36:21 2022] PUT /identity/v3/projects/1e013ced58534990acf659d445ccbcec/users/2c03c6cf574d4e2ab0df534077fcfb18/roles/382636e67fc142a2b2f486340d959e11 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 05:36:21.710696 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47aa1d0d-ba5c-4f25-b576-e82b254ccf95 None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:36:21.711048 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47aa1d0d-ba5c-4f25-b576-e82b254ccf95 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:36:21.711399 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47aa1d0d-ba5c-4f25-b576-e82b254ccf95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:36:21.767563 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-47aa1d0d-ba5c-4f25-b576-e82b254ccf95 None None] MFA Rules not processed for user `2c03c6cf574d4e2ab0df534077fcfb18`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:36:21.770375 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-47aa1d0d-ba5c-4f25-b576-e82b254ccf95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:36:21.914240 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1002/2045] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 10 05:36:21 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 05:36:21.915726 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafd2b33-482e-41ae-9491-b3c75ad81eee admin admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:36:22.042781 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafd2b33-482e-41ae-9491-b3c75ad81eee admin admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:36:22.050596 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521df873-becf-4501-846b-00c45ea132c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:36:22.051780 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521df873-becf-4501-846b-00c45ea132c2 admin admin] REQUEST_METHOD: `POST` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:36:22.052206 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521df873-becf-4501-846b-00c45ea132c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:36:22.052490 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521df873-becf-4501-846b-00c45ea132c2 admin admin] PATH_INFO: `/v3/projects` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:36:22.053313 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521df873-becf-4501-846b-00c45ea132c2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:36:22.055730 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521df873-becf-4501-846b-00c45ea132c2 admin admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:36:22.115131 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47aa1d0d-ba5c-4f25-b576-e82b254ccf95 None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:36:22.118138 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1044/2046] 10.222.0.23 () {60 vars in 1152 bytes} [Tue May 10 05:36:21 2022] POST /identity/v3/projects => generated 381 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 05:36:22.130944 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47aa1d0d-ba5c-4f25-b576-e82b254ccf95 None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:36:22.259088 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0dd5c7-9039-4c3c-abfd-e13c11ed7854 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:36:22.260014 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0dd5c7-9039-4c3c-abfd-e13c11ed7854 admin admin] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:36:22.260399 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0dd5c7-9039-4c3c-abfd-e13c11ed7854 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:36:22.260746 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0dd5c7-9039-4c3c-abfd-e13c11ed7854 admin admin] PATH_INFO: `/v3/users` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:36:22.261521 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0dd5c7-9039-4c3c-abfd-e13c11ed7854 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:36:22.264519 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0dd5c7-9039-4c3c-abfd-e13c11ed7854 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:36:22.308394 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1003/2047] 10.222.0.23 () {60 vars in 1143 bytes} [Tue May 10 05:36:22 2022] POST /identity/v3/users => generated 297 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 05:36:22.311886 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521df873-becf-4501-846b-00c45ea132c2 admin admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:36:22.328103 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521df873-becf-4501-846b-00c45ea132c2 admin admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:36:22.334104 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d458f4b-b60b-42f7-8b94-1e20c3634265 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:36:22.334839 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d458f4b-b60b-42f7-8b94-1e20c3634265 admin admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:36:22.335129 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d458f4b-b60b-42f7-8b94-1e20c3634265 admin admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:36:22.335409 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d458f4b-b60b-42f7-8b94-1e20c3634265 admin admin] PATH_INFO: `/v3/roles` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:36:22.337325 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d458f4b-b60b-42f7-8b94-1e20c3634265 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:36:22.340065 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d458f4b-b60b-42f7-8b94-1e20c3634265 admin admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:36:22.376295 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1045/2048] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 10 05:36:22 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 05:36:22.380450 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0dd5c7-9039-4c3c-abfd-e13c11ed7854 admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:36:22.393681 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0dd5c7-9039-4c3c-abfd-e13c11ed7854 admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:36:22.411439 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d458f4b-b60b-42f7-8b94-1e20c3634265 admin admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:36:22.412046 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a944eb3-b00e-41de-baa9-3c80e3ed0138 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:36:22.413072 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a944eb3-b00e-41de-baa9-3c80e3ed0138 admin admin] REQUEST_METHOD: `PUT` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:36:22.413458 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a944eb3-b00e-41de-baa9-3c80e3ed0138 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:36:22.414449 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a944eb3-b00e-41de-baa9-3c80e3ed0138 admin admin] PATH_INFO: `/v3/projects/8d68f6a5147645a9a8f017ee33a50196/users/66ff3ca03f254ac6bd8da5632c5f446d/roles/199ac1dd842441d7913c6ee89d8fbecc` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:36:22.455956 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a944eb3-b00e-41de-baa9-3c80e3ed0138 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8d68f6a5147645a9a8f017ee33a50196, user_id=66ff3ca03f254ac6bd8da5632c5f446d, role_id=199ac1dd842441d7913c6ee89d8fbecc)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:36:22.485941 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a944eb3-b00e-41de-baa9-3c80e3ed0138 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:36:22.486152 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d458f4b-b60b-42f7-8b94-1e20c3634265 admin admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:36:22.493300 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f2f947-04b5-4718-86e2-d96b648d7ec3 tempest-VolumeQuotaClassesTest-1169497257 tempest-VolumeQuotaClassesTest-1169497257-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51f5555a83f04c13834179e21c59c136', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1583374ec3b7485ea8a682bf7fda3c33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:36:22.494251 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f2f947-04b5-4718-86e2-d96b648d7ec3 tempest-VolumeQuotaClassesTest-1169497257 tempest-VolumeQuotaClassesTest-1169497257-project-admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:36:22.494541 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f2f947-04b5-4718-86e2-d96b648d7ec3 tempest-VolumeQuotaClassesTest-1169497257 tempest-VolumeQuotaClassesTest-1169497257-project-admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:36:22.494850 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f2f947-04b5-4718-86e2-d96b648d7ec3 tempest-VolumeQuotaClassesTest-1169497257 tempest-VolumeQuotaClassesTest-1169497257-project-admin] PATH_INFO: `/v3/domains` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:36:22.495625 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f2f947-04b5-4718-86e2-d96b648d7ec3 tempest-VolumeQuotaClassesTest-1169497257 tempest-VolumeQuotaClassesTest-1169497257-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=79879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:36:22.495950 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f2f947-04b5-4718-86e2-d96b648d7ec3 tempest-VolumeQuotaClassesTest-1169497257 tempest-VolumeQuotaClassesTest-1169497257-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:36:22.498020 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f2f947-04b5-4718-86e2-d96b648d7ec3 tempest-VolumeQuotaClassesTest-1169497257 tempest-VolumeQuotaClassesTest-1169497257-project-admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:36:22.507108 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1004/2049] 10.222.0.23 () {60 vars in 1482 bytes} [Tue May 10 05:36:22 2022] PUT /identity/v3/projects/8d68f6a5147645a9a8f017ee33a50196/users/66ff3ca03f254ac6bd8da5632c5f446d/roles/199ac1dd842441d7913c6ee89d8fbecc => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 05:36:22.511012 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a944eb3-b00e-41de-baa9-3c80e3ed0138 admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:36:22.514804 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1046/2050] 10.222.0.23 () {58 vars in 1152 bytes} [Tue May 10 05:36:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 05:36:22.519393 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f2f947-04b5-4718-86e2-d96b648d7ec3 tempest-VolumeQuotaClassesTest-1169497257 tempest-VolumeQuotaClassesTest-1169497257-project-admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:36:22.541396 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f2f947-04b5-4718-86e2-d96b648d7ec3 tempest-VolumeQuotaClassesTest-1169497257 tempest-VolumeQuotaClassesTest-1169497257-project-admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:36:22.583706 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a944eb3-b00e-41de-baa9-3c80e3ed0138 admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:36:22.588496 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4562a3-fbef-4c67-97ea-ac5cb2750884 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:36:22.589181 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4562a3-fbef-4c67-97ea-ac5cb2750884 admin admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:36:22.589464 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4562a3-fbef-4c67-97ea-ac5cb2750884 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:36:22.589741 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4562a3-fbef-4c67-97ea-ac5cb2750884 admin admin] PATH_INFO: `/v3/roles` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:36:22.590479 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4562a3-fbef-4c67-97ea-ac5cb2750884 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:36:22.592118 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4562a3-fbef-4c67-97ea-ac5cb2750884 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:36:22.602455 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1005/2051] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 10 05:36:22 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 05:36:22.606586 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4562a3-fbef-4c67-97ea-ac5cb2750884 admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:36:22.607643 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c719c8-1360-4c6c-b604-88cc6ad4b15a tempest-VolumeQuotaClassesTest-1169497257 tempest-VolumeQuotaClassesTest-1169497257-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51f5555a83f04c13834179e21c59c136', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1583374ec3b7485ea8a682bf7fda3c33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:36:22.608328 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c719c8-1360-4c6c-b604-88cc6ad4b15a tempest-VolumeQuotaClassesTest-1169497257 tempest-VolumeQuotaClassesTest-1169497257-project-admin] REQUEST_METHOD: `POST` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:36:22.608750 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c719c8-1360-4c6c-b604-88cc6ad4b15a tempest-VolumeQuotaClassesTest-1169497257 tempest-VolumeQuotaClassesTest-1169497257-project-admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:36:22.609040 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c719c8-1360-4c6c-b604-88cc6ad4b15a tempest-VolumeQuotaClassesTest-1169497257 tempest-VolumeQuotaClassesTest-1169497257-project-admin] PATH_INFO: `/v3/projects` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:36:22.609806 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c719c8-1360-4c6c-b604-88cc6ad4b15a tempest-VolumeQuotaClassesTest-1169497257 tempest-VolumeQuotaClassesTest-1169497257-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:36:22.611803 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c719c8-1360-4c6c-b604-88cc6ad4b15a tempest-VolumeQuotaClassesTest-1169497257 tempest-VolumeQuotaClassesTest-1169497257-project-admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:36:22.624742 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4562a3-fbef-4c67-97ea-ac5cb2750884 admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:36:22.637633 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68d0d91-f0a3-4342-9c38-d69e2c1be000 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:36:22.638547 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68d0d91-f0a3-4342-9c38-d69e2c1be000 admin admin] REQUEST_METHOD: `PUT` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:36:22.638826 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68d0d91-f0a3-4342-9c38-d69e2c1be000 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:36:22.639097 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68d0d91-f0a3-4342-9c38-d69e2c1be000 admin admin] PATH_INFO: `/v3/projects/8d68f6a5147645a9a8f017ee33a50196/users/66ff3ca03f254ac6bd8da5632c5f446d/roles/199ac1dd842441d7913c6ee89d8fbecc` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:36:22.642836 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68d0d91-f0a3-4342-9c38-d69e2c1be000 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8d68f6a5147645a9a8f017ee33a50196, user_id=66ff3ca03f254ac6bd8da5632c5f446d, role_id=199ac1dd842441d7913c6ee89d8fbecc)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:36:22.647690 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68d0d91-f0a3-4342-9c38-d69e2c1be000 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:36:22.660865 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1047/2052] 10.222.0.23 () {60 vars in 1152 bytes} [Tue May 10 05:36:22 2022] POST /identity/v3/projects => generated 353 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 05:36:22.662752 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c719c8-1360-4c6c-b604-88cc6ad4b15a tempest-VolumeQuotaClassesTest-1169497257 tempest-VolumeQuotaClassesTest-1169497257-project-admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:36:22.667637 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1006/2053] 10.222.0.23 () {60 vars in 1482 bytes} [Tue May 10 05:36:22 2022] PUT /identity/v3/projects/8d68f6a5147645a9a8f017ee33a50196/users/66ff3ca03f254ac6bd8da5632c5f446d/roles/199ac1dd842441d7913c6ee89d8fbecc => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 05:36:22.678831 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8ec270-53fa-45f6-9e75-efc8a2f2a777 None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:36:22.680264 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8ec270-53fa-45f6-9e75-efc8a2f2a777 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:36:22.681771 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8ec270-53fa-45f6-9e75-efc8a2f2a777 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:36:22.746926 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-1f8ec270-53fa-45f6-9e75-efc8a2f2a777 None None] MFA Rules not processed for user `66ff3ca03f254ac6bd8da5632c5f446d`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:36:22.749302 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-1f8ec270-53fa-45f6-9e75-efc8a2f2a777 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:36:22.836645 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c719c8-1360-4c6c-b604-88cc6ad4b15a tempest-VolumeQuotaClassesTest-1169497257 tempest-VolumeQuotaClassesTest-1169497257-project-admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:36:22.902323 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1007/2054] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 10 05:36:22 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 05:36:22.914962 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8ec270-53fa-45f6-9e75-efc8a2f2a777 None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:36:22.926018 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9558cbc2-dd3d-424a-bf7e-3913bcde5a70 tempest-VolumeQuotaClassesTest-1169497257 tempest-VolumeQuotaClassesTest-1169497257-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51f5555a83f04c13834179e21c59c136', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1583374ec3b7485ea8a682bf7fda3c33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:36:22.926699 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9558cbc2-dd3d-424a-bf7e-3913bcde5a70 tempest-VolumeQuotaClassesTest-1169497257 tempest-VolumeQuotaClassesTest-1169497257-project-admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:36:22.927012 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9558cbc2-dd3d-424a-bf7e-3913bcde5a70 tempest-VolumeQuotaClassesTest-1169497257 tempest-VolumeQuotaClassesTest-1169497257-project-admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:36:22.927293 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9558cbc2-dd3d-424a-bf7e-3913bcde5a70 tempest-VolumeQuotaClassesTest-1169497257 tempest-VolumeQuotaClassesTest-1169497257-project-admin] PATH_INFO: `/v3/domains` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:36:22.928162 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9558cbc2-dd3d-424a-bf7e-3913bcde5a70 tempest-VolumeQuotaClassesTest-1169497257 tempest-VolumeQuotaClassesTest-1169497257-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=79879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:36:22.928613 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9558cbc2-dd3d-424a-bf7e-3913bcde5a70 tempest-VolumeQuotaClassesTest-1169497257 tempest-VolumeQuotaClassesTest-1169497257-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:36:22.931214 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9558cbc2-dd3d-424a-bf7e-3913bcde5a70 tempest-VolumeQuotaClassesTest-1169497257 tempest-VolumeQuotaClassesTest-1169497257-project-admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:36:22.944537 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1048/2055] 10.222.0.23 () {58 vars in 1152 bytes} [Tue May 10 05:36:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:36:22.980684 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8ec270-53fa-45f6-9e75-efc8a2f2a777 None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:36:22.989188 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9558cbc2-dd3d-424a-bf7e-3913bcde5a70 tempest-VolumeQuotaClassesTest-1169497257 tempest-VolumeQuotaClassesTest-1169497257-project-admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:36:22.991015 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e870b78-c686-4185-9b92-850b0238f9d9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355be413675540a39ccb00e1a0722316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f23435f783540199d6dcfd0417c090e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:36:22.991949 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e870b78-c686-4185-9b92-850b0238f9d9 service cinder] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:36:22.992394 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e870b78-c686-4185-9b92-850b0238f9d9 service cinder] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:36:22.992811 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e870b78-c686-4185-9b92-850b0238f9d9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:36:23.003671 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e870b78-c686-4185-9b92-850b0238f9d9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:36:23.005350 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e870b78-c686-4185-9b92-850b0238f9d9 service cinder] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:36:23.014707 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9558cbc2-dd3d-424a-bf7e-3913bcde5a70 tempest-VolumeQuotaClassesTest-1169497257 tempest-VolumeQuotaClassesTest-1169497257-project-admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:36:23.016659 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1008/2056] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 10 05:36:22 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 05:36:23.035623 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac540a7-fbd1-404e-ab4f-d5eda14a05aa tempest-VolumeQuotaClassesTest-1169497257 tempest-VolumeQuotaClassesTest-1169497257-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51f5555a83f04c13834179e21c59c136', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1583374ec3b7485ea8a682bf7fda3c33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:36:23.035623 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac540a7-fbd1-404e-ab4f-d5eda14a05aa tempest-VolumeQuotaClassesTest-1169497257 tempest-VolumeQuotaClassesTest-1169497257-project-admin] REQUEST_METHOD: `DELETE` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:36:23.036406 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac540a7-fbd1-404e-ab4f-d5eda14a05aa tempest-VolumeQuotaClassesTest-1169497257 tempest-VolumeQuotaClassesTest-1169497257-project-admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:36:23.036704 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac540a7-fbd1-404e-ab4f-d5eda14a05aa tempest-VolumeQuotaClassesTest-1169497257 tempest-VolumeQuotaClassesTest-1169497257-project-admin] PATH_INFO: `/v3/projects/4bd887a4af3a48909df12baaa5537a63` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:36:23.037925 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac540a7-fbd1-404e-ab4f-d5eda14a05aa tempest-VolumeQuotaClassesTest-1169497257 tempest-VolumeQuotaClassesTest-1169497257-project-admin] RBAC: Authorizing `identity:delete_project(project_id=4bd887a4af3a48909df12baaa5537a63)` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:36:23.040859 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac540a7-fbd1-404e-ab4f-d5eda14a05aa tempest-VolumeQuotaClassesTest-1169497257 tempest-VolumeQuotaClassesTest-1169497257-project-admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:36:23.104919 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-dac540a7-fbd1-404e-ab4f-d5eda14a05aa tempest-VolumeQuotaClassesTest-1169497257 tempest-VolumeQuotaClassesTest-1169497257-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4bd887a4af3a48909df12baaa5537a63', 'request_id': 'req-dac540a7-fbd1-404e-ab4f-d5eda14a05aa'} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:36:23.119368 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-dac540a7-fbd1-404e-ab4f-d5eda14a05aa tempest-VolumeQuotaClassesTest-1169497257 tempest-VolumeQuotaClassesTest-1169497257-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4bd887a4af3a48909df12baaa5537a63', 'request_id': 'req-dac540a7-fbd1-404e-ab4f-d5eda14a05aa'} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:36:23.127414 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e870b78-c686-4185-9b92-850b0238f9d9 service cinder] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:36:23.134059 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-dac540a7-fbd1-404e-ab4f-d5eda14a05aa tempest-VolumeQuotaClassesTest-1169497257 tempest-VolumeQuotaClassesTest-1169497257-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4bd887a4af3a48909df12baaa5537a63', 'request_id': 'req-dac540a7-fbd1-404e-ab4f-d5eda14a05aa'} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:36:23.139700 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e870b78-c686-4185-9b92-850b0238f9d9 service cinder] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:36:23.164216 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-dac540a7-fbd1-404e-ab4f-d5eda14a05aa tempest-VolumeQuotaClassesTest-1169497257 tempest-VolumeQuotaClassesTest-1169497257-project-admin] The token cache is being invalidate because project 4bd887a4af3a48909df12baaa5537a63 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79879) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 05:36:23.164525 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-dac540a7-fbd1-404e-ab4f-d5eda14a05aa tempest-VolumeQuotaClassesTest-1169497257 tempest-VolumeQuotaClassesTest-1169497257-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:36:23.165310 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-dac540a7-fbd1-404e-ab4f-d5eda14a05aa tempest-VolumeQuotaClassesTest-1169497257 tempest-VolumeQuotaClassesTest-1169497257-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:36:23.167038 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1049/2057] 10.222.0.23 () {58 vars in 1232 bytes} [Tue May 10 05:36:22 2022] DELETE /identity/v3/projects/4bd887a4af3a48909df12baaa5537a63 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 05:36:23.198246 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbedcfa7-fa2e-4cf1-84a6-565d220002e3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355be413675540a39ccb00e1a0722316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f23435f783540199d6dcfd0417c090e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:36:23.198995 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbedcfa7-fa2e-4cf1-84a6-565d220002e3 service cinder] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:36:23.199379 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbedcfa7-fa2e-4cf1-84a6-565d220002e3 service cinder] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:36:23.199742 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbedcfa7-fa2e-4cf1-84a6-565d220002e3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:36:23.201620 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-bbedcfa7-fa2e-4cf1-84a6-565d220002e3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:36:23.268432 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbedcfa7-fa2e-4cf1-84a6-565d220002e3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:36:23.270017 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbedcfa7-fa2e-4cf1-84a6-565d220002e3 service cinder] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:36:23.279280 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1009/2058] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 10 05:36:23 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 05:36:23.361112 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac540a7-fbd1-404e-ab4f-d5eda14a05aa tempest-VolumeQuotaClassesTest-1169497257 tempest-VolumeQuotaClassesTest-1169497257-project-admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:36:23.362995 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-dac540a7-fbd1-404e-ab4f-d5eda14a05aa tempest-VolumeQuotaClassesTest-1169497257 tempest-VolumeQuotaClassesTest-1169497257-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:36:23.438435 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac540a7-fbd1-404e-ab4f-d5eda14a05aa tempest-VolumeQuotaClassesTest-1169497257 tempest-VolumeQuotaClassesTest-1169497257-project-admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:36:23.444167 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a667f3e-e775-4163-ab31-87a2eab47958 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:36:23.445708 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a667f3e-e775-4163-ab31-87a2eab47958 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:36:23.445708 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a667f3e-e775-4163-ab31-87a2eab47958 admin admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:36:23.445708 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a667f3e-e775-4163-ab31-87a2eab47958 admin admin] PATH_INFO: `/v3/users/0e47399614e3437ca04192dcefb550e9` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:36:23.447294 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a667f3e-e775-4163-ab31-87a2eab47958 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0e47399614e3437ca04192dcefb550e9)` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:36:23.449434 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a667f3e-e775-4163-ab31-87a2eab47958 admin admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:36:23.534977 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-4a667f3e-e775-4163-ab31-87a2eab47958 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0e47399614e3437ca04192dcefb550e9'} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:36:23.559449 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-4a667f3e-e775-4163-ab31-87a2eab47958 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0e47399614e3437ca04192dcefb550e9'} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:36:23.560275 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-4a667f3e-e775-4163-ab31-87a2eab47958 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0e47399614e3437ca04192dcefb550e9'} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:36:23.594654 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-4a667f3e-e775-4163-ab31-87a2eab47958 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0e47399614e3437ca04192dcefb550e9'} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:36:23.607610 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-4a667f3e-e775-4163-ab31-87a2eab47958 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0e47399614e3437ca04192dcefb550e9'} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:36:23.623827 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475e05d6-d4a4-4ce9-b2ca-86f97516ed35 None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:36:23.624818 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475e05d6-d4a4-4ce9-b2ca-86f97516ed35 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:36:23.625200 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475e05d6-d4a4-4ce9-b2ca-86f97516ed35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:36:23.626843 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1050/2059] 10.222.0.23 () {58 vars in 1223 bytes} [Tue May 10 05:36:23 2022] DELETE /identity/v3/users/0e47399614e3437ca04192dcefb550e9 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 05:36:23.655193 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-475e05d6-d4a4-4ce9-b2ca-86f97516ed35 None None] MFA Rules not processed for user `44883b22532e44049d846938dc2cf423`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:36:23.657445 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-475e05d6-d4a4-4ce9-b2ca-86f97516ed35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:36:23.751861 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1010/2060] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 10 05:36:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 05:36:23.766433 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a667f3e-e775-4163-ab31-87a2eab47958 admin admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:36:23.768324 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-4a667f3e-e775-4163-ab31-87a2eab47958 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:36:23.849539 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a667f3e-e775-4163-ab31-87a2eab47958 admin admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:36:23.854560 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdef6f59-4db6-4bad-9cc2-f06c3e5059c5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c8461cfdd9648b8abcaf8d34b7a102a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f23435f783540199d6dcfd0417c090e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:36:23.855235 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdef6f59-4db6-4bad-9cc2-f06c3e5059c5 service neutron] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:36:23.855745 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdef6f59-4db6-4bad-9cc2-f06c3e5059c5 service neutron] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:36:23.856111 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdef6f59-4db6-4bad-9cc2-f06c3e5059c5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:36:23.866595 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdef6f59-4db6-4bad-9cc2-f06c3e5059c5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:36:23.868214 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdef6f59-4db6-4bad-9cc2-f06c3e5059c5 service neutron] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:36:23.882300 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1051/2061] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 10 05:36:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 05:36:24.447301 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475e05d6-d4a4-4ce9-b2ca-86f97516ed35 None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:36:24.449052 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-475e05d6-d4a4-4ce9-b2ca-86f97516ed35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:36:24.487614 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475e05d6-d4a4-4ce9-b2ca-86f97516ed35 None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:36:24.492439 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96cd12f-fe20-41a5-b2cb-03927c36d6be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:36:24.493350 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96cd12f-fe20-41a5-b2cb-03927c36d6be admin admin] REQUEST_METHOD: `DELETE` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:36:24.493635 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96cd12f-fe20-41a5-b2cb-03927c36d6be admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:36:24.493914 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96cd12f-fe20-41a5-b2cb-03927c36d6be admin admin] PATH_INFO: `/v3/projects/ae5e16ebae5349fb9fa55180727f726b` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:36:24.495113 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96cd12f-fe20-41a5-b2cb-03927c36d6be admin admin] RBAC: Authorizing `identity:delete_project(project_id=ae5e16ebae5349fb9fa55180727f726b)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:36:24.497085 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96cd12f-fe20-41a5-b2cb-03927c36d6be admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:36:24.549515 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-a96cd12f-fe20-41a5-b2cb-03927c36d6be admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ae5e16ebae5349fb9fa55180727f726b', 'request_id': 'req-a96cd12f-fe20-41a5-b2cb-03927c36d6be'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:36:24.556892 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-a96cd12f-fe20-41a5-b2cb-03927c36d6be admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ae5e16ebae5349fb9fa55180727f726b', 'request_id': 'req-a96cd12f-fe20-41a5-b2cb-03927c36d6be'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:36:24.566058 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-a96cd12f-fe20-41a5-b2cb-03927c36d6be admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ae5e16ebae5349fb9fa55180727f726b', 'request_id': 'req-a96cd12f-fe20-41a5-b2cb-03927c36d6be'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:36:24.576244 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-a96cd12f-fe20-41a5-b2cb-03927c36d6be admin admin] The token cache is being invalidate because project ae5e16ebae5349fb9fa55180727f726b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79880) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 05:36:24.576526 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-a96cd12f-fe20-41a5-b2cb-03927c36d6be admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:36:24.577162 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-a96cd12f-fe20-41a5-b2cb-03927c36d6be admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:36:24.578767 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1011/2062] 10.222.0.23 () {58 vars in 1232 bytes} [Tue May 10 05:36:24 2022] DELETE /identity/v3/projects/ae5e16ebae5349fb9fa55180727f726b => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 05:36:24.582989 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdef6f59-4db6-4bad-9cc2-f06c3e5059c5 service neutron] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:36:24.593636 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdef6f59-4db6-4bad-9cc2-f06c3e5059c5 service neutron] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:36:24.653844 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deca80b3-9039-47ed-ab74-88a24fbabab6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:36:24.654712 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deca80b3-9039-47ed-ab74-88a24fbabab6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:36:24.655133 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deca80b3-9039-47ed-ab74-88a24fbabab6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:36:24.655428 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deca80b3-9039-47ed-ab74-88a24fbabab6 admin admin] PATH_INFO: `/v3/users/51f5555a83f04c13834179e21c59c136` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:36:24.656972 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deca80b3-9039-47ed-ab74-88a24fbabab6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=51f5555a83f04c13834179e21c59c136)` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:36:24.658939 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deca80b3-9039-47ed-ab74-88a24fbabab6 admin admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:36:24.711660 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-deca80b3-9039-47ed-ab74-88a24fbabab6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '51f5555a83f04c13834179e21c59c136'} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:36:24.719314 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-deca80b3-9039-47ed-ab74-88a24fbabab6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '51f5555a83f04c13834179e21c59c136'} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:36:24.720040 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-deca80b3-9039-47ed-ab74-88a24fbabab6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '51f5555a83f04c13834179e21c59c136'} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:36:24.733597 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-deca80b3-9039-47ed-ab74-88a24fbabab6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '51f5555a83f04c13834179e21c59c136'} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:36:24.741291 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-deca80b3-9039-47ed-ab74-88a24fbabab6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '51f5555a83f04c13834179e21c59c136'} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:36:24.748079 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1052/2063] 10.222.0.23 () {58 vars in 1223 bytes} [Tue May 10 05:36:24 2022] DELETE /identity/v3/users/51f5555a83f04c13834179e21c59c136 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 05:36:25.317619 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96cd12f-fe20-41a5-b2cb-03927c36d6be admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:36:25.319322 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-a96cd12f-fe20-41a5-b2cb-03927c36d6be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:36:25.338347 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96cd12f-fe20-41a5-b2cb-03927c36d6be admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:36:25.436619 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b2a705-f0b4-41e1-806e-7490f6d250e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:36:25.437639 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b2a705-f0b4-41e1-806e-7490f6d250e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:36:25.438549 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b2a705-f0b4-41e1-806e-7490f6d250e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:36:25.438549 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b2a705-f0b4-41e1-806e-7490f6d250e7 admin admin] PATH_INFO: `/v3/projects/1583374ec3b7485ea8a682bf7fda3c33` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:36:25.439877 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b2a705-f0b4-41e1-806e-7490f6d250e7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1583374ec3b7485ea8a682bf7fda3c33)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:36:25.442925 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b2a705-f0b4-41e1-806e-7490f6d250e7 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:36:25.525038 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-64b2a705-f0b4-41e1-806e-7490f6d250e7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1583374ec3b7485ea8a682bf7fda3c33', 'request_id': 'req-64b2a705-f0b4-41e1-806e-7490f6d250e7'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:36:25.530856 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-64b2a705-f0b4-41e1-806e-7490f6d250e7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1583374ec3b7485ea8a682bf7fda3c33', 'request_id': 'req-64b2a705-f0b4-41e1-806e-7490f6d250e7'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:36:25.541120 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-64b2a705-f0b4-41e1-806e-7490f6d250e7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1583374ec3b7485ea8a682bf7fda3c33', 'request_id': 'req-64b2a705-f0b4-41e1-806e-7490f6d250e7'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:36:25.552734 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-64b2a705-f0b4-41e1-806e-7490f6d250e7 admin admin] The token cache is being invalidate because project 1583374ec3b7485ea8a682bf7fda3c33 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79880) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 05:36:25.553022 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-64b2a705-f0b4-41e1-806e-7490f6d250e7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:36:25.553711 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-64b2a705-f0b4-41e1-806e-7490f6d250e7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:36:25.558851 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1012/2064] 10.222.0.23 () {58 vars in 1232 bytes} [Tue May 10 05:36:25 2022] DELETE /identity/v3/projects/1583374ec3b7485ea8a682bf7fda3c33 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 05:36:25.560551 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1df44e-e7c9-4ba8-84f1-ba2ae15781d8 None None] REQUEST_METHOD: `POST` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:36:25.561560 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1df44e-e7c9-4ba8-84f1-ba2ae15781d8 None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:36:25.561915 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1df44e-e7c9-4ba8-84f1-ba2ae15781d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:36:25.582242 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.auth.core [None req-3d1df44e-e7c9-4ba8-84f1-ba2ae15781d8 None None] MFA Rules not processed for user `44883b22532e44049d846938dc2cf423`. Rule list: `[]` (Enabled: `True`). {{(pid=79879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:36:25.583638 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-3d1df44e-e7c9-4ba8-84f1-ba2ae15781d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:36:25.659715 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1053/2065] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 10 05:36:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 05:36:25.668172 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4d1fa2-5b01-4f2a-9934-b7f3be3d0d23 None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:36:25.668543 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4d1fa2-5b01-4f2a-9934-b7f3be3d0d23 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:36:25.668912 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4d1fa2-5b01-4f2a-9934-b7f3be3d0d23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:36:25.702514 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-3f4d1fa2-5b01-4f2a-9934-b7f3be3d0d23 None None] MFA Rules not processed for user `44883b22532e44049d846938dc2cf423`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:36:25.703987 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-3f4d1fa2-5b01-4f2a-9934-b7f3be3d0d23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:36:25.714666 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1013/2066] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 10 05:36:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 05:36:25.718756 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1df44e-e7c9-4ba8-84f1-ba2ae15781d8 None None] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:36:25.730670 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1df44e-e7c9-4ba8-84f1-ba2ae15781d8 None None] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:36:25.735637 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029d2a8b-c426-4e31-bc56-083a7e8f7d43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:36:25.736391 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029d2a8b-c426-4e31-bc56-083a7e8f7d43 admin admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:36:25.736751 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029d2a8b-c426-4e31-bc56-083a7e8f7d43 admin admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:36:25.737103 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029d2a8b-c426-4e31-bc56-083a7e8f7d43 admin admin] PATH_INFO: `/v3/domains` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:36:25.737941 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029d2a8b-c426-4e31-bc56-083a7e8f7d43 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:36:25.738252 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029d2a8b-c426-4e31-bc56-083a7e8f7d43 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:36:25.740107 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029d2a8b-c426-4e31-bc56-083a7e8f7d43 admin admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:36:25.755323 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1054/2067] 10.222.0.23 () {58 vars in 1152 bytes} [Tue May 10 05:36:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 05:36:25.759757 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4d1fa2-5b01-4f2a-9934-b7f3be3d0d23 None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:36:25.769053 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4d1fa2-5b01-4f2a-9934-b7f3be3d0d23 None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:36:25.773845 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e16021c-a123-4965-a531-5e7356deacb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:36:25.774514 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e16021c-a123-4965-a531-5e7356deacb1 admin admin] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:36:25.774798 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e16021c-a123-4965-a531-5e7356deacb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:36:25.775076 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e16021c-a123-4965-a531-5e7356deacb1 admin admin] PATH_INFO: `/v3/projects` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:36:25.775820 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e16021c-a123-4965-a531-5e7356deacb1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:36:25.777741 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e16021c-a123-4965-a531-5e7356deacb1 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:36:25.812350 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1014/2068] 10.222.0.23 () {60 vars in 1152 bytes} [Tue May 10 05:36:25 2022] POST /identity/v3/projects => generated 407 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 05:36:25.815293 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029d2a8b-c426-4e31-bc56-083a7e8f7d43 admin admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:36:25.832575 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029d2a8b-c426-4e31-bc56-083a7e8f7d43 admin admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:36:25.833094 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e16021c-a123-4965-a531-5e7356deacb1 admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:36:25.834787 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-7e16021c-a123-4965-a531-5e7356deacb1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:36:25.902803 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5586fd-fade-471c-b41c-08a20518ac27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:36:25.903864 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5586fd-fade-471c-b41c-08a20518ac27 admin admin] REQUEST_METHOD: `POST` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:36:25.904514 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5586fd-fade-471c-b41c-08a20518ac27 admin admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:36:25.904988 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5586fd-fade-471c-b41c-08a20518ac27 admin admin] PATH_INFO: `/v3/users` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:36:25.906078 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5586fd-fade-471c-b41c-08a20518ac27 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:36:25.908686 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5586fd-fade-471c-b41c-08a20518ac27 admin admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:36:25.910630 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e16021c-a123-4965-a531-5e7356deacb1 admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:36:25.915918 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de19e1fa-8dce-4791-ab3f-42591dabc1a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:36:25.916934 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de19e1fa-8dce-4791-ab3f-42591dabc1a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:36:25.917395 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de19e1fa-8dce-4791-ab3f-42591dabc1a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:36:25.917743 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de19e1fa-8dce-4791-ab3f-42591dabc1a6 admin admin] PATH_INFO: `/v3/users/132b4ab645ca4af48f9665589f2a58f7` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:36:25.919046 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de19e1fa-8dce-4791-ab3f-42591dabc1a6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=132b4ab645ca4af48f9665589f2a58f7)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:36:25.921490 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de19e1fa-8dce-4791-ab3f-42591dabc1a6 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:36:25.941287 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1055/2069] 10.222.0.23 () {60 vars in 1143 bytes} [Tue May 10 05:36:25 2022] POST /identity/v3/users => generated 304 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 05:36:25.943737 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5586fd-fade-471c-b41c-08a20518ac27 admin admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:36:25.969852 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5586fd-fade-471c-b41c-08a20518ac27 admin admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:36:25.977332 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ba376a-7211-4b7f-b3de-4930a5e91c9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:36:25.978017 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ba376a-7211-4b7f-b3de-4930a5e91c9c admin admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:36:25.978297 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ba376a-7211-4b7f-b3de-4930a5e91c9c admin admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:36:25.978693 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ba376a-7211-4b7f-b3de-4930a5e91c9c admin admin] PATH_INFO: `/v3/roles` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:36:25.979302 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ba376a-7211-4b7f-b3de-4930a5e91c9c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:36:25.981003 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ba376a-7211-4b7f-b3de-4930a5e91c9c admin admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:36:25.988512 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-de19e1fa-8dce-4791-ab3f-42591dabc1a6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '132b4ab645ca4af48f9665589f2a58f7'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:36:25.997372 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1056/2070] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 10 05:36:25 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 05:36:25.998896 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ba376a-7211-4b7f-b3de-4930a5e91c9c admin admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:36:26.006170 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-de19e1fa-8dce-4791-ab3f-42591dabc1a6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '132b4ab645ca4af48f9665589f2a58f7'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:36:26.006987 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-de19e1fa-8dce-4791-ab3f-42591dabc1a6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '132b4ab645ca4af48f9665589f2a58f7'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:36:26.011890 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ba376a-7211-4b7f-b3de-4930a5e91c9c admin admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:36:26.014544 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-de19e1fa-8dce-4791-ab3f-42591dabc1a6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '132b4ab645ca4af48f9665589f2a58f7'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:36:26.015203 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-de19e1fa-8dce-4791-ab3f-42591dabc1a6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '132b4ab645ca4af48f9665589f2a58f7'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:36:26.016975 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da123f7-9c6b-4595-95e4-808aa500f90a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:36:26.017648 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da123f7-9c6b-4595-95e4-808aa500f90a admin admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:36:26.017933 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da123f7-9c6b-4595-95e4-808aa500f90a admin admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:36:26.018211 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da123f7-9c6b-4595-95e4-808aa500f90a admin admin] PATH_INFO: `/v3/roles` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:36:26.019195 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da123f7-9c6b-4595-95e4-808aa500f90a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:36:26.020942 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da123f7-9c6b-4595-95e4-808aa500f90a admin admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:36:26.033628 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1015/2071] 10.222.0.23 () {58 vars in 1223 bytes} [Tue May 10 05:36:25 2022] DELETE /identity/v3/users/132b4ab645ca4af48f9665589f2a58f7 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 05:36:26.038201 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1057/2072] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 10 05:36:25 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 05:36:26.039385 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b7ea83-be16-4180-a271-dc3041b950a7 None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:36:26.039717 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b7ea83-be16-4180-a271-dc3041b950a7 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:36:26.039993 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b7ea83-be16-4180-a271-dc3041b950a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:36:26.042061 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da123f7-9c6b-4595-95e4-808aa500f90a admin admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:36:26.043910 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-0da123f7-9c6b-4595-95e4-808aa500f90a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:36:26.057576 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da123f7-9c6b-4595-95e4-808aa500f90a admin admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:36:26.061860 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-22b7ea83-be16-4180-a271-dc3041b950a7 None None] MFA Rules not processed for user `44883b22532e44049d846938dc2cf423`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:36:26.064494 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-22b7ea83-be16-4180-a271-dc3041b950a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:36:26.160467 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1016/2073] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 10 05:36:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 05:36:26.165337 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9d164a-e6f7-464c-b699-6daf9a412d76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:36:26.166247 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9d164a-e6f7-464c-b699-6daf9a412d76 admin admin] REQUEST_METHOD: `PUT` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:36:26.166533 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9d164a-e6f7-464c-b699-6daf9a412d76 admin admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:36:26.166805 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9d164a-e6f7-464c-b699-6daf9a412d76 admin admin] PATH_INFO: `/v3/projects/1f1697b0f90c4ac7a6bc809dfe11537e/users/6b700dc0be3a4aa1911a7fb976f00b91/roles/382636e67fc142a2b2f486340d959e11` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:36:26.170223 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b7ea83-be16-4180-a271-dc3041b950a7 None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:36:26.171825 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-22b7ea83-be16-4180-a271-dc3041b950a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:36:26.184777 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9d164a-e6f7-464c-b699-6daf9a412d76 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1f1697b0f90c4ac7a6bc809dfe11537e, user_id=6b700dc0be3a4aa1911a7fb976f00b91, role_id=382636e67fc142a2b2f486340d959e11)` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:36:26.187835 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9d164a-e6f7-464c-b699-6daf9a412d76 admin admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:36:26.207591 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1058/2074] 10.222.0.23 () {60 vars in 1482 bytes} [Tue May 10 05:36:26 2022] PUT /identity/v3/projects/1f1697b0f90c4ac7a6bc809dfe11537e/users/6b700dc0be3a4aa1911a7fb976f00b91/roles/382636e67fc142a2b2f486340d959e11 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 05:36:26.209251 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9d164a-e6f7-464c-b699-6daf9a412d76 admin admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:36:26.217249 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-df9d164a-e6f7-464c-b699-6daf9a412d76 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:36:26.247288 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b7ea83-be16-4180-a271-dc3041b950a7 None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:36:26.287493 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9d164a-e6f7-464c-b699-6daf9a412d76 admin admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:36:26.292470 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13043f8a-8735-4990-91d0-eafe9be3dfca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:36:26.293575 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13043f8a-8735-4990-91d0-eafe9be3dfca admin admin] REQUEST_METHOD: `DELETE` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:36:26.293849 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13043f8a-8735-4990-91d0-eafe9be3dfca admin admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:36:26.294115 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13043f8a-8735-4990-91d0-eafe9be3dfca admin admin] PATH_INFO: `/v3/users/2c03c6cf574d4e2ab0df534077fcfb18` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:36:26.295316 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13043f8a-8735-4990-91d0-eafe9be3dfca admin admin] RBAC: Authorizing `identity:delete_user(user_id=2c03c6cf574d4e2ab0df534077fcfb18)` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:36:26.296492 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab8885c-c2de-4100-9082-4f8db2d1381f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c8461cfdd9648b8abcaf8d34b7a102a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f23435f783540199d6dcfd0417c090e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:36:26.297553 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab8885c-c2de-4100-9082-4f8db2d1381f service neutron] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:36:26.297875 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13043f8a-8735-4990-91d0-eafe9be3dfca admin admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:36:26.298221 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab8885c-c2de-4100-9082-4f8db2d1381f service neutron] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:36:26.298318 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab8885c-c2de-4100-9082-4f8db2d1381f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:36:26.308831 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab8885c-c2de-4100-9082-4f8db2d1381f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:36:26.310458 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab8885c-c2de-4100-9082-4f8db2d1381f service neutron] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:36:26.323787 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1017/2075] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 10 05:36:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 05:36:26.326389 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde14e63-c9af-48c9-907a-9418bd8a0671 None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:36:26.326805 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde14e63-c9af-48c9-907a-9418bd8a0671 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:36:26.327292 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde14e63-c9af-48c9-907a-9418bd8a0671 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:36:26.352717 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-13043f8a-8735-4990-91d0-eafe9be3dfca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2c03c6cf574d4e2ab0df534077fcfb18'} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:36:26.360225 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-dde14e63-c9af-48c9-907a-9418bd8a0671 None None] MFA Rules not processed for user `6b700dc0be3a4aa1911a7fb976f00b91`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:36:26.361665 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-dde14e63-c9af-48c9-907a-9418bd8a0671 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:36:26.362792 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-13043f8a-8735-4990-91d0-eafe9be3dfca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2c03c6cf574d4e2ab0df534077fcfb18'} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:36:26.363773 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-13043f8a-8735-4990-91d0-eafe9be3dfca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2c03c6cf574d4e2ab0df534077fcfb18'} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:36:26.382937 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-13043f8a-8735-4990-91d0-eafe9be3dfca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2c03c6cf574d4e2ab0df534077fcfb18'} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:36:26.393572 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-13043f8a-8735-4990-91d0-eafe9be3dfca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2c03c6cf574d4e2ab0df534077fcfb18'} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:36:26.406558 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1059/2076] 10.222.0.23 () {58 vars in 1223 bytes} [Tue May 10 05:36:26 2022] DELETE /identity/v3/users/2c03c6cf574d4e2ab0df534077fcfb18 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 05:36:26.409288 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b35a74d-faeb-482e-9c45-ca6e0d06cd4d None None] REQUEST_METHOD: `POST` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:36:26.410418 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b35a74d-faeb-482e-9c45-ca6e0d06cd4d None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:36:26.410922 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b35a74d-faeb-482e-9c45-ca6e0d06cd4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:36:26.433931 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.auth.core [None req-1b35a74d-faeb-482e-9c45-ca6e0d06cd4d None None] MFA Rules not processed for user `44883b22532e44049d846938dc2cf423`. Rule list: `[]` (Enabled: `True`). {{(pid=79879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:36:26.435960 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-1b35a74d-faeb-482e-9c45-ca6e0d06cd4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:36:26.441496 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1018/2077] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 10 05:36:26 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 05:36:26.446756 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde14e63-c9af-48c9-907a-9418bd8a0671 None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:36:26.448650 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-dde14e63-c9af-48c9-907a-9418bd8a0671 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:36:26.471049 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde14e63-c9af-48c9-907a-9418bd8a0671 None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:36:26.536089 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1060/2078] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 10 05:36:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 05:36:26.546443 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b35a74d-faeb-482e-9c45-ca6e0d06cd4d None None] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:36:26.548004 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-1b35a74d-faeb-482e-9c45-ca6e0d06cd4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:36:26.548382 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed354ece-73fc-477f-990f-64ceb209e325 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:36:26.549057 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed354ece-73fc-477f-990f-64ceb209e325 admin admin] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:36:26.549335 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed354ece-73fc-477f-990f-64ceb209e325 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:36:26.549600 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed354ece-73fc-477f-990f-64ceb209e325 admin admin] PATH_INFO: `/v3/projects` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:36:26.550289 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed354ece-73fc-477f-990f-64ceb209e325 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:36:26.552960 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed354ece-73fc-477f-990f-64ceb209e325 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:36:26.587634 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1019/2079] 10.222.0.23 () {60 vars in 1152 bytes} [Tue May 10 05:36:26 2022] POST /identity/v3/projects => generated 407 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 05:36:26.589619 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed354ece-73fc-477f-990f-64ceb209e325 admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:36:26.609973 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b35a74d-faeb-482e-9c45-ca6e0d06cd4d None None] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:36:26.653270 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed354ece-73fc-477f-990f-64ceb209e325 admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:36:26.657785 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c82221-de07-4c99-9244-8a0346f8a1a5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c8461cfdd9648b8abcaf8d34b7a102a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f23435f783540199d6dcfd0417c090e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:36:26.658023 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c82221-de07-4c99-9244-8a0346f8a1a5 service neutron] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:36:26.658302 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c82221-de07-4c99-9244-8a0346f8a1a5 service neutron] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:36:26.658577 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c82221-de07-4c99-9244-8a0346f8a1a5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:36:26.658802 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e339264-1667-472a-9988-82f8642c1319 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:36:26.659516 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e339264-1667-472a-9988-82f8642c1319 admin admin] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:36:26.659925 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e339264-1667-472a-9988-82f8642c1319 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:36:26.660401 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e339264-1667-472a-9988-82f8642c1319 admin admin] PATH_INFO: `/v3/users` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:36:26.661150 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e339264-1667-472a-9988-82f8642c1319 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:36:26.663357 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e339264-1667-472a-9988-82f8642c1319 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:36:26.667795 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c82221-de07-4c99-9244-8a0346f8a1a5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:36:26.669241 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c82221-de07-4c99-9244-8a0346f8a1a5 service neutron] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:36:26.680101 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1061/2080] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 10 05:36:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 05:36:26.685963 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1020/2081] 10.222.0.23 () {60 vars in 1143 bytes} [Tue May 10 05:36:26 2022] POST /identity/v3/users => generated 310 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 05:36:26.689987 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c82221-de07-4c99-9244-8a0346f8a1a5 service neutron] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:36:26.701275 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c82221-de07-4c99-9244-8a0346f8a1a5 service neutron] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:36:26.707672 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f6eee3-3c9c-4b59-8882-a3dc8b46fb94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:36:26.708377 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f6eee3-3c9c-4b59-8882-a3dc8b46fb94 admin admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:36:26.708792 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f6eee3-3c9c-4b59-8882-a3dc8b46fb94 admin admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:36:26.709168 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f6eee3-3c9c-4b59-8882-a3dc8b46fb94 admin admin] PATH_INFO: `/v3/roles` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:36:26.710011 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f6eee3-3c9c-4b59-8882-a3dc8b46fb94 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:36:26.711726 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f6eee3-3c9c-4b59-8882-a3dc8b46fb94 admin admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:36:26.729873 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1062/2082] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 10 05:36:26 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 05:36:26.730791 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e339264-1667-472a-9988-82f8642c1319 admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:36:26.741736 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e339264-1667-472a-9988-82f8642c1319 admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:36:26.746842 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86af2041-53c2-4ae7-82e7-c017e5213780 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:36:26.748087 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86af2041-53c2-4ae7-82e7-c017e5213780 admin admin] REQUEST_METHOD: `PUT` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:36:26.748372 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86af2041-53c2-4ae7-82e7-c017e5213780 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:36:26.748659 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86af2041-53c2-4ae7-82e7-c017e5213780 admin admin] PATH_INFO: `/v3/projects/7a4ec1dbe6ae43bfb69888bd675b3fbf/users/52e64239e5d34b379b6f698d7b7de529/roles/199ac1dd842441d7913c6ee89d8fbecc` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:36:26.766439 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86af2041-53c2-4ae7-82e7-c017e5213780 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7a4ec1dbe6ae43bfb69888bd675b3fbf, user_id=52e64239e5d34b379b6f698d7b7de529, role_id=199ac1dd842441d7913c6ee89d8fbecc)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:36:26.769294 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86af2041-53c2-4ae7-82e7-c017e5213780 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:36:26.790668 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1021/2083] 10.222.0.23 () {60 vars in 1482 bytes} [Tue May 10 05:36:26 2022] PUT /identity/v3/projects/7a4ec1dbe6ae43bfb69888bd675b3fbf/users/52e64239e5d34b379b6f698d7b7de529/roles/199ac1dd842441d7913c6ee89d8fbecc => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 05:36:26.792959 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f6eee3-3c9c-4b59-8882-a3dc8b46fb94 admin admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:36:26.807414 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f6eee3-3c9c-4b59-8882-a3dc8b46fb94 admin admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:36:26.880440 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50a19b8-dcf1-431f-8ae5-5daeb7a08d4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:36:26.881126 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50a19b8-dcf1-431f-8ae5-5daeb7a08d4f admin admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:36:26.881408 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50a19b8-dcf1-431f-8ae5-5daeb7a08d4f admin admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:36:26.881683 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50a19b8-dcf1-431f-8ae5-5daeb7a08d4f admin admin] PATH_INFO: `/v3/roles` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:36:26.882710 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50a19b8-dcf1-431f-8ae5-5daeb7a08d4f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:36:26.884335 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50a19b8-dcf1-431f-8ae5-5daeb7a08d4f admin admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:36:26.895674 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1063/2084] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 10 05:36:26 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 05:36:26.899855 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86af2041-53c2-4ae7-82e7-c017e5213780 admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:36:26.910956 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86af2041-53c2-4ae7-82e7-c017e5213780 admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:36:26.918383 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29037f94-9c3a-4f2d-9aba-d0f7045dd716 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:36:26.919436 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29037f94-9c3a-4f2d-9aba-d0f7045dd716 admin admin] REQUEST_METHOD: `PUT` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:36:26.919758 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29037f94-9c3a-4f2d-9aba-d0f7045dd716 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:36:26.920078 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29037f94-9c3a-4f2d-9aba-d0f7045dd716 admin admin] PATH_INFO: `/v3/projects/7a4ec1dbe6ae43bfb69888bd675b3fbf/users/52e64239e5d34b379b6f698d7b7de529/roles/199ac1dd842441d7913c6ee89d8fbecc` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:36:26.922103 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29037f94-9c3a-4f2d-9aba-d0f7045dd716 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7a4ec1dbe6ae43bfb69888bd675b3fbf, user_id=52e64239e5d34b379b6f698d7b7de529, role_id=199ac1dd842441d7913c6ee89d8fbecc)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:36:26.924808 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29037f94-9c3a-4f2d-9aba-d0f7045dd716 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:36:26.937769 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1022/2085] 10.222.0.23 () {60 vars in 1482 bytes} [Tue May 10 05:36:26 2022] PUT /identity/v3/projects/7a4ec1dbe6ae43bfb69888bd675b3fbf/users/52e64239e5d34b379b6f698d7b7de529/roles/199ac1dd842441d7913c6ee89d8fbecc => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 05:36:26.949134 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4a8ad5-933e-4a6a-b789-d46be3f2e46b None None] REQUEST_METHOD: `POST` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:36:26.949882 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4a8ad5-933e-4a6a-b789-d46be3f2e46b None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:36:26.950546 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4a8ad5-933e-4a6a-b789-d46be3f2e46b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:36:26.984485 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.auth.core [None req-0c4a8ad5-933e-4a6a-b789-d46be3f2e46b None None] MFA Rules not processed for user `52e64239e5d34b379b6f698d7b7de529`. Rule list: `[]` (Enabled: `True`). {{(pid=79879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:36:26.986355 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-0c4a8ad5-933e-4a6a-b789-d46be3f2e46b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:36:26.999081 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29037f94-9c3a-4f2d-9aba-d0f7045dd716 admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:36:27.001593 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-29037f94-9c3a-4f2d-9aba-d0f7045dd716 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:36:27.083623 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1064/2086] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 10 05:36:26 2022] POST /identity/v3/auth/tokens => generated 3341 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 05:36:27.089816 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4a8ad5-933e-4a6a-b789-d46be3f2e46b None None] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:36:27.092461 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-0c4a8ad5-933e-4a6a-b789-d46be3f2e46b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:36:27.092882 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29037f94-9c3a-4f2d-9aba-d0f7045dd716 admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:36:27.098522 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683f7e82-9c5c-4217-9eb7-976b5e2a0933 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:36:27.099870 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683f7e82-9c5c-4217-9eb7-976b5e2a0933 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:36:27.100266 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683f7e82-9c5c-4217-9eb7-976b5e2a0933 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:36:27.100769 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683f7e82-9c5c-4217-9eb7-976b5e2a0933 admin admin] PATH_INFO: `/v3/projects/1e013ced58534990acf659d445ccbcec` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:36:27.102731 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683f7e82-9c5c-4217-9eb7-976b5e2a0933 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1e013ced58534990acf659d445ccbcec)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:36:27.105121 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683f7e82-9c5c-4217-9eb7-976b5e2a0933 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:36:27.113285 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4a8ad5-933e-4a6a-b789-d46be3f2e46b None None] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:36:27.119719 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8af571-38ef-43bb-a99c-fc19a6116f29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:36:27.120602 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8af571-38ef-43bb-a99c-fc19a6116f29 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:36:27.120885 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8af571-38ef-43bb-a99c-fc19a6116f29 admin admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:36:27.121159 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8af571-38ef-43bb-a99c-fc19a6116f29 admin admin] PATH_INFO: `/v3/projects/7acc301c90b848e69cdcb6c34b9d640d` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:36:27.122372 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8af571-38ef-43bb-a99c-fc19a6116f29 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7acc301c90b848e69cdcb6c34b9d640d)` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:36:27.124828 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8af571-38ef-43bb-a99c-fc19a6116f29 admin admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:36:27.162655 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-683f7e82-9c5c-4217-9eb7-976b5e2a0933 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1e013ced58534990acf659d445ccbcec', 'request_id': 'req-683f7e82-9c5c-4217-9eb7-976b5e2a0933'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:36:27.171703 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-683f7e82-9c5c-4217-9eb7-976b5e2a0933 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1e013ced58534990acf659d445ccbcec', 'request_id': 'req-683f7e82-9c5c-4217-9eb7-976b5e2a0933'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:36:27.183716 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-683f7e82-9c5c-4217-9eb7-976b5e2a0933 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1e013ced58534990acf659d445ccbcec', 'request_id': 'req-683f7e82-9c5c-4217-9eb7-976b5e2a0933'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:36:27.199666 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-683f7e82-9c5c-4217-9eb7-976b5e2a0933 admin admin] The token cache is being invalidate because project 1e013ced58534990acf659d445ccbcec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79880) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 05:36:27.199999 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-683f7e82-9c5c-4217-9eb7-976b5e2a0933 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:36:27.200761 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-683f7e82-9c5c-4217-9eb7-976b5e2a0933 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:36:27.205263 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1023/2087] 10.222.0.23 () {58 vars in 1232 bytes} [Tue May 10 05:36:26 2022] DELETE /identity/v3/projects/1e013ced58534990acf659d445ccbcec => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 05:36:27.205263 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683f7e82-9c5c-4217-9eb7-976b5e2a0933 admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:36:27.206557 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-683f7e82-9c5c-4217-9eb7-976b5e2a0933 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:36:27.216402 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-7e8af571-38ef-43bb-a99c-fc19a6116f29 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7acc301c90b848e69cdcb6c34b9d640d', 'request_id': 'req-7e8af571-38ef-43bb-a99c-fc19a6116f29'} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:36:27.225595 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-7e8af571-38ef-43bb-a99c-fc19a6116f29 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7acc301c90b848e69cdcb6c34b9d640d', 'request_id': 'req-7e8af571-38ef-43bb-a99c-fc19a6116f29'} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:36:27.235178 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-7e8af571-38ef-43bb-a99c-fc19a6116f29 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7acc301c90b848e69cdcb6c34b9d640d', 'request_id': 'req-7e8af571-38ef-43bb-a99c-fc19a6116f29'} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:36:27.250262 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-7e8af571-38ef-43bb-a99c-fc19a6116f29 admin admin] The token cache is being invalidate because project 7acc301c90b848e69cdcb6c34b9d640d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79879) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 05:36:27.250742 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-7e8af571-38ef-43bb-a99c-fc19a6116f29 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:36:27.251608 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-7e8af571-38ef-43bb-a99c-fc19a6116f29 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:36:27.253172 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1065/2088] 10.222.0.23 () {58 vars in 1232 bytes} [Tue May 10 05:36:27 2022] DELETE /identity/v3/projects/7acc301c90b848e69cdcb6c34b9d640d => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 05:36:27.255745 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8af571-38ef-43bb-a99c-fc19a6116f29 admin admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:36:27.255745 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-7e8af571-38ef-43bb-a99c-fc19a6116f29 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:36:27.269172 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683f7e82-9c5c-4217-9eb7-976b5e2a0933 admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:36:27.318898 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e9d9b4-603a-48f6-8f86-131143ce8382 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355be413675540a39ccb00e1a0722316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f23435f783540199d6dcfd0417c090e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:36:27.319596 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e9d9b4-603a-48f6-8f86-131143ce8382 service cinder] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:36:27.319895 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e9d9b4-603a-48f6-8f86-131143ce8382 service cinder] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:36:27.320173 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e9d9b4-603a-48f6-8f86-131143ce8382 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:36:27.322007 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-14e9d9b4-603a-48f6-8f86-131143ce8382 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:36:27.328515 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8af571-38ef-43bb-a99c-fc19a6116f29 admin admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:36:27.333480 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88513420-10b0-43dd-8a90-b43f73988eca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:36:27.334558 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88513420-10b0-43dd-8a90-b43f73988eca admin admin] REQUEST_METHOD: `DELETE` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:36:27.334843 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88513420-10b0-43dd-8a90-b43f73988eca admin admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:36:27.335116 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88513420-10b0-43dd-8a90-b43f73988eca admin admin] PATH_INFO: `/v3/users/66ff3ca03f254ac6bd8da5632c5f446d` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:36:27.336358 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88513420-10b0-43dd-8a90-b43f73988eca admin admin] RBAC: Authorizing `identity:delete_user(user_id=66ff3ca03f254ac6bd8da5632c5f446d)` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:36:27.338299 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88513420-10b0-43dd-8a90-b43f73988eca admin admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:36:27.388704 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-88513420-10b0-43dd-8a90-b43f73988eca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '66ff3ca03f254ac6bd8da5632c5f446d'} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:36:27.389324 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e9d9b4-603a-48f6-8f86-131143ce8382 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:36:27.391237 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e9d9b4-603a-48f6-8f86-131143ce8382 service cinder] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:36:27.397486 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-88513420-10b0-43dd-8a90-b43f73988eca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '66ff3ca03f254ac6bd8da5632c5f446d'} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:36:27.398273 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-88513420-10b0-43dd-8a90-b43f73988eca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '66ff3ca03f254ac6bd8da5632c5f446d'} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:36:27.402100 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1024/2089] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 10 05:36:27 2022] GET /identity/v3/auth/tokens => generated 3341 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 05:36:27.402738 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e9d9b4-603a-48f6-8f86-131143ce8382 service cinder] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:36:27.404824 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-14e9d9b4-603a-48f6-8f86-131143ce8382 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:36:27.412321 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-88513420-10b0-43dd-8a90-b43f73988eca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '66ff3ca03f254ac6bd8da5632c5f446d'} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:36:27.418516 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e9d9b4-603a-48f6-8f86-131143ce8382 service cinder] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:36:27.420608 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-88513420-10b0-43dd-8a90-b43f73988eca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '66ff3ca03f254ac6bd8da5632c5f446d'} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:36:27.424102 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dad44e6-6cb5-4c69-b0ec-ecdc95d9db1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:36:27.424988 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dad44e6-6cb5-4c69-b0ec-ecdc95d9db1d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:36:27.425472 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dad44e6-6cb5-4c69-b0ec-ecdc95d9db1d admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:36:27.425671 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dad44e6-6cb5-4c69-b0ec-ecdc95d9db1d admin admin] PATH_INFO: `/v3/users/22050b75444449f2a2f70b1972a7d9f7` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:36:27.426985 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dad44e6-6cb5-4c69-b0ec-ecdc95d9db1d admin admin] RBAC: Authorizing `identity:delete_user(user_id=22050b75444449f2a2f70b1972a7d9f7)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:36:27.428378 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1066/2090] 10.222.0.23 () {58 vars in 1223 bytes} [Tue May 10 05:36:27 2022] DELETE /identity/v3/users/66ff3ca03f254ac6bd8da5632c5f446d => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 05:36:27.429303 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dad44e6-6cb5-4c69-b0ec-ecdc95d9db1d admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:36:27.505101 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-6dad44e6-6cb5-4c69-b0ec-ecdc95d9db1d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '22050b75444449f2a2f70b1972a7d9f7'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:36:27.523177 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-6dad44e6-6cb5-4c69-b0ec-ecdc95d9db1d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '22050b75444449f2a2f70b1972a7d9f7'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:36:27.524013 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-6dad44e6-6cb5-4c69-b0ec-ecdc95d9db1d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '22050b75444449f2a2f70b1972a7d9f7'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:36:27.533442 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-6dad44e6-6cb5-4c69-b0ec-ecdc95d9db1d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '22050b75444449f2a2f70b1972a7d9f7'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:36:27.534241 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-6dad44e6-6cb5-4c69-b0ec-ecdc95d9db1d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '22050b75444449f2a2f70b1972a7d9f7'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:36:27.557048 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1025/2091] 10.222.0.23 () {58 vars in 1223 bytes} [Tue May 10 05:36:27 2022] DELETE /identity/v3/users/22050b75444449f2a2f70b1972a7d9f7 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 05:36:27.600742 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88513420-10b0-43dd-8a90-b43f73988eca admin admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:36:27.602180 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-88513420-10b0-43dd-8a90-b43f73988eca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:36:27.748505 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88513420-10b0-43dd-8a90-b43f73988eca admin admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:36:27.878807 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d432f4-258f-47e3-84ec-a6625b43cbaa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355be413675540a39ccb00e1a0722316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f23435f783540199d6dcfd0417c090e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:36:27.879889 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d432f4-258f-47e3-84ec-a6625b43cbaa service cinder] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:36:27.880182 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d432f4-258f-47e3-84ec-a6625b43cbaa service cinder] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:36:27.880459 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d432f4-258f-47e3-84ec-a6625b43cbaa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:36:27.883273 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-91d432f4-258f-47e3-84ec-a6625b43cbaa service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:36:27.896102 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dad44e6-6cb5-4c69-b0ec-ecdc95d9db1d admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:36:27.898739 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-6dad44e6-6cb5-4c69-b0ec-ecdc95d9db1d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:36:28.031181 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d432f4-258f-47e3-84ec-a6625b43cbaa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:36:28.036413 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d432f4-258f-47e3-84ec-a6625b43cbaa service cinder] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:36:28.049991 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1067/2092] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 10 05:36:27 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 450 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 05:36:28.051552 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d432f4-258f-47e3-84ec-a6625b43cbaa service cinder] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:36:28.053331 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-91d432f4-258f-47e3-84ec-a6625b43cbaa service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:36:28.059681 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dad44e6-6cb5-4c69-b0ec-ecdc95d9db1d admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:36:28.065642 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713d2123-c44f-4cd5-bfb3-2a4e80e2db1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:36:28.066765 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713d2123-c44f-4cd5-bfb3-2a4e80e2db1f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:36:28.067364 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713d2123-c44f-4cd5-bfb3-2a4e80e2db1f admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:36:28.068395 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713d2123-c44f-4cd5-bfb3-2a4e80e2db1f admin admin] PATH_INFO: `/v3/projects/8d68f6a5147645a9a8f017ee33a50196` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:36:28.069996 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d432f4-258f-47e3-84ec-a6625b43cbaa service cinder] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:36:28.071298 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713d2123-c44f-4cd5-bfb3-2a4e80e2db1f admin admin] RBAC: Authorizing `identity:delete_project(project_id=8d68f6a5147645a9a8f017ee33a50196)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:36:28.073866 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713d2123-c44f-4cd5-bfb3-2a4e80e2db1f admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:36:28.075320 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff54fdb-6d40-4ac0-ab79-68d4e59f5477 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:36:28.077481 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff54fdb-6d40-4ac0-ab79-68d4e59f5477 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:36:28.077935 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff54fdb-6d40-4ac0-ab79-68d4e59f5477 admin admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:36:28.078348 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff54fdb-6d40-4ac0-ab79-68d4e59f5477 admin admin] PATH_INFO: `/v3/projects/09fe6e84ef6f48cf9f8bb30b7b66dcc2` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:36:28.079691 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff54fdb-6d40-4ac0-ab79-68d4e59f5477 admin admin] RBAC: Authorizing `identity:delete_project(project_id=09fe6e84ef6f48cf9f8bb30b7b66dcc2)` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:36:28.082279 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff54fdb-6d40-4ac0-ab79-68d4e59f5477 admin admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:36:28.137329 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-713d2123-c44f-4cd5-bfb3-2a4e80e2db1f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8d68f6a5147645a9a8f017ee33a50196', 'request_id': 'req-713d2123-c44f-4cd5-bfb3-2a4e80e2db1f'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:36:28.151424 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-8ff54fdb-6d40-4ac0-ab79-68d4e59f5477 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '09fe6e84ef6f48cf9f8bb30b7b66dcc2', 'request_id': 'req-8ff54fdb-6d40-4ac0-ab79-68d4e59f5477'} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:36:28.156777 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-713d2123-c44f-4cd5-bfb3-2a4e80e2db1f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8d68f6a5147645a9a8f017ee33a50196', 'request_id': 'req-713d2123-c44f-4cd5-bfb3-2a4e80e2db1f'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:36:28.159036 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-8ff54fdb-6d40-4ac0-ab79-68d4e59f5477 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '09fe6e84ef6f48cf9f8bb30b7b66dcc2', 'request_id': 'req-8ff54fdb-6d40-4ac0-ab79-68d4e59f5477'} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:36:28.170160 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-8ff54fdb-6d40-4ac0-ab79-68d4e59f5477 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '09fe6e84ef6f48cf9f8bb30b7b66dcc2', 'request_id': 'req-8ff54fdb-6d40-4ac0-ab79-68d4e59f5477'} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:36:28.180566 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-713d2123-c44f-4cd5-bfb3-2a4e80e2db1f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8d68f6a5147645a9a8f017ee33a50196', 'request_id': 'req-713d2123-c44f-4cd5-bfb3-2a4e80e2db1f'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:36:28.183542 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-8ff54fdb-6d40-4ac0-ab79-68d4e59f5477 admin admin] The token cache is being invalidate because project 09fe6e84ef6f48cf9f8bb30b7b66dcc2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79879) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 05:36:28.184364 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-8ff54fdb-6d40-4ac0-ab79-68d4e59f5477 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:36:28.185548 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-8ff54fdb-6d40-4ac0-ab79-68d4e59f5477 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:36:28.188910 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1068/2093] 10.222.0.23 () {58 vars in 1232 bytes} [Tue May 10 05:36:28 2022] DELETE /identity/v3/projects/09fe6e84ef6f48cf9f8bb30b7b66dcc2 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 05:36:28.202108 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-713d2123-c44f-4cd5-bfb3-2a4e80e2db1f admin admin] The token cache is being invalidate because project 8d68f6a5147645a9a8f017ee33a50196 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79880) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 05:36:28.202404 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-713d2123-c44f-4cd5-bfb3-2a4e80e2db1f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:36:28.203058 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-713d2123-c44f-4cd5-bfb3-2a4e80e2db1f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:36:28.205162 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1026/2094] 10.222.0.23 () {58 vars in 1232 bytes} [Tue May 10 05:36:27 2022] DELETE /identity/v3/projects/8d68f6a5147645a9a8f017ee33a50196 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 05:36:28.212521 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3d5cda-f461-40cf-8e56-5a941f147c74 None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:36:28.213201 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3d5cda-f461-40cf-8e56-5a941f147c74 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:36:28.214114 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3d5cda-f461-40cf-8e56-5a941f147c74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:36:28.216851 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba79e4f-15d6-4f4d-b58c-29d2a4154efe None None] REQUEST_METHOD: `POST` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:36:28.219116 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba79e4f-15d6-4f4d-b58c-29d2a4154efe None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:36:28.220091 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba79e4f-15d6-4f4d-b58c-29d2a4154efe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:36:28.264543 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-ec3d5cda-f461-40cf-8e56-5a941f147c74 None None] MFA Rules not processed for user `44883b22532e44049d846938dc2cf423`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:36:28.268285 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-ec3d5cda-f461-40cf-8e56-5a941f147c74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:36:28.269447 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.auth.core [None req-2ba79e4f-15d6-4f4d-b58c-29d2a4154efe None None] MFA Rules not processed for user `44883b22532e44049d846938dc2cf423`. Rule list: `[]` (Enabled: `True`). {{(pid=79879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:36:28.273062 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-2ba79e4f-15d6-4f4d-b58c-29d2a4154efe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:36:28.425692 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1027/2095] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 10 05:36:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 05:36:28.432653 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e8eaf9-cbdd-4bc3-9fcb-92589f09858c None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:36:28.433161 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e8eaf9-cbdd-4bc3-9fcb-92589f09858c None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:36:28.434081 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e8eaf9-cbdd-4bc3-9fcb-92589f09858c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:36:28.443108 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1069/2096] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 10 05:36:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 05:36:28.445767 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e224e4ca-c6a0-4e2b-9314-781c1d71836f None None] REQUEST_METHOD: `POST` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:36:28.446247 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e224e4ca-c6a0-4e2b-9314-781c1d71836f None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:36:28.446586 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e224e4ca-c6a0-4e2b-9314-781c1d71836f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:36:28.462483 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-64e8eaf9-cbdd-4bc3-9fcb-92589f09858c None None] MFA Rules not processed for user `44883b22532e44049d846938dc2cf423`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:36:28.475627 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-64e8eaf9-cbdd-4bc3-9fcb-92589f09858c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:36:28.498317 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.auth.core [None req-e224e4ca-c6a0-4e2b-9314-781c1d71836f None None] MFA Rules not processed for user `44883b22532e44049d846938dc2cf423`. Rule list: `[]` (Enabled: `True`). {{(pid=79879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:36:28.498317 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-e224e4ca-c6a0-4e2b-9314-781c1d71836f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:36:28.499990 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1028/2097] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 10 05:36:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 05:36:28.501680 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e8eaf9-cbdd-4bc3-9fcb-92589f09858c None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:36:28.513298 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e8eaf9-cbdd-4bc3-9fcb-92589f09858c None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:36:28.516469 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1070/2098] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 10 05:36:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 05:36:28.519024 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e224e4ca-c6a0-4e2b-9314-781c1d71836f None None] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:36:28.524327 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84d556b-4bdc-43d7-b239-5db97b019d75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:36:28.525349 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84d556b-4bdc-43d7-b239-5db97b019d75 admin admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:36:28.525638 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84d556b-4bdc-43d7-b239-5db97b019d75 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:36:28.525905 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84d556b-4bdc-43d7-b239-5db97b019d75 admin admin] PATH_INFO: `/v3/domains` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:36:28.526724 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84d556b-4bdc-43d7-b239-5db97b019d75 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:36:28.527067 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84d556b-4bdc-43d7-b239-5db97b019d75 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:36:28.529068 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84d556b-4bdc-43d7-b239-5db97b019d75 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:36:28.543630 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1029/2099] 10.222.0.23 () {58 vars in 1152 bytes} [Tue May 10 05:36:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:36:28.548631 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84d556b-4bdc-43d7-b239-5db97b019d75 admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:36:28.550896 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e224e4ca-c6a0-4e2b-9314-781c1d71836f None None] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:36:28.562256 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08063a0-0667-4f1f-95df-ec7f744fea42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:36:28.564372 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08063a0-0667-4f1f-95df-ec7f744fea42 admin admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:36:28.564654 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08063a0-0667-4f1f-95df-ec7f744fea42 admin admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:36:28.564929 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08063a0-0667-4f1f-95df-ec7f744fea42 admin admin] PATH_INFO: `/v3/domains` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:36:28.565672 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08063a0-0667-4f1f-95df-ec7f744fea42 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:36:28.565987 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08063a0-0667-4f1f-95df-ec7f744fea42 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:36:28.568068 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08063a0-0667-4f1f-95df-ec7f744fea42 admin admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:36:28.569431 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84d556b-4bdc-43d7-b239-5db97b019d75 admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:36:28.582216 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692ed2e0-acff-46b3-8a16-ef85a3c62523 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:36:28.582885 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692ed2e0-acff-46b3-8a16-ef85a3c62523 admin admin] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:36:28.583161 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692ed2e0-acff-46b3-8a16-ef85a3c62523 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:36:28.583428 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692ed2e0-acff-46b3-8a16-ef85a3c62523 admin admin] PATH_INFO: `/v3/projects` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:36:28.585854 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692ed2e0-acff-46b3-8a16-ef85a3c62523 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:36:28.588894 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692ed2e0-acff-46b3-8a16-ef85a3c62523 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:36:28.594033 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1071/2100] 10.222.0.23 () {58 vars in 1152 bytes} [Tue May 10 05:36:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:36:28.597231 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08063a0-0667-4f1f-95df-ec7f744fea42 admin admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:36:28.615747 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08063a0-0667-4f1f-95df-ec7f744fea42 admin admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:36:28.623286 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46184c4-18eb-40df-844e-688a852c2fbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:36:28.624394 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46184c4-18eb-40df-844e-688a852c2fbb admin admin] REQUEST_METHOD: `POST` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:36:28.624928 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46184c4-18eb-40df-844e-688a852c2fbb admin admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:36:28.625506 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46184c4-18eb-40df-844e-688a852c2fbb admin admin] PATH_INFO: `/v3/projects` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:36:28.626410 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46184c4-18eb-40df-844e-688a852c2fbb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:36:28.634554 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46184c4-18eb-40df-844e-688a852c2fbb admin admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:36:28.638970 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1030/2101] 10.222.0.23 () {60 vars in 1152 bytes} [Tue May 10 05:36:28 2022] POST /identity/v3/projects => generated 373 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 05:36:28.640558 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692ed2e0-acff-46b3-8a16-ef85a3c62523 admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:36:28.682783 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1072/2102] 10.222.0.23 () {60 vars in 1152 bytes} [Tue May 10 05:36:28 2022] POST /identity/v3/projects => generated 385 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 05:36:28.686859 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46184c4-18eb-40df-844e-688a852c2fbb admin admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:36:28.733632 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692ed2e0-acff-46b3-8a16-ef85a3c62523 admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:36:28.775442 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46184c4-18eb-40df-844e-688a852c2fbb admin admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:36:28.784319 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5320754-08f7-435e-a042-868d4aa5e768 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:36:28.785032 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5320754-08f7-435e-a042-868d4aa5e768 admin admin] REQUEST_METHOD: `POST` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:36:28.785307 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5320754-08f7-435e-a042-868d4aa5e768 admin admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:36:28.785573 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5320754-08f7-435e-a042-868d4aa5e768 admin admin] PATH_INFO: `/v3/users` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:36:28.786270 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5320754-08f7-435e-a042-868d4aa5e768 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:36:28.788260 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5320754-08f7-435e-a042-868d4aa5e768 admin admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:36:28.798580 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a397d92-100a-4c88-a411-33e715f21817 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:36:28.799482 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a397d92-100a-4c88-a411-33e715f21817 admin admin] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:36:28.799970 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a397d92-100a-4c88-a411-33e715f21817 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:36:28.800230 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a397d92-100a-4c88-a411-33e715f21817 admin admin] PATH_INFO: `/v3/users` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:36:28.801099 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a397d92-100a-4c88-a411-33e715f21817 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:36:28.803419 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a397d92-100a-4c88-a411-33e715f21817 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:36:28.819914 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1073/2103] 10.222.0.23 () {60 vars in 1143 bytes} [Tue May 10 05:36:28 2022] POST /identity/v3/users => generated 293 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 05:36:28.821048 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5320754-08f7-435e-a042-868d4aa5e768 admin admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:36:28.829207 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1031/2104] 10.222.0.23 () {60 vars in 1143 bytes} [Tue May 10 05:36:28 2022] POST /identity/v3/users => generated 287 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 05:36:28.832001 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5320754-08f7-435e-a042-868d4aa5e768 admin admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:36:28.833413 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a397d92-100a-4c88-a411-33e715f21817 admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:36:28.837098 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb49f758-0b15-422a-a9f0-3ab49147d99e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:36:28.837851 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb49f758-0b15-422a-a9f0-3ab49147d99e admin admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:36:28.838161 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb49f758-0b15-422a-a9f0-3ab49147d99e admin admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:36:28.838527 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb49f758-0b15-422a-a9f0-3ab49147d99e admin admin] PATH_INFO: `/v3/roles` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:36:28.839328 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb49f758-0b15-422a-a9f0-3ab49147d99e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:36:28.841646 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb49f758-0b15-422a-a9f0-3ab49147d99e admin admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:36:28.846100 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a397d92-100a-4c88-a411-33e715f21817 admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:36:28.852897 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8b03f3-a9f4-4afb-a8bd-a8ff845c4417 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:36:28.854144 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8b03f3-a9f4-4afb-a8bd-a8ff845c4417 admin admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:36:28.854527 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8b03f3-a9f4-4afb-a8bd-a8ff845c4417 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:36:28.854702 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8b03f3-a9f4-4afb-a8bd-a8ff845c4417 admin admin] PATH_INFO: `/v3/roles` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:36:28.855611 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8b03f3-a9f4-4afb-a8bd-a8ff845c4417 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:36:28.857544 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8b03f3-a9f4-4afb-a8bd-a8ff845c4417 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:36:28.859664 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1074/2105] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 10 05:36:28 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 05:36:28.860929 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb49f758-0b15-422a-a9f0-3ab49147d99e admin admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:36:28.875409 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1032/2106] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 10 05:36:28 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 05:36:28.878440 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb49f758-0b15-422a-a9f0-3ab49147d99e admin admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:36:28.880318 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8b03f3-a9f4-4afb-a8bd-a8ff845c4417 admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:36:28.884366 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0e9734-5a42-4bc2-a525-d8df86dbc8cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:36:28.885053 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0e9734-5a42-4bc2-a525-d8df86dbc8cf admin admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:36:28.885476 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0e9734-5a42-4bc2-a525-d8df86dbc8cf admin admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:36:28.885574 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0e9734-5a42-4bc2-a525-d8df86dbc8cf admin admin] PATH_INFO: `/v3/roles` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:36:28.887157 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0e9734-5a42-4bc2-a525-d8df86dbc8cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:36:28.889215 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0e9734-5a42-4bc2-a525-d8df86dbc8cf admin admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:36:28.891341 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8b03f3-a9f4-4afb-a8bd-a8ff845c4417 admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:36:28.896949 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e713dc-aa7d-4fdc-8caf-ca8fd8f2f2ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:36:28.897831 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e713dc-aa7d-4fdc-8caf-ca8fd8f2f2ea admin admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:36:28.898120 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e713dc-aa7d-4fdc-8caf-ca8fd8f2f2ea admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:36:28.898783 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e713dc-aa7d-4fdc-8caf-ca8fd8f2f2ea admin admin] PATH_INFO: `/v3/roles` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:36:28.899758 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e713dc-aa7d-4fdc-8caf-ca8fd8f2f2ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:36:28.901574 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e713dc-aa7d-4fdc-8caf-ca8fd8f2f2ea admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:36:28.903209 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1075/2107] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 10 05:36:28 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 05:36:28.907240 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0e9734-5a42-4bc2-a525-d8df86dbc8cf admin admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:36:28.916767 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1033/2108] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 10 05:36:28 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 05:36:28.920929 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e713dc-aa7d-4fdc-8caf-ca8fd8f2f2ea admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:36:28.923442 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0e9734-5a42-4bc2-a525-d8df86dbc8cf admin admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:36:28.928729 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bb40d1-8435-454d-bc22-d7c962c20074 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:36:28.930525 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bb40d1-8435-454d-bc22-d7c962c20074 admin admin] REQUEST_METHOD: `PUT` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:36:28.930874 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bb40d1-8435-454d-bc22-d7c962c20074 admin admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:36:28.931218 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bb40d1-8435-454d-bc22-d7c962c20074 admin admin] PATH_INFO: `/v3/projects/3c8101b24f874a16a871a2c0e08ef875/users/cb690b39040340ef96b70974678fb620/roles/382636e67fc142a2b2f486340d959e11` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:36:28.932155 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e713dc-aa7d-4fdc-8caf-ca8fd8f2f2ea admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:36:28.936840 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b6ac9d-4a01-4976-b2a1-b28640c8829f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:36:28.937885 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b6ac9d-4a01-4976-b2a1-b28640c8829f admin admin] REQUEST_METHOD: `PUT` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:36:28.938343 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b6ac9d-4a01-4976-b2a1-b28640c8829f admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:36:28.938755 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b6ac9d-4a01-4976-b2a1-b28640c8829f admin admin] PATH_INFO: `/v3/projects/599e9fb651f741219891085a25cb30a1/users/cac0ba2a9fa9448f98e80cc38462758e/roles/382636e67fc142a2b2f486340d959e11` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:36:28.956391 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46bb40d1-8435-454d-bc22-d7c962c20074 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3c8101b24f874a16a871a2c0e08ef875, user_id=cb690b39040340ef96b70974678fb620, role_id=382636e67fc142a2b2f486340d959e11)` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:36:28.958578 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b6ac9d-4a01-4976-b2a1-b28640c8829f admin admin] RBAC: Authorizing `identity:create_grant(project_id=599e9fb651f741219891085a25cb30a1, user_id=cac0ba2a9fa9448f98e80cc38462758e, role_id=382636e67fc142a2b2f486340d959e11)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:36:28.959764 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46bb40d1-8435-454d-bc22-d7c962c20074 admin admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:36:28.961314 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b6ac9d-4a01-4976-b2a1-b28640c8829f admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:36:28.975116 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1076/2109] 10.222.0.23 () {60 vars in 1482 bytes} [Tue May 10 05:36:28 2022] PUT /identity/v3/projects/3c8101b24f874a16a871a2c0e08ef875/users/cb690b39040340ef96b70974678fb620/roles/382636e67fc142a2b2f486340d959e11 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 05:36:28.976199 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1034/2110] 10.222.0.23 () {60 vars in 1482 bytes} [Tue May 10 05:36:28 2022] PUT /identity/v3/projects/599e9fb651f741219891085a25cb30a1/users/cac0ba2a9fa9448f98e80cc38462758e/roles/382636e67fc142a2b2f486340d959e11 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 05:36:28.986307 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2dbf90-8e1b-48b1-bd12-5aff4d572eda None None] REQUEST_METHOD: `POST` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:36:28.986596 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2dbf90-8e1b-48b1-bd12-5aff4d572eda None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:36:28.986872 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2dbf90-8e1b-48b1-bd12-5aff4d572eda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:36:28.987317 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3457e47-926b-4901-a53d-7367a774c19b None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:36:28.987639 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3457e47-926b-4901-a53d-7367a774c19b None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:36:28.988002 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3457e47-926b-4901-a53d-7367a774c19b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:36:29.016854 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-f3457e47-926b-4901-a53d-7367a774c19b None None] MFA Rules not processed for user `cb690b39040340ef96b70974678fb620`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:36:29.018112 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-f3457e47-926b-4901-a53d-7367a774c19b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:36:29.020658 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.auth.core [None req-eb2dbf90-8e1b-48b1-bd12-5aff4d572eda None None] MFA Rules not processed for user `cac0ba2a9fa9448f98e80cc38462758e`. Rule list: `[]` (Enabled: `True`). {{(pid=79879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:36:29.021962 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-eb2dbf90-8e1b-48b1-bd12-5aff4d572eda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:36:29.082676 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1035/2111] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 10 05:36:28 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 05:36:29.093388 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1077/2112] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 10 05:36:28 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 05:36:29.094364 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3457e47-926b-4901-a53d-7367a774c19b None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:36:29.095853 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-f3457e47-926b-4901-a53d-7367a774c19b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:36:29.101419 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2dbf90-8e1b-48b1-bd12-5aff4d572eda None None] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:36:29.102789 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-eb2dbf90-8e1b-48b1-bd12-5aff4d572eda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:36:29.160497 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3457e47-926b-4901-a53d-7367a774c19b None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:36:29.164673 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c55bbf-77a8-431a-a15e-f19b518f1f23 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355be413675540a39ccb00e1a0722316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f23435f783540199d6dcfd0417c090e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:36:29.164952 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c55bbf-77a8-431a-a15e-f19b518f1f23 service cinder] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:36:29.165240 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c55bbf-77a8-431a-a15e-f19b518f1f23 service cinder] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:36:29.165525 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c55bbf-77a8-431a-a15e-f19b518f1f23 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:36:29.172876 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2dbf90-8e1b-48b1-bd12-5aff4d572eda None None] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:36:29.175064 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c55bbf-77a8-431a-a15e-f19b518f1f23 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:36:29.176550 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c55bbf-77a8-431a-a15e-f19b518f1f23 service cinder] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:36:29.177089 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f49491-a1b6-4f33-b903-4048b0bc8fb5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355be413675540a39ccb00e1a0722316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f23435f783540199d6dcfd0417c090e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:36:29.177940 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f49491-a1b6-4f33-b903-4048b0bc8fb5 service cinder] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:36:29.178309 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f49491-a1b6-4f33-b903-4048b0bc8fb5 service cinder] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:36:29.178754 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f49491-a1b6-4f33-b903-4048b0bc8fb5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:36:29.186444 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1036/2113] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 10 05:36:29 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 05:36:29.189523 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f49491-a1b6-4f33-b903-4048b0bc8fb5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:36:29.190982 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f49491-a1b6-4f33-b903-4048b0bc8fb5 service cinder] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:36:29.200573 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1078/2114] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 10 05:36:29 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 05:36:37.569337 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c55bbf-77a8-431a-a15e-f19b518f1f23 service cinder] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:36:37.653131 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c55bbf-77a8-431a-a15e-f19b518f1f23 service cinder] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:36:37.657949 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5156558d-4be5-4768-a243-660b59228341 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:36:37.658961 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5156558d-4be5-4768-a243-660b59228341 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:36:37.659347 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5156558d-4be5-4768-a243-660b59228341 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:36:37.659699 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5156558d-4be5-4768-a243-660b59228341 admin admin] PATH_INFO: `/v3/users/cac0ba2a9fa9448f98e80cc38462758e` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:36:37.661058 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5156558d-4be5-4768-a243-660b59228341 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cac0ba2a9fa9448f98e80cc38462758e)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:36:37.663044 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5156558d-4be5-4768-a243-660b59228341 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:36:37.713583 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-5156558d-4be5-4768-a243-660b59228341 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cac0ba2a9fa9448f98e80cc38462758e'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:36:37.724996 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-5156558d-4be5-4768-a243-660b59228341 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cac0ba2a9fa9448f98e80cc38462758e'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:36:37.725685 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-5156558d-4be5-4768-a243-660b59228341 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cac0ba2a9fa9448f98e80cc38462758e'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:36:37.732935 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-5156558d-4be5-4768-a243-660b59228341 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cac0ba2a9fa9448f98e80cc38462758e'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:36:37.733578 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-5156558d-4be5-4768-a243-660b59228341 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cac0ba2a9fa9448f98e80cc38462758e'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:36:37.746697 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1037/2115] 10.222.0.23 () {58 vars in 1223 bytes} [Tue May 10 05:36:37 2022] DELETE /identity/v3/users/cac0ba2a9fa9448f98e80cc38462758e => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 05:36:37.752078 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24877a51-22be-43bb-9ca8-0f9a230320d0 None None] REQUEST_METHOD: `POST` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:36:37.752587 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24877a51-22be-43bb-9ca8-0f9a230320d0 None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:36:37.752679 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24877a51-22be-43bb-9ca8-0f9a230320d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:36:37.771332 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.auth.core [None req-24877a51-22be-43bb-9ca8-0f9a230320d0 None None] MFA Rules not processed for user `44883b22532e44049d846938dc2cf423`. Rule list: `[]` (Enabled: `True`). {{(pid=79879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:36:37.772590 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-24877a51-22be-43bb-9ca8-0f9a230320d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:36:37.832420 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1079/2116] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 10 05:36:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 05:36:37.842207 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5156558d-4be5-4768-a243-660b59228341 admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:36:37.844000 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-5156558d-4be5-4768-a243-660b59228341 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:36:37.905964 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5156558d-4be5-4768-a243-660b59228341 admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:36:37.910509 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fcd329-b001-4803-afc0-415771da4c2a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c8461cfdd9648b8abcaf8d34b7a102a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f23435f783540199d6dcfd0417c090e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:36:37.911163 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fcd329-b001-4803-afc0-415771da4c2a service neutron] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:36:37.911439 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fcd329-b001-4803-afc0-415771da4c2a service neutron] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:36:37.911742 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fcd329-b001-4803-afc0-415771da4c2a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:36:37.921707 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91fcd329-b001-4803-afc0-415771da4c2a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:36:37.923133 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91fcd329-b001-4803-afc0-415771da4c2a service neutron] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:36:37.932672 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1038/2117] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 10 05:36:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 05:36:38.197896 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24877a51-22be-43bb-9ca8-0f9a230320d0 None None] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:36:38.199350 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-24877a51-22be-43bb-9ca8-0f9a230320d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:36:38.214152 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24877a51-22be-43bb-9ca8-0f9a230320d0 None None] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:36:38.220600 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095bdb34-a588-480b-8cc7-d9f9664aa9f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:36:38.221396 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095bdb34-a588-480b-8cc7-d9f9664aa9f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:36:38.221617 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095bdb34-a588-480b-8cc7-d9f9664aa9f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:36:38.221872 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095bdb34-a588-480b-8cc7-d9f9664aa9f1 admin admin] PATH_INFO: `/v3/projects/599e9fb651f741219891085a25cb30a1` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:36:38.223201 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095bdb34-a588-480b-8cc7-d9f9664aa9f1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=599e9fb651f741219891085a25cb30a1)` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:36:38.225082 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095bdb34-a588-480b-8cc7-d9f9664aa9f1 admin admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:36:38.272265 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-095bdb34-a588-480b-8cc7-d9f9664aa9f1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '599e9fb651f741219891085a25cb30a1', 'request_id': 'req-095bdb34-a588-480b-8cc7-d9f9664aa9f1'} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:36:38.278274 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-095bdb34-a588-480b-8cc7-d9f9664aa9f1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '599e9fb651f741219891085a25cb30a1', 'request_id': 'req-095bdb34-a588-480b-8cc7-d9f9664aa9f1'} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:36:38.287884 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-095bdb34-a588-480b-8cc7-d9f9664aa9f1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '599e9fb651f741219891085a25cb30a1', 'request_id': 'req-095bdb34-a588-480b-8cc7-d9f9664aa9f1'} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:36:38.299491 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-095bdb34-a588-480b-8cc7-d9f9664aa9f1 admin admin] The token cache is being invalidate because project 599e9fb651f741219891085a25cb30a1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79879) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 05:36:38.299864 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-095bdb34-a588-480b-8cc7-d9f9664aa9f1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:36:38.300632 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-095bdb34-a588-480b-8cc7-d9f9664aa9f1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:36:38.302382 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1080/2118] 10.222.0.23 () {58 vars in 1232 bytes} [Tue May 10 05:36:38 2022] DELETE /identity/v3/projects/599e9fb651f741219891085a25cb30a1 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 05:36:38.644283 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fcd329-b001-4803-afc0-415771da4c2a service neutron] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:36:38.645985 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-91fcd329-b001-4803-afc0-415771da4c2a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:36:38.659659 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fcd329-b001-4803-afc0-415771da4c2a service neutron] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:36:38.717200 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c90fee-5c98-4d99-a323-76013f2e3328 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:36:38.718126 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c90fee-5c98-4d99-a323-76013f2e3328 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:36:38.718406 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c90fee-5c98-4d99-a323-76013f2e3328 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:36:38.718790 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c90fee-5c98-4d99-a323-76013f2e3328 admin admin] PATH_INFO: `/v3/users/6b700dc0be3a4aa1911a7fb976f00b91` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:36:38.720283 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c90fee-5c98-4d99-a323-76013f2e3328 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6b700dc0be3a4aa1911a7fb976f00b91)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:36:38.725677 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c90fee-5c98-4d99-a323-76013f2e3328 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:36:38.773448 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-02c90fee-5c98-4d99-a323-76013f2e3328 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6b700dc0be3a4aa1911a7fb976f00b91'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:36:38.784751 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-02c90fee-5c98-4d99-a323-76013f2e3328 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6b700dc0be3a4aa1911a7fb976f00b91'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:36:38.785435 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-02c90fee-5c98-4d99-a323-76013f2e3328 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6b700dc0be3a4aa1911a7fb976f00b91'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:36:38.791945 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-02c90fee-5c98-4d99-a323-76013f2e3328 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6b700dc0be3a4aa1911a7fb976f00b91'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:36:38.792643 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-02c90fee-5c98-4d99-a323-76013f2e3328 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6b700dc0be3a4aa1911a7fb976f00b91'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:36:38.806875 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1039/2119] 10.222.0.23 () {58 vars in 1223 bytes} [Tue May 10 05:36:38 2022] DELETE /identity/v3/users/6b700dc0be3a4aa1911a7fb976f00b91 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 05:36:38.811350 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba712a6a-4934-45af-8599-27cc15396d79 None None] REQUEST_METHOD: `POST` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:36:38.811843 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba712a6a-4934-45af-8599-27cc15396d79 None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:36:38.811959 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba712a6a-4934-45af-8599-27cc15396d79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:36:38.831098 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.auth.core [None req-ba712a6a-4934-45af-8599-27cc15396d79 None None] MFA Rules not processed for user `44883b22532e44049d846938dc2cf423`. Rule list: `[]` (Enabled: `True`). {{(pid=79879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:36:38.832487 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-ba712a6a-4934-45af-8599-27cc15396d79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:36:38.897104 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1081/2120] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 10 05:36:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 05:36:38.907068 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c90fee-5c98-4d99-a323-76013f2e3328 admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:36:38.908563 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-02c90fee-5c98-4d99-a323-76013f2e3328 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:36:38.966380 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c90fee-5c98-4d99-a323-76013f2e3328 admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:36:38.970369 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2612f95f-43ba-4fd3-a152-ee138f1237ad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c8461cfdd9648b8abcaf8d34b7a102a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f23435f783540199d6dcfd0417c090e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:36:38.971036 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2612f95f-43ba-4fd3-a152-ee138f1237ad service neutron] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:36:38.971472 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2612f95f-43ba-4fd3-a152-ee138f1237ad service neutron] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:36:38.971761 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2612f95f-43ba-4fd3-a152-ee138f1237ad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:36:38.981644 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2612f95f-43ba-4fd3-a152-ee138f1237ad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:36:38.983127 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2612f95f-43ba-4fd3-a152-ee138f1237ad service neutron] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:36:38.992591 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1040/2121] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 10 05:36:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 05:36:39.258985 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba712a6a-4934-45af-8599-27cc15396d79 None None] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:36:39.260979 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-ba712a6a-4934-45af-8599-27cc15396d79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:36:39.278892 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba712a6a-4934-45af-8599-27cc15396d79 None None] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:36:39.285019 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d89665-87d7-4bd2-9009-3590fd33fb8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:36:39.285888 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d89665-87d7-4bd2-9009-3590fd33fb8c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:36:39.286237 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d89665-87d7-4bd2-9009-3590fd33fb8c admin admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:36:39.286579 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d89665-87d7-4bd2-9009-3590fd33fb8c admin admin] PATH_INFO: `/v3/projects/1f1697b0f90c4ac7a6bc809dfe11537e` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:36:39.287991 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d89665-87d7-4bd2-9009-3590fd33fb8c admin admin] RBAC: Authorizing `identity:delete_project(project_id=1f1697b0f90c4ac7a6bc809dfe11537e)` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:36:39.290018 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d89665-87d7-4bd2-9009-3590fd33fb8c admin admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:36:39.336875 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-17d89665-87d7-4bd2-9009-3590fd33fb8c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1f1697b0f90c4ac7a6bc809dfe11537e', 'request_id': 'req-17d89665-87d7-4bd2-9009-3590fd33fb8c'} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:36:39.343302 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-17d89665-87d7-4bd2-9009-3590fd33fb8c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1f1697b0f90c4ac7a6bc809dfe11537e', 'request_id': 'req-17d89665-87d7-4bd2-9009-3590fd33fb8c'} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:36:39.352070 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-17d89665-87d7-4bd2-9009-3590fd33fb8c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1f1697b0f90c4ac7a6bc809dfe11537e', 'request_id': 'req-17d89665-87d7-4bd2-9009-3590fd33fb8c'} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:36:39.365061 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-17d89665-87d7-4bd2-9009-3590fd33fb8c admin admin] The token cache is being invalidate because project 1f1697b0f90c4ac7a6bc809dfe11537e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79879) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 05:36:39.365351 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-17d89665-87d7-4bd2-9009-3590fd33fb8c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:36:39.365998 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-17d89665-87d7-4bd2-9009-3590fd33fb8c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:36:39.367873 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1082/2122] 10.222.0.23 () {58 vars in 1232 bytes} [Tue May 10 05:36:39 2022] DELETE /identity/v3/projects/1f1697b0f90c4ac7a6bc809dfe11537e => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 05:36:39.371755 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2612f95f-43ba-4fd3-a152-ee138f1237ad service neutron] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:36:39.381693 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2612f95f-43ba-4fd3-a152-ee138f1237ad service neutron] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:36:39.436115 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73c4d39-a121-43f8-98d1-31030329e55f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:36:39.437031 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73c4d39-a121-43f8-98d1-31030329e55f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:36:39.437316 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73c4d39-a121-43f8-98d1-31030329e55f admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:36:39.437635 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73c4d39-a121-43f8-98d1-31030329e55f admin admin] PATH_INFO: `/v3/users/52e64239e5d34b379b6f698d7b7de529` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:36:39.439270 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73c4d39-a121-43f8-98d1-31030329e55f admin admin] RBAC: Authorizing `identity:delete_user(user_id=52e64239e5d34b379b6f698d7b7de529)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:36:39.441244 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73c4d39-a121-43f8-98d1-31030329e55f admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:36:39.499411 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-e73c4d39-a121-43f8-98d1-31030329e55f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '52e64239e5d34b379b6f698d7b7de529'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:36:39.513961 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-e73c4d39-a121-43f8-98d1-31030329e55f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '52e64239e5d34b379b6f698d7b7de529'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:36:39.514768 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-e73c4d39-a121-43f8-98d1-31030329e55f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '52e64239e5d34b379b6f698d7b7de529'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:36:39.521546 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-e73c4d39-a121-43f8-98d1-31030329e55f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '52e64239e5d34b379b6f698d7b7de529'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:36:39.522246 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-e73c4d39-a121-43f8-98d1-31030329e55f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '52e64239e5d34b379b6f698d7b7de529'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:36:39.536225 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1041/2123] 10.222.0.23 () {58 vars in 1223 bytes} [Tue May 10 05:36:39 2022] DELETE /identity/v3/users/52e64239e5d34b379b6f698d7b7de529 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 05:36:39.792129 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d89665-87d7-4bd2-9009-3590fd33fb8c admin admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:36:39.797394 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-17d89665-87d7-4bd2-9009-3590fd33fb8c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:36:39.813035 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d89665-87d7-4bd2-9009-3590fd33fb8c admin admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:36:39.813588 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73c4d39-a121-43f8-98d1-31030329e55f admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:36:39.815110 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-e73c4d39-a121-43f8-98d1-31030329e55f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:36:39.885905 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e79473d-72f6-4ae2-a448-1ed053d0a972 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:36:39.887216 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e79473d-72f6-4ae2-a448-1ed053d0a972 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:36:39.887494 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e79473d-72f6-4ae2-a448-1ed053d0a972 admin admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:36:39.887943 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e79473d-72f6-4ae2-a448-1ed053d0a972 admin admin] PATH_INFO: `/v3/users/cb690b39040340ef96b70974678fb620` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:36:39.889242 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e79473d-72f6-4ae2-a448-1ed053d0a972 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cb690b39040340ef96b70974678fb620)` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:36:39.891489 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e79473d-72f6-4ae2-a448-1ed053d0a972 admin admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:36:39.937649 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73c4d39-a121-43f8-98d1-31030329e55f admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:36:39.938669 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-2e79473d-72f6-4ae2-a448-1ed053d0a972 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cb690b39040340ef96b70974678fb620'} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:36:39.942261 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90065ece-46e2-47a2-9193-eb48c1cbdbb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:36:39.943135 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90065ece-46e2-47a2-9193-eb48c1cbdbb4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:36:39.943414 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90065ece-46e2-47a2-9193-eb48c1cbdbb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:36:39.943732 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90065ece-46e2-47a2-9193-eb48c1cbdbb4 admin admin] PATH_INFO: `/v3/projects/7a4ec1dbe6ae43bfb69888bd675b3fbf` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:36:39.945092 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90065ece-46e2-47a2-9193-eb48c1cbdbb4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7a4ec1dbe6ae43bfb69888bd675b3fbf)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:36:39.947300 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90065ece-46e2-47a2-9193-eb48c1cbdbb4 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:36:39.948311 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-2e79473d-72f6-4ae2-a448-1ed053d0a972 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cb690b39040340ef96b70974678fb620'} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:36:39.949021 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-2e79473d-72f6-4ae2-a448-1ed053d0a972 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cb690b39040340ef96b70974678fb620'} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:36:39.962772 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-2e79473d-72f6-4ae2-a448-1ed053d0a972 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cb690b39040340ef96b70974678fb620'} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:36:39.969675 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-2e79473d-72f6-4ae2-a448-1ed053d0a972 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cb690b39040340ef96b70974678fb620'} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:36:39.976106 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1083/2124] 10.222.0.23 () {58 vars in 1223 bytes} [Tue May 10 05:36:39 2022] DELETE /identity/v3/users/cb690b39040340ef96b70974678fb620 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 05:36:39.981119 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2555b66-d014-4d7d-bbc0-c85e201980b8 None None] REQUEST_METHOD: `POST` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:36:39.981263 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2555b66-d014-4d7d-bbc0-c85e201980b8 None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:36:39.981521 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2555b66-d014-4d7d-bbc0-c85e201980b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:36:39.999090 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.auth.core [None req-b2555b66-d014-4d7d-bbc0-c85e201980b8 None None] MFA Rules not processed for user `44883b22532e44049d846938dc2cf423`. Rule list: `[]` (Enabled: `True`). {{(pid=79879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:36:40.000601 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-b2555b66-d014-4d7d-bbc0-c85e201980b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:36:40.003785 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-90065ece-46e2-47a2-9193-eb48c1cbdbb4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7a4ec1dbe6ae43bfb69888bd675b3fbf', 'request_id': 'req-90065ece-46e2-47a2-9193-eb48c1cbdbb4'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:36:40.020369 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-90065ece-46e2-47a2-9193-eb48c1cbdbb4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7a4ec1dbe6ae43bfb69888bd675b3fbf', 'request_id': 'req-90065ece-46e2-47a2-9193-eb48c1cbdbb4'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:36:40.029151 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-90065ece-46e2-47a2-9193-eb48c1cbdbb4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7a4ec1dbe6ae43bfb69888bd675b3fbf', 'request_id': 'req-90065ece-46e2-47a2-9193-eb48c1cbdbb4'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:36:40.040631 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-90065ece-46e2-47a2-9193-eb48c1cbdbb4 admin admin] The token cache is being invalidate because project 7a4ec1dbe6ae43bfb69888bd675b3fbf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79880) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 05:36:40.040917 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-90065ece-46e2-47a2-9193-eb48c1cbdbb4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:36:40.041562 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-90065ece-46e2-47a2-9193-eb48c1cbdbb4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:36:40.043407 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1042/2125] 10.222.0.23 () {58 vars in 1232 bytes} [Tue May 10 05:36:39 2022] DELETE /identity/v3/projects/7a4ec1dbe6ae43bfb69888bd675b3fbf => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 05:36:40.048905 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f3e302-d7bb-44bf-be17-9979bc36f638 None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:36:40.050060 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f3e302-d7bb-44bf-be17-9979bc36f638 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:36:40.050347 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f3e302-d7bb-44bf-be17-9979bc36f638 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:36:40.071508 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-46f3e302-d7bb-44bf-be17-9979bc36f638 None None] MFA Rules not processed for user `44883b22532e44049d846938dc2cf423`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:36:40.072984 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-46f3e302-d7bb-44bf-be17-9979bc36f638 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:36:40.075713 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1084/2126] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 10 05:36:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 05:36:40.083520 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2555b66-d014-4d7d-bbc0-c85e201980b8 None None] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:36:40.085070 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-b2555b66-d014-4d7d-bbc0-c85e201980b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:36:40.096276 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1043/2127] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 10 05:36:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 05:36:40.098721 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccafbf8-a3bb-4c7f-bad6-8a23bb486493 None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:36:40.098999 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccafbf8-a3bb-4c7f-bad6-8a23bb486493 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:36:40.099278 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccafbf8-a3bb-4c7f-bad6-8a23bb486493 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:36:40.119880 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-7ccafbf8-a3bb-4c7f-bad6-8a23bb486493 None None] MFA Rules not processed for user `44883b22532e44049d846938dc2cf423`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:36:40.121071 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-7ccafbf8-a3bb-4c7f-bad6-8a23bb486493 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:36:40.129585 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1044/2128] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 10 05:36:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 05:36:40.134232 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccafbf8-a3bb-4c7f-bad6-8a23bb486493 None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:36:40.143352 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccafbf8-a3bb-4c7f-bad6-8a23bb486493 None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:36:40.148286 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee9ed4c-0e8e-47ba-913c-6068d30ee348 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:36:40.149022 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee9ed4c-0e8e-47ba-913c-6068d30ee348 admin admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:36:40.149395 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee9ed4c-0e8e-47ba-913c-6068d30ee348 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:36:40.149744 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee9ed4c-0e8e-47ba-913c-6068d30ee348 admin admin] PATH_INFO: `/v3/domains` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:36:40.150568 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee9ed4c-0e8e-47ba-913c-6068d30ee348 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:36:40.150967 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee9ed4c-0e8e-47ba-913c-6068d30ee348 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:36:40.152734 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee9ed4c-0e8e-47ba-913c-6068d30ee348 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:36:40.155042 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2555b66-d014-4d7d-bbc0-c85e201980b8 None None] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:36:40.158980 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174b0cd8-3186-411b-8145-12ad693bef9a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c8461cfdd9648b8abcaf8d34b7a102a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f23435f783540199d6dcfd0417c090e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:36:40.159842 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174b0cd8-3186-411b-8145-12ad693bef9a service neutron] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:36:40.160108 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174b0cd8-3186-411b-8145-12ad693bef9a service neutron] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:36:40.160414 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174b0cd8-3186-411b-8145-12ad693bef9a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:36:40.165643 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1045/2129] 10.222.0.23 () {58 vars in 1152 bytes} [Tue May 10 05:36:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 05:36:40.169730 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee9ed4c-0e8e-47ba-913c-6068d30ee348 admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:36:40.171363 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174b0cd8-3186-411b-8145-12ad693bef9a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:36:40.172962 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174b0cd8-3186-411b-8145-12ad693bef9a service neutron] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:36:40.185085 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee9ed4c-0e8e-47ba-913c-6068d30ee348 admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:36:40.185286 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1085/2130] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 10 05:36:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 05:36:40.190102 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e926e9a9-a14b-43a8-8869-def369e9cc74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:36:40.190985 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e926e9a9-a14b-43a8-8869-def369e9cc74 admin admin] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:36:40.191267 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e926e9a9-a14b-43a8-8869-def369e9cc74 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:36:40.191543 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e926e9a9-a14b-43a8-8869-def369e9cc74 admin admin] PATH_INFO: `/v3/projects` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:36:40.192281 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e926e9a9-a14b-43a8-8869-def369e9cc74 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:36:40.194252 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e926e9a9-a14b-43a8-8869-def369e9cc74 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:36:40.224319 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1046/2131] 10.222.0.23 () {60 vars in 1152 bytes} [Tue May 10 05:36:40 2022] POST /identity/v3/projects => generated 367 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 05:36:40.228879 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174b0cd8-3186-411b-8145-12ad693bef9a service neutron] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:36:40.238492 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174b0cd8-3186-411b-8145-12ad693bef9a service neutron] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:36:40.294062 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfab6cc7-c3af-40ab-8435-e2f52dae8446 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:36:40.294741 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfab6cc7-c3af-40ab-8435-e2f52dae8446 admin admin] REQUEST_METHOD: `POST` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:36:40.295018 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfab6cc7-c3af-40ab-8435-e2f52dae8446 admin admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:36:40.295290 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfab6cc7-c3af-40ab-8435-e2f52dae8446 admin admin] PATH_INFO: `/v3/users` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:36:40.296012 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfab6cc7-c3af-40ab-8435-e2f52dae8446 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:36:40.297963 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfab6cc7-c3af-40ab-8435-e2f52dae8446 admin admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:36:40.318556 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1086/2132] 10.222.0.23 () {60 vars in 1143 bytes} [Tue May 10 05:36:40 2022] POST /identity/v3/users => generated 284 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 05:36:40.322797 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e926e9a9-a14b-43a8-8869-def369e9cc74 admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:36:40.333332 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e926e9a9-a14b-43a8-8869-def369e9cc74 admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:36:40.339246 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdf29e2-551c-4385-a240-b35f4979eea8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:36:40.340398 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdf29e2-551c-4385-a240-b35f4979eea8 admin admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:36:40.340398 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdf29e2-551c-4385-a240-b35f4979eea8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:36:40.340649 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdf29e2-551c-4385-a240-b35f4979eea8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:36:40.341373 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cdf29e2-551c-4385-a240-b35f4979eea8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:36:40.343048 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cdf29e2-551c-4385-a240-b35f4979eea8 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:36:40.353541 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1047/2133] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 10 05:36:40 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 05:36:40.357683 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfab6cc7-c3af-40ab-8435-e2f52dae8446 admin admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:36:40.367772 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfab6cc7-c3af-40ab-8435-e2f52dae8446 admin admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:36:40.372578 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbee7c6-cd0c-4bcd-ba3a-73d682098be2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:36:40.373626 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbee7c6-cd0c-4bcd-ba3a-73d682098be2 admin admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:36:40.373964 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbee7c6-cd0c-4bcd-ba3a-73d682098be2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:36:40.374319 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbee7c6-cd0c-4bcd-ba3a-73d682098be2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:36:40.375206 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbee7c6-cd0c-4bcd-ba3a-73d682098be2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:36:40.376833 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbee7c6-cd0c-4bcd-ba3a-73d682098be2 admin admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:36:40.386790 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1087/2134] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 10 05:36:40 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 05:36:40.391090 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdf29e2-551c-4385-a240-b35f4979eea8 admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:36:40.400992 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdf29e2-551c-4385-a240-b35f4979eea8 admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:36:40.406087 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e282a624-fa9d-425d-a7f6-8b0350292165 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:36:40.407081 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e282a624-fa9d-425d-a7f6-8b0350292165 admin admin] REQUEST_METHOD: `PUT` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:36:40.407359 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e282a624-fa9d-425d-a7f6-8b0350292165 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:36:40.407660 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e282a624-fa9d-425d-a7f6-8b0350292165 admin admin] PATH_INFO: `/v3/projects/f88eeb0863c84a7ebedab78ab7f0b970/users/af1ff8ca03124ab7a4479f28711ad312/roles/382636e67fc142a2b2f486340d959e11` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:36:40.422462 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e282a624-fa9d-425d-a7f6-8b0350292165 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f88eeb0863c84a7ebedab78ab7f0b970, user_id=af1ff8ca03124ab7a4479f28711ad312, role_id=382636e67fc142a2b2f486340d959e11)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:36:40.425214 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e282a624-fa9d-425d-a7f6-8b0350292165 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:36:40.438892 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1048/2135] 10.222.0.23 () {60 vars in 1482 bytes} [Tue May 10 05:36:40 2022] PUT /identity/v3/projects/f88eeb0863c84a7ebedab78ab7f0b970/users/af1ff8ca03124ab7a4479f28711ad312/roles/382636e67fc142a2b2f486340d959e11 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 05:36:40.452907 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d1b013-6a1a-40cf-ac13-8ea612d7f036 None None] REQUEST_METHOD: `POST` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:36:40.452907 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d1b013-6a1a-40cf-ac13-8ea612d7f036 None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:36:40.452907 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d1b013-6a1a-40cf-ac13-8ea612d7f036 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:36:40.454521 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e282a624-fa9d-425d-a7f6-8b0350292165 admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:36:40.457720 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-e282a624-fa9d-425d-a7f6-8b0350292165 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:36:40.478672 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.auth.core [None req-d0d1b013-6a1a-40cf-ac13-8ea612d7f036 None None] MFA Rules not processed for user `af1ff8ca03124ab7a4479f28711ad312`. Rule list: `[]` (Enabled: `True`). {{(pid=79879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:36:40.479923 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-d0d1b013-6a1a-40cf-ac13-8ea612d7f036 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:36:40.531764 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e282a624-fa9d-425d-a7f6-8b0350292165 admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:36:40.536711 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06032b96-1e31-4770-b376-115d98c032c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:36:40.537800 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06032b96-1e31-4770-b376-115d98c032c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:36:40.538217 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06032b96-1e31-4770-b376-115d98c032c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:36:40.538474 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06032b96-1e31-4770-b376-115d98c032c7 admin admin] PATH_INFO: `/v3/projects/3c8101b24f874a16a871a2c0e08ef875` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:36:40.539686 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06032b96-1e31-4770-b376-115d98c032c7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3c8101b24f874a16a871a2c0e08ef875)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:36:40.541558 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06032b96-1e31-4770-b376-115d98c032c7 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:36:40.550799 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1088/2136] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 10 05:36:40 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 05:36:40.556668 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d1b013-6a1a-40cf-ac13-8ea612d7f036 None None] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:36:40.568618 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d1b013-6a1a-40cf-ac13-8ea612d7f036 None None] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:36:40.574494 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ba1529-6a2b-472e-a2fd-e1314893f6c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:36:40.575526 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ba1529-6a2b-472e-a2fd-e1314893f6c0 admin admin] REQUEST_METHOD: `POST` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:36:40.576405 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ba1529-6a2b-472e-a2fd-e1314893f6c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:36:40.577634 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ba1529-6a2b-472e-a2fd-e1314893f6c0 admin admin] PATH_INFO: `/v3/projects` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:36:40.580449 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ba1529-6a2b-472e-a2fd-e1314893f6c0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:36:40.582654 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ba1529-6a2b-472e-a2fd-e1314893f6c0 admin admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:36:40.597296 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-06032b96-1e31-4770-b376-115d98c032c7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3c8101b24f874a16a871a2c0e08ef875', 'request_id': 'req-06032b96-1e31-4770-b376-115d98c032c7'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:36:40.605364 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-06032b96-1e31-4770-b376-115d98c032c7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3c8101b24f874a16a871a2c0e08ef875', 'request_id': 'req-06032b96-1e31-4770-b376-115d98c032c7'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:36:40.613043 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1089/2137] 10.222.0.23 () {60 vars in 1152 bytes} [Tue May 10 05:36:40 2022] POST /identity/v3/projects => generated 367 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 05:36:40.617180 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ba1529-6a2b-472e-a2fd-e1314893f6c0 admin admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:36:40.617487 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-06032b96-1e31-4770-b376-115d98c032c7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3c8101b24f874a16a871a2c0e08ef875', 'request_id': 'req-06032b96-1e31-4770-b376-115d98c032c7'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:36:40.632775 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-06032b96-1e31-4770-b376-115d98c032c7 admin admin] The token cache is being invalidate because project 3c8101b24f874a16a871a2c0e08ef875 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79880) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 05:36:40.633067 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-06032b96-1e31-4770-b376-115d98c032c7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:36:40.633741 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-06032b96-1e31-4770-b376-115d98c032c7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:36:40.635595 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1049/2138] 10.222.0.23 () {58 vars in 1232 bytes} [Tue May 10 05:36:40 2022] DELETE /identity/v3/projects/3c8101b24f874a16a871a2c0e08ef875 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 05:36:40.640877 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c288fc14-fd37-4e43-9106-3d2dfd40f285 None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:36:40.641685 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c288fc14-fd37-4e43-9106-3d2dfd40f285 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:36:40.641991 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c288fc14-fd37-4e43-9106-3d2dfd40f285 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:36:40.662604 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-c288fc14-fd37-4e43-9106-3d2dfd40f285 None None] MFA Rules not processed for user `44883b22532e44049d846938dc2cf423`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:36:40.663876 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-c288fc14-fd37-4e43-9106-3d2dfd40f285 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:36:40.685444 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ba1529-6a2b-472e-a2fd-e1314893f6c0 admin admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:36:40.690056 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd4f46e-7623-420a-8a72-f8e320b191ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:36:40.690756 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd4f46e-7623-420a-8a72-f8e320b191ff admin admin] REQUEST_METHOD: `POST` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:36:40.691028 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd4f46e-7623-420a-8a72-f8e320b191ff admin admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:36:40.691302 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd4f46e-7623-420a-8a72-f8e320b191ff admin admin] PATH_INFO: `/v3/users` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:36:40.692032 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd4f46e-7623-420a-8a72-f8e320b191ff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:36:40.693974 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd4f46e-7623-420a-8a72-f8e320b191ff admin admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:36:40.722571 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1090/2139] 10.222.0.23 () {60 vars in 1143 bytes} [Tue May 10 05:36:40 2022] POST /identity/v3/users => generated 290 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 05:36:40.724451 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd4f46e-7623-420a-8a72-f8e320b191ff admin admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:36:40.726273 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-edd4f46e-7623-420a-8a72-f8e320b191ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:36:40.734284 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1050/2140] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 10 05:36:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 05:36:40.744497 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4a407e-35c0-47a7-a576-d63314203443 None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:36:40.745002 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4a407e-35c0-47a7-a576-d63314203443 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:36:40.745280 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4a407e-35c0-47a7-a576-d63314203443 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:36:40.748686 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd4f46e-7623-420a-8a72-f8e320b191ff admin admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:36:40.756067 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a4404b-2f61-4ab0-a240-7b9c2c3c733d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:36:40.756758 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a4404b-2f61-4ab0-a240-7b9c2c3c733d admin admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:36:40.759792 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a4404b-2f61-4ab0-a240-7b9c2c3c733d admin admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:36:40.760269 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a4404b-2f61-4ab0-a240-7b9c2c3c733d admin admin] PATH_INFO: `/v3/roles` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:36:40.761175 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a4404b-2f61-4ab0-a240-7b9c2c3c733d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:36:40.763112 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a4404b-2f61-4ab0-a240-7b9c2c3c733d admin admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:36:40.766738 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-df4a407e-35c0-47a7-a576-d63314203443 None None] MFA Rules not processed for user `44883b22532e44049d846938dc2cf423`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:36:40.768064 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-df4a407e-35c0-47a7-a576-d63314203443 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:36:40.778500 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1051/2141] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 10 05:36:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 05:36:40.779067 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1091/2142] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 10 05:36:40 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 05:36:40.784443 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a4404b-2f61-4ab0-a240-7b9c2c3c733d admin admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:36:40.784620 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4a407e-35c0-47a7-a576-d63314203443 None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:36:40.795745 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a4404b-2f61-4ab0-a240-7b9c2c3c733d admin admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:36:40.800990 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204f8876-aa26-40a8-b30c-6dd6d1b8fef2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:36:40.801761 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4a407e-35c0-47a7-a576-d63314203443 None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:36:40.801908 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204f8876-aa26-40a8-b30c-6dd6d1b8fef2 admin admin] REQUEST_METHOD: `PUT` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:36:40.802155 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204f8876-aa26-40a8-b30c-6dd6d1b8fef2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:36:40.802428 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204f8876-aa26-40a8-b30c-6dd6d1b8fef2 admin admin] PATH_INFO: `/v3/projects/562fd70bb9234941802bfac352c8012d/users/337d2a063f4447e9ad01b5a25422b123/roles/199ac1dd842441d7913c6ee89d8fbecc` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:36:40.809266 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4501800b-be7b-4565-bab5-94a183d63d88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:36:40.810023 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4501800b-be7b-4565-bab5-94a183d63d88 admin admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:36:40.810325 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4501800b-be7b-4565-bab5-94a183d63d88 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:36:40.810665 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4501800b-be7b-4565-bab5-94a183d63d88 admin admin] PATH_INFO: `/v3/domains` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:36:40.811506 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4501800b-be7b-4565-bab5-94a183d63d88 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:36:40.811841 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4501800b-be7b-4565-bab5-94a183d63d88 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:36:40.814556 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4501800b-be7b-4565-bab5-94a183d63d88 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:36:40.819669 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204f8876-aa26-40a8-b30c-6dd6d1b8fef2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=562fd70bb9234941802bfac352c8012d, user_id=337d2a063f4447e9ad01b5a25422b123, role_id=199ac1dd842441d7913c6ee89d8fbecc)` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:36:40.822320 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204f8876-aa26-40a8-b30c-6dd6d1b8fef2 admin admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:36:40.826747 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1052/2143] 10.222.0.23 () {58 vars in 1152 bytes} [Tue May 10 05:36:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:36:40.831228 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4501800b-be7b-4565-bab5-94a183d63d88 admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:36:40.843428 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1092/2144] 10.222.0.23 () {60 vars in 1482 bytes} [Tue May 10 05:36:40 2022] PUT /identity/v3/projects/562fd70bb9234941802bfac352c8012d/users/337d2a063f4447e9ad01b5a25422b123/roles/199ac1dd842441d7913c6ee89d8fbecc => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 05:36:40.843563 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4501800b-be7b-4565-bab5-94a183d63d88 admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:36:40.844553 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204f8876-aa26-40a8-b30c-6dd6d1b8fef2 admin admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:36:40.900237 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0148e3bc-1bde-42c2-be19-e8426028e72b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:36:40.901024 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0148e3bc-1bde-42c2-be19-e8426028e72b admin admin] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:36:40.901305 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0148e3bc-1bde-42c2-be19-e8426028e72b admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:36:40.901575 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0148e3bc-1bde-42c2-be19-e8426028e72b admin admin] PATH_INFO: `/v3/projects` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:36:40.902301 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0148e3bc-1bde-42c2-be19-e8426028e72b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:36:40.904249 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0148e3bc-1bde-42c2-be19-e8426028e72b admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:36:40.906339 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204f8876-aa26-40a8-b30c-6dd6d1b8fef2 admin admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:36:40.911206 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2058e20-f223-4d93-beb5-b6659b65ee4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:36:40.911955 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2058e20-f223-4d93-beb5-b6659b65ee4e admin admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:36:40.912237 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2058e20-f223-4d93-beb5-b6659b65ee4e admin admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:36:40.912622 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2058e20-f223-4d93-beb5-b6659b65ee4e admin admin] PATH_INFO: `/v3/roles` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:36:40.913356 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2058e20-f223-4d93-beb5-b6659b65ee4e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:36:40.914941 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2058e20-f223-4d93-beb5-b6659b65ee4e admin admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:36:40.924758 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1093/2145] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 10 05:36:40 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 05:36:40.928830 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2058e20-f223-4d93-beb5-b6659b65ee4e admin admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:36:40.932222 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1053/2146] 10.222.0.23 () {60 vars in 1152 bytes} [Tue May 10 05:36:40 2022] POST /identity/v3/projects => generated 371 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 05:36:40.936068 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0148e3bc-1bde-42c2-be19-e8426028e72b admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:36:40.938322 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2058e20-f223-4d93-beb5-b6659b65ee4e admin admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:36:40.991000 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4e6922-cd5e-4111-a1ab-ef48189286a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:36:40.991921 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4e6922-cd5e-4111-a1ab-ef48189286a1 admin admin] REQUEST_METHOD: `PUT` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:36:40.992199 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4e6922-cd5e-4111-a1ab-ef48189286a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:36:40.992472 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4e6922-cd5e-4111-a1ab-ef48189286a1 admin admin] PATH_INFO: `/v3/projects/562fd70bb9234941802bfac352c8012d/users/337d2a063f4447e9ad01b5a25422b123/roles/199ac1dd842441d7913c6ee89d8fbecc` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:36:40.992786 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0148e3bc-1bde-42c2-be19-e8426028e72b admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:36:40.994405 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4e6922-cd5e-4111-a1ab-ef48189286a1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=562fd70bb9234941802bfac352c8012d, user_id=337d2a063f4447e9ad01b5a25422b123, role_id=199ac1dd842441d7913c6ee89d8fbecc)` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:36:40.997151 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4e6922-cd5e-4111-a1ab-ef48189286a1 admin admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:36:40.997364 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420fa4c3-4f74-41c1-8033-ae4151f958f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:36:40.999657 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420fa4c3-4f74-41c1-8033-ae4151f958f0 admin admin] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:36:40.999983 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420fa4c3-4f74-41c1-8033-ae4151f958f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:36:41.000575 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420fa4c3-4f74-41c1-8033-ae4151f958f0 admin admin] PATH_INFO: `/v3/users` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:36:41.000970 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420fa4c3-4f74-41c1-8033-ae4151f958f0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:36:41.002881 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420fa4c3-4f74-41c1-8033-ae4151f958f0 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:36:41.008023 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1094/2147] 10.222.0.23 () {60 vars in 1482 bytes} [Tue May 10 05:36:40 2022] PUT /identity/v3/projects/562fd70bb9234941802bfac352c8012d/users/337d2a063f4447e9ad01b5a25422b123/roles/199ac1dd842441d7913c6ee89d8fbecc => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 05:36:41.018183 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f811c05-3655-4f4b-9376-6fbf090f7ebf None None] REQUEST_METHOD: `POST` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:36:41.018496 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f811c05-3655-4f4b-9376-6fbf090f7ebf None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:36:41.018776 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f811c05-3655-4f4b-9376-6fbf090f7ebf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:36:41.026142 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1054/2148] 10.222.0.23 () {60 vars in 1143 bytes} [Tue May 10 05:36:40 2022] POST /identity/v3/users => generated 286 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 05:36:41.027309 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420fa4c3-4f74-41c1-8033-ae4151f958f0 admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:36:41.037141 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420fa4c3-4f74-41c1-8033-ae4151f958f0 admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:36:41.045388 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.auth.core [None req-1f811c05-3655-4f4b-9376-6fbf090f7ebf None None] MFA Rules not processed for user `337d2a063f4447e9ad01b5a25422b123`. Rule list: `[]` (Enabled: `True`). {{(pid=79879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:36:41.046564 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-1f811c05-3655-4f4b-9376-6fbf090f7ebf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:36:41.090040 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7563a93b-9898-4a91-85e2-d5de720f459e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:36:41.090705 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7563a93b-9898-4a91-85e2-d5de720f459e admin admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:36:41.090981 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7563a93b-9898-4a91-85e2-d5de720f459e admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:36:41.091249 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7563a93b-9898-4a91-85e2-d5de720f459e admin admin] PATH_INFO: `/v3/roles` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:36:41.092081 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7563a93b-9898-4a91-85e2-d5de720f459e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:36:41.093746 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7563a93b-9898-4a91-85e2-d5de720f459e admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:36:41.103061 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1055/2149] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 10 05:36:41 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 05:36:41.106760 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7563a93b-9898-4a91-85e2-d5de720f459e admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:36:41.115128 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1095/2150] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 10 05:36:41 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 05:36:41.117496 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7563a93b-9898-4a91-85e2-d5de720f459e admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:36:41.124062 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3dfbd19-8383-43e5-a2f5-9a92c3f6f141 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:36:41.124731 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dfbd19-8383-43e5-a2f5-9a92c3f6f141 admin admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:36:41.125121 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dfbd19-8383-43e5-a2f5-9a92c3f6f141 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:36:41.125397 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dfbd19-8383-43e5-a2f5-9a92c3f6f141 admin admin] PATH_INFO: `/v3/roles` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:36:41.126952 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3dfbd19-8383-43e5-a2f5-9a92c3f6f141 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:36:41.127846 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f811c05-3655-4f4b-9376-6fbf090f7ebf None None] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:36:41.128635 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3dfbd19-8383-43e5-a2f5-9a92c3f6f141 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:36:41.129256 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-1f811c05-3655-4f4b-9376-6fbf090f7ebf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:36:41.142357 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1056/2151] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 10 05:36:41 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 05:36:41.143472 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3dfbd19-8383-43e5-a2f5-9a92c3f6f141 admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:36:41.152836 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3dfbd19-8383-43e5-a2f5-9a92c3f6f141 admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:36:41.157342 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a42ea7-d5dd-443e-bd43-97aed4922569 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:36:41.158219 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a42ea7-d5dd-443e-bd43-97aed4922569 admin admin] REQUEST_METHOD: `PUT` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:36:41.158497 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a42ea7-d5dd-443e-bd43-97aed4922569 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:36:41.158766 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a42ea7-d5dd-443e-bd43-97aed4922569 admin admin] PATH_INFO: `/v3/projects/9870e28919e340ad9cda63cbbdea4e35/users/8e8273af61e041cbac9974ece62c86ad/roles/382636e67fc142a2b2f486340d959e11` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:36:41.174440 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a42ea7-d5dd-443e-bd43-97aed4922569 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9870e28919e340ad9cda63cbbdea4e35, user_id=8e8273af61e041cbac9974ece62c86ad, role_id=382636e67fc142a2b2f486340d959e11)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:36:41.177511 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a42ea7-d5dd-443e-bd43-97aed4922569 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:36:41.191500 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1057/2152] 10.222.0.23 () {60 vars in 1482 bytes} [Tue May 10 05:36:41 2022] PUT /identity/v3/projects/9870e28919e340ad9cda63cbbdea4e35/users/8e8273af61e041cbac9974ece62c86ad/roles/382636e67fc142a2b2f486340d959e11 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 05:36:41.192905 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f811c05-3655-4f4b-9376-6fbf090f7ebf None None] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:36:41.196514 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb56c1f-2b40-4116-a58d-545938c959ef None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:36:41.196806 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb56c1f-2b40-4116-a58d-545938c959ef None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:36:41.197087 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb56c1f-2b40-4116-a58d-545938c959ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:36:41.214366 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-4eb56c1f-2b40-4116-a58d-545938c959ef None None] MFA Rules not processed for user `44883b22532e44049d846938dc2cf423`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:36:41.215563 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-4eb56c1f-2b40-4116-a58d-545938c959ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:36:41.247124 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23232e8d-72b5-40fa-8a56-c32c66c9761f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355be413675540a39ccb00e1a0722316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f23435f783540199d6dcfd0417c090e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:36:41.248693 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23232e8d-72b5-40fa-8a56-c32c66c9761f service cinder] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:36:41.248781 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23232e8d-72b5-40fa-8a56-c32c66c9761f service cinder] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:36:41.249133 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23232e8d-72b5-40fa-8a56-c32c66c9761f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:36:41.280859 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1058/2153] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 10 05:36:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 05:36:41.290282 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb56c1f-2b40-4116-a58d-545938c959ef None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:36:41.291758 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-4eb56c1f-2b40-4116-a58d-545938c959ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:36:41.315147 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23232e8d-72b5-40fa-8a56-c32c66c9761f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:36:41.316651 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23232e8d-72b5-40fa-8a56-c32c66c9761f service cinder] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:36:41.326546 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1096/2154] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 10 05:36:41 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 05:36:41.346774 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb56c1f-2b40-4116-a58d-545938c959ef None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:36:41.350955 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b347f5-b1e2-4443-9b8e-ca5fd9fd8c33 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c8461cfdd9648b8abcaf8d34b7a102a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f23435f783540199d6dcfd0417c090e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:36:41.351633 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b347f5-b1e2-4443-9b8e-ca5fd9fd8c33 service neutron] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:36:41.351921 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b347f5-b1e2-4443-9b8e-ca5fd9fd8c33 service neutron] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:36:41.352200 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b347f5-b1e2-4443-9b8e-ca5fd9fd8c33 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:36:41.361305 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b347f5-b1e2-4443-9b8e-ca5fd9fd8c33 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:36:41.362731 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b347f5-b1e2-4443-9b8e-ca5fd9fd8c33 service neutron] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:36:41.372997 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1059/2155] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 10 05:36:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 05:36:41.413871 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23232e8d-72b5-40fa-8a56-c32c66c9761f service cinder] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:36:41.422353 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23232e8d-72b5-40fa-8a56-c32c66c9761f service cinder] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:36:41.426067 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1870b0-1744-4012-b3b4-377890104b7c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355be413675540a39ccb00e1a0722316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f23435f783540199d6dcfd0417c090e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:36:41.426718 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1870b0-1744-4012-b3b4-377890104b7c service cinder] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:36:41.426981 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1870b0-1744-4012-b3b4-377890104b7c service cinder] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:36:41.427294 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1870b0-1744-4012-b3b4-377890104b7c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:36:41.429131 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-6d1870b0-1744-4012-b3b4-377890104b7c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:36:41.492274 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1870b0-1744-4012-b3b4-377890104b7c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:36:41.493767 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1870b0-1744-4012-b3b4-377890104b7c service cinder] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:36:41.503329 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1097/2156] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 10 05:36:41 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 05:36:43.979788 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b347f5-b1e2-4443-9b8e-ca5fd9fd8c33 service neutron] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:36:43.981434 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-b6b347f5-b1e2-4443-9b8e-ca5fd9fd8c33 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:36:43.999560 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b347f5-b1e2-4443-9b8e-ca5fd9fd8c33 service neutron] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:36:44.004715 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a66743-9cc0-4e58-9fa0-ce3daadd5c0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:36:44.005685 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a66743-9cc0-4e58-9fa0-ce3daadd5c0d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:36:44.006033 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a66743-9cc0-4e58-9fa0-ce3daadd5c0d admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:36:44.006374 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a66743-9cc0-4e58-9fa0-ce3daadd5c0d admin admin] PATH_INFO: `/v3/users/194e94adb54944e39abb66f98be657c6` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:36:44.007717 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a66743-9cc0-4e58-9fa0-ce3daadd5c0d admin admin] RBAC: Authorizing `identity:delete_user(user_id=194e94adb54944e39abb66f98be657c6)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:36:44.010039 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a66743-9cc0-4e58-9fa0-ce3daadd5c0d admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:36:44.065939 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-c8a66743-9cc0-4e58-9fa0-ce3daadd5c0d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '194e94adb54944e39abb66f98be657c6'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:36:44.080157 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-c8a66743-9cc0-4e58-9fa0-ce3daadd5c0d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '194e94adb54944e39abb66f98be657c6'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:36:44.081042 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-c8a66743-9cc0-4e58-9fa0-ce3daadd5c0d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '194e94adb54944e39abb66f98be657c6'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:36:44.087705 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-c8a66743-9cc0-4e58-9fa0-ce3daadd5c0d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '194e94adb54944e39abb66f98be657c6'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:36:44.088299 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-c8a66743-9cc0-4e58-9fa0-ce3daadd5c0d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '194e94adb54944e39abb66f98be657c6'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:36:44.103428 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1060/2157] 10.222.0.23 () {58 vars in 1223 bytes} [Tue May 10 05:36:43 2022] DELETE /identity/v3/users/194e94adb54944e39abb66f98be657c6 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 05:36:44.372295 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1870b0-1744-4012-b3b4-377890104b7c service cinder] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:36:44.389810 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1870b0-1744-4012-b3b4-377890104b7c service cinder] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:36:44.484858 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752e08d1-abab-42ce-a987-0a6102afeb86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:36:44.485756 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752e08d1-abab-42ce-a987-0a6102afeb86 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:36:44.486028 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752e08d1-abab-42ce-a987-0a6102afeb86 admin admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:36:44.486304 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752e08d1-abab-42ce-a987-0a6102afeb86 admin admin] PATH_INFO: `/v3/projects/a4b426f4da354914ab7f6f98d583f557` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:36:44.489421 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752e08d1-abab-42ce-a987-0a6102afeb86 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a4b426f4da354914ab7f6f98d583f557)` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:36:44.491293 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752e08d1-abab-42ce-a987-0a6102afeb86 admin admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:36:44.553714 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-752e08d1-abab-42ce-a987-0a6102afeb86 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a4b426f4da354914ab7f6f98d583f557', 'request_id': 'req-752e08d1-abab-42ce-a987-0a6102afeb86'} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:36:44.560429 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-752e08d1-abab-42ce-a987-0a6102afeb86 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a4b426f4da354914ab7f6f98d583f557', 'request_id': 'req-752e08d1-abab-42ce-a987-0a6102afeb86'} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:36:44.571555 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-752e08d1-abab-42ce-a987-0a6102afeb86 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a4b426f4da354914ab7f6f98d583f557', 'request_id': 'req-752e08d1-abab-42ce-a987-0a6102afeb86'} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:36:44.591674 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-752e08d1-abab-42ce-a987-0a6102afeb86 admin admin] The token cache is being invalidate because project a4b426f4da354914ab7f6f98d583f557 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79879) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 05:36:44.591968 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-752e08d1-abab-42ce-a987-0a6102afeb86 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:36:44.593082 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-752e08d1-abab-42ce-a987-0a6102afeb86 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:36:44.595034 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1098/2158] 10.222.0.23 () {58 vars in 1232 bytes} [Tue May 10 05:36:44 2022] DELETE /identity/v3/projects/a4b426f4da354914ab7f6f98d583f557 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 05:36:44.599951 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef841fdd-423f-47b4-ac03-ba5845652651 None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:36:44.600242 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef841fdd-423f-47b4-ac03-ba5845652651 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:36:44.600516 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef841fdd-423f-47b4-ac03-ba5845652651 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:36:44.623421 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-ef841fdd-423f-47b4-ac03-ba5845652651 None None] MFA Rules not processed for user `44883b22532e44049d846938dc2cf423`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:36:44.625259 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-ef841fdd-423f-47b4-ac03-ba5845652651 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:36:44.710157 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1061/2159] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 10 05:36:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 05:36:44.717771 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2931519a-9391-4ccc-9e73-69477c79b787 None None] REQUEST_METHOD: `POST` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:36:44.718060 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2931519a-9391-4ccc-9e73-69477c79b787 None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:36:44.718336 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2931519a-9391-4ccc-9e73-69477c79b787 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:36:44.739670 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.auth.core [None req-2931519a-9391-4ccc-9e73-69477c79b787 None None] MFA Rules not processed for user `44883b22532e44049d846938dc2cf423`. Rule list: `[]` (Enabled: `True`). {{(pid=79879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:36:44.741364 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-2931519a-9391-4ccc-9e73-69477c79b787 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:36:44.755252 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef841fdd-423f-47b4-ac03-ba5845652651 None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:36:44.755787 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1099/2160] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 10 05:36:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 05:36:44.771916 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef841fdd-423f-47b4-ac03-ba5845652651 None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:36:44.778242 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e4acd2-5c66-4c43-9919-ad2f02ab196e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:36:44.778921 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e4acd2-5c66-4c43-9919-ad2f02ab196e admin admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:36:44.779903 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e4acd2-5c66-4c43-9919-ad2f02ab196e admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:36:44.780185 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e4acd2-5c66-4c43-9919-ad2f02ab196e admin admin] PATH_INFO: `/v3/domains` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:36:44.780945 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e4acd2-5c66-4c43-9919-ad2f02ab196e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:36:44.781638 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e4acd2-5c66-4c43-9919-ad2f02ab196e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:36:44.783538 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e4acd2-5c66-4c43-9919-ad2f02ab196e admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:36:44.802758 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1062/2161] 10.222.0.23 () {58 vars in 1152 bytes} [Tue May 10 05:36:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:36:44.804130 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2931519a-9391-4ccc-9e73-69477c79b787 None None] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:36:44.816120 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2931519a-9391-4ccc-9e73-69477c79b787 None None] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:36:44.822793 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717a6aae-3fa4-4fb8-a84b-ec14a8f81def admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:36:44.823492 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717a6aae-3fa4-4fb8-a84b-ec14a8f81def admin admin] REQUEST_METHOD: `POST` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:36:44.823827 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717a6aae-3fa4-4fb8-a84b-ec14a8f81def admin admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:36:44.824106 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717a6aae-3fa4-4fb8-a84b-ec14a8f81def admin admin] PATH_INFO: `/v3/projects` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:36:44.824807 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717a6aae-3fa4-4fb8-a84b-ec14a8f81def admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:36:44.827207 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717a6aae-3fa4-4fb8-a84b-ec14a8f81def admin admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:36:44.862872 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1100/2162] 10.222.0.23 () {60 vars in 1152 bytes} [Tue May 10 05:36:44 2022] POST /identity/v3/projects => generated 383 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 05:36:44.864525 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e4acd2-5c66-4c43-9919-ad2f02ab196e admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:36:44.878770 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e4acd2-5c66-4c43-9919-ad2f02ab196e admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:36:44.949556 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d60fa2-65ef-425d-bb7e-91c82ffd97f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:36:44.950259 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d60fa2-65ef-425d-bb7e-91c82ffd97f6 admin admin] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:36:44.950543 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d60fa2-65ef-425d-bb7e-91c82ffd97f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:36:44.950820 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d60fa2-65ef-425d-bb7e-91c82ffd97f6 admin admin] PATH_INFO: `/v3/users` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:36:44.951535 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d60fa2-65ef-425d-bb7e-91c82ffd97f6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:36:44.953837 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d60fa2-65ef-425d-bb7e-91c82ffd97f6 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:36:44.988481 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1063/2163] 10.222.0.23 () {60 vars in 1143 bytes} [Tue May 10 05:36:44 2022] POST /identity/v3/users => generated 292 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 05:36:44.989125 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717a6aae-3fa4-4fb8-a84b-ec14a8f81def admin admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:36:45.003018 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717a6aae-3fa4-4fb8-a84b-ec14a8f81def admin admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:36:45.009038 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5daf160-8021-470b-a07d-25d79effc32d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:36:45.010238 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5daf160-8021-470b-a07d-25d79effc32d admin admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:36:45.010583 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5daf160-8021-470b-a07d-25d79effc32d admin admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:36:45.010926 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5daf160-8021-470b-a07d-25d79effc32d admin admin] PATH_INFO: `/v3/roles` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:36:45.011841 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5daf160-8021-470b-a07d-25d79effc32d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:36:45.013569 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5daf160-8021-470b-a07d-25d79effc32d admin admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:36:45.028071 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1101/2164] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 10 05:36:44 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 05:36:45.030854 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d60fa2-65ef-425d-bb7e-91c82ffd97f6 admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:36:45.042863 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d60fa2-65ef-425d-bb7e-91c82ffd97f6 admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:36:45.050014 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a4e4e8-6c88-4f1f-a910-44dd155bc028 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:36:45.051269 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a4e4e8-6c88-4f1f-a910-44dd155bc028 admin admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:36:45.051808 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a4e4e8-6c88-4f1f-a910-44dd155bc028 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:36:45.052279 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a4e4e8-6c88-4f1f-a910-44dd155bc028 admin admin] PATH_INFO: `/v3/roles` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:36:45.053834 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a4e4e8-6c88-4f1f-a910-44dd155bc028 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:36:45.056629 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a4e4e8-6c88-4f1f-a910-44dd155bc028 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:36:45.074920 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1064/2165] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 10 05:36:45 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 05:36:45.075685 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5daf160-8021-470b-a07d-25d79effc32d admin admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:36:45.086285 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5daf160-8021-470b-a07d-25d79effc32d admin admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:36:45.092159 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ae602d-bcc3-4f41-92db-89d0733b4c17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:36:45.093387 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ae602d-bcc3-4f41-92db-89d0733b4c17 admin admin] REQUEST_METHOD: `PUT` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:36:45.093850 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ae602d-bcc3-4f41-92db-89d0733b4c17 admin admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:36:45.094261 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ae602d-bcc3-4f41-92db-89d0733b4c17 admin admin] PATH_INFO: `/v3/projects/0623b145317e4164862cd8601813c000/users/da9d43f65eca485b8b629a4c7a867b93/roles/382636e67fc142a2b2f486340d959e11` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:36:45.114818 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ae602d-bcc3-4f41-92db-89d0733b4c17 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0623b145317e4164862cd8601813c000, user_id=da9d43f65eca485b8b629a4c7a867b93, role_id=382636e67fc142a2b2f486340d959e11)` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:36:45.118873 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ae602d-bcc3-4f41-92db-89d0733b4c17 admin admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:36:45.150004 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1102/2166] 10.222.0.23 () {60 vars in 1482 bytes} [Tue May 10 05:36:45 2022] PUT /identity/v3/projects/0623b145317e4164862cd8601813c000/users/da9d43f65eca485b8b629a4c7a867b93/roles/382636e67fc142a2b2f486340d959e11 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 05:36:45.154870 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c670e355-9947-4e6f-8a7c-1276607f4788 None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:36:45.155156 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c670e355-9947-4e6f-8a7c-1276607f4788 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:36:45.155430 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c670e355-9947-4e6f-8a7c-1276607f4788 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:36:45.174376 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-c670e355-9947-4e6f-8a7c-1276607f4788 None None] MFA Rules not processed for user `44883b22532e44049d846938dc2cf423`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:36:45.176324 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-c670e355-9947-4e6f-8a7c-1276607f4788 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:36:45.303047 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1065/2167] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 10 05:36:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 05:36:45.317224 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ae602d-bcc3-4f41-92db-89d0733b4c17 admin admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:36:45.320869 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-13ae602d-bcc3-4f41-92db-89d0733b4c17 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:36:45.397166 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ae602d-bcc3-4f41-92db-89d0733b4c17 admin admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:36:45.401767 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94429c5b-6593-4329-abb1-407dc8fa6f00 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c8461cfdd9648b8abcaf8d34b7a102a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f23435f783540199d6dcfd0417c090e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:36:45.402596 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94429c5b-6593-4329-abb1-407dc8fa6f00 service neutron] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:36:45.403049 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94429c5b-6593-4329-abb1-407dc8fa6f00 service neutron] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:36:45.403462 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94429c5b-6593-4329-abb1-407dc8fa6f00 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:36:45.415625 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94429c5b-6593-4329-abb1-407dc8fa6f00 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:36:45.417286 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94429c5b-6593-4329-abb1-407dc8fa6f00 service neutron] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:36:45.429022 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1103/2168] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 10 05:36:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 05:36:46.646605 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d390449-c760-45cc-b68a-1108c3646fcf None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:36:46.647131 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d390449-c760-45cc-b68a-1108c3646fcf None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:36:46.647214 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d390449-c760-45cc-b68a-1108c3646fcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:36:46.659396 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94429c5b-6593-4329-abb1-407dc8fa6f00 service neutron] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:36:46.661070 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-94429c5b-6593-4329-abb1-407dc8fa6f00 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:36:46.682066 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94429c5b-6593-4329-abb1-407dc8fa6f00 service neutron] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:36:46.685866 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-4d390449-c760-45cc-b68a-1108c3646fcf None None] MFA Rules not processed for user `8e8273af61e041cbac9974ece62c86ad`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:36:46.687098 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-4d390449-c760-45cc-b68a-1108c3646fcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:36:46.691934 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632860a0-55fc-4b8a-96bd-0254e64315bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:36:46.692906 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632860a0-55fc-4b8a-96bd-0254e64315bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:36:46.693392 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632860a0-55fc-4b8a-96bd-0254e64315bb admin admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:36:46.693908 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632860a0-55fc-4b8a-96bd-0254e64315bb admin admin] PATH_INFO: `/v3/users/af1ff8ca03124ab7a4479f28711ad312` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:36:46.696112 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632860a0-55fc-4b8a-96bd-0254e64315bb admin admin] RBAC: Authorizing `identity:delete_user(user_id=af1ff8ca03124ab7a4479f28711ad312)` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:36:46.698783 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632860a0-55fc-4b8a-96bd-0254e64315bb admin admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:36:46.768428 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-632860a0-55fc-4b8a-96bd-0254e64315bb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'af1ff8ca03124ab7a4479f28711ad312'} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:36:46.777615 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-632860a0-55fc-4b8a-96bd-0254e64315bb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'af1ff8ca03124ab7a4479f28711ad312'} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:36:46.778394 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-632860a0-55fc-4b8a-96bd-0254e64315bb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'af1ff8ca03124ab7a4479f28711ad312'} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:36:46.784756 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1066/2169] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 10 05:36:46 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 05:36:46.794215 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-632860a0-55fc-4b8a-96bd-0254e64315bb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'af1ff8ca03124ab7a4479f28711ad312'} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:36:46.796619 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d390449-c760-45cc-b68a-1108c3646fcf None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:36:46.798487 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-4d390449-c760-45cc-b68a-1108c3646fcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:36:46.806322 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-632860a0-55fc-4b8a-96bd-0254e64315bb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'af1ff8ca03124ab7a4479f28711ad312'} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:36:46.815931 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d390449-c760-45cc-b68a-1108c3646fcf None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:36:46.824413 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543aa83d-6b58-47cf-89d4-d6a291cded93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:36:46.826423 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543aa83d-6b58-47cf-89d4-d6a291cded93 admin admin] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:36:46.827780 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543aa83d-6b58-47cf-89d4-d6a291cded93 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:36:46.830642 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1104/2170] 10.222.0.23 () {58 vars in 1223 bytes} [Tue May 10 05:36:46 2022] DELETE /identity/v3/users/af1ff8ca03124ab7a4479f28711ad312 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 05:36:46.830775 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543aa83d-6b58-47cf-89d4-d6a291cded93 admin admin] PATH_INFO: `/v3/projects` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:36:46.830775 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543aa83d-6b58-47cf-89d4-d6a291cded93 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:36:46.832332 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfecafe-396b-4a9c-9f84-8278c787285c None None] REQUEST_METHOD: `POST` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:36:46.832481 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543aa83d-6b58-47cf-89d4-d6a291cded93 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:36:46.832933 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfecafe-396b-4a9c-9f84-8278c787285c None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:36:46.833703 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfecafe-396b-4a9c-9f84-8278c787285c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:36:46.854382 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.auth.core [None req-cdfecafe-396b-4a9c-9f84-8278c787285c None None] MFA Rules not processed for user `44883b22532e44049d846938dc2cf423`. Rule list: `[]` (Enabled: `True`). {{(pid=79879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:36:46.858166 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-cdfecafe-396b-4a9c-9f84-8278c787285c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:36:46.892172 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1067/2171] 10.222.0.23 () {60 vars in 1152 bytes} [Tue May 10 05:36:46 2022] POST /identity/v3/projects => generated 373 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 05:36:46.896674 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543aa83d-6b58-47cf-89d4-d6a291cded93 admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:36:46.903318 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-543aa83d-6b58-47cf-89d4-d6a291cded93 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:36:46.933187 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1105/2172] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 10 05:36:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 05:36:46.944378 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfecafe-396b-4a9c-9f84-8278c787285c None None] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:36:46.946149 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-cdfecafe-396b-4a9c-9f84-8278c787285c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:36:46.990278 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543aa83d-6b58-47cf-89d4-d6a291cded93 admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:36:46.996383 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0985b11-0a2e-439f-ae4d-aace24f07aa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:36:46.998123 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0985b11-0a2e-439f-ae4d-aace24f07aa6 admin admin] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:36:46.999143 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0985b11-0a2e-439f-ae4d-aace24f07aa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:36:47.000491 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0985b11-0a2e-439f-ae4d-aace24f07aa6 admin admin] PATH_INFO: `/v3/users` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:36:47.002216 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0985b11-0a2e-439f-ae4d-aace24f07aa6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:36:47.006301 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0985b11-0a2e-439f-ae4d-aace24f07aa6 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:36:47.016998 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfecafe-396b-4a9c-9f84-8278c787285c None None] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:36:47.041148 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1068/2173] 10.222.0.23 () {60 vars in 1143 bytes} [Tue May 10 05:36:46 2022] POST /identity/v3/users => generated 293 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 05:36:47.042265 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0985b11-0a2e-439f-ae4d-aace24f07aa6 admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:36:47.061142 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0985b11-0a2e-439f-ae4d-aace24f07aa6 admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:36:47.067430 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ae4fb9-5b7f-4893-b0f0-220481e46e0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:36:47.068775 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ae4fb9-5b7f-4893-b0f0-220481e46e0e admin admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:36:47.068940 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ae4fb9-5b7f-4893-b0f0-220481e46e0e admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:36:47.069190 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ae4fb9-5b7f-4893-b0f0-220481e46e0e admin admin] PATH_INFO: `/v3/roles` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:36:47.070213 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ae4fb9-5b7f-4893-b0f0-220481e46e0e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:36:47.071790 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ae4fb9-5b7f-4893-b0f0-220481e46e0e admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:36:47.080261 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58296de7-cffc-4049-9db4-011709db2c52 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c8461cfdd9648b8abcaf8d34b7a102a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f23435f783540199d6dcfd0417c090e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:36:47.080929 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58296de7-cffc-4049-9db4-011709db2c52 service neutron] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:36:47.081216 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58296de7-cffc-4049-9db4-011709db2c52 service neutron] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:36:47.081499 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58296de7-cffc-4049-9db4-011709db2c52 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:36:47.093836 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1069/2174] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 10 05:36:47 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 05:36:47.096791 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ae4fb9-5b7f-4893-b0f0-220481e46e0e admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:36:47.099154 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58296de7-cffc-4049-9db4-011709db2c52 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:36:47.101209 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58296de7-cffc-4049-9db4-011709db2c52 service neutron] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:36:47.108706 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ae4fb9-5b7f-4893-b0f0-220481e46e0e admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:36:47.116654 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1106/2175] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 10 05:36:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 05:36:47.130005 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558fa8b9-349f-462a-9b66-fdd17689f101 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:36:47.131155 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558fa8b9-349f-462a-9b66-fdd17689f101 admin admin] REQUEST_METHOD: `PUT` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:36:47.131639 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558fa8b9-349f-462a-9b66-fdd17689f101 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:36:47.131987 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558fa8b9-349f-462a-9b66-fdd17689f101 admin admin] PATH_INFO: `/v3/projects/96f5fbc03aab48ed80b52ac8bb30d9b4/users/c9faf8a8f8e747239a0e062471f4a1ca/roles/199ac1dd842441d7913c6ee89d8fbecc` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:36:47.168988 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558fa8b9-349f-462a-9b66-fdd17689f101 admin admin] RBAC: Authorizing `identity:create_grant(project_id=96f5fbc03aab48ed80b52ac8bb30d9b4, user_id=c9faf8a8f8e747239a0e062471f4a1ca, role_id=199ac1dd842441d7913c6ee89d8fbecc)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:36:47.172943 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558fa8b9-349f-462a-9b66-fdd17689f101 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:36:47.202433 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1070/2176] 10.222.0.23 () {60 vars in 1482 bytes} [Tue May 10 05:36:47 2022] PUT /identity/v3/projects/96f5fbc03aab48ed80b52ac8bb30d9b4/users/c9faf8a8f8e747239a0e062471f4a1ca/roles/199ac1dd842441d7913c6ee89d8fbecc => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 05:36:47.204874 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58296de7-cffc-4049-9db4-011709db2c52 service neutron] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:36:47.223185 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58296de7-cffc-4049-9db4-011709db2c52 service neutron] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:36:47.332482 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73bef0e-9124-48c5-8fdd-71f7ae34a9fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:36:47.333179 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73bef0e-9124-48c5-8fdd-71f7ae34a9fb admin admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:36:47.333460 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73bef0e-9124-48c5-8fdd-71f7ae34a9fb admin admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:36:47.333734 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73bef0e-9124-48c5-8fdd-71f7ae34a9fb admin admin] PATH_INFO: `/v3/roles` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:36:47.334479 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73bef0e-9124-48c5-8fdd-71f7ae34a9fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:36:47.342467 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73bef0e-9124-48c5-8fdd-71f7ae34a9fb admin admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:36:47.364332 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1107/2177] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 10 05:36:47 2022] GET /identity/v3/roles => generated 1420 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 05:36:47.371910 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558fa8b9-349f-462a-9b66-fdd17689f101 admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:36:47.413823 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558fa8b9-349f-462a-9b66-fdd17689f101 admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:36:47.437126 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0bd4cb-dc04-4cae-9fa6-b55916d6be40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:36:47.438026 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0bd4cb-dc04-4cae-9fa6-b55916d6be40 admin admin] REQUEST_METHOD: `PUT` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:36:47.438303 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0bd4cb-dc04-4cae-9fa6-b55916d6be40 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:36:47.438571 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0bd4cb-dc04-4cae-9fa6-b55916d6be40 admin admin] PATH_INFO: `/v3/projects/96f5fbc03aab48ed80b52ac8bb30d9b4/users/c9faf8a8f8e747239a0e062471f4a1ca/roles/199ac1dd842441d7913c6ee89d8fbecc` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:36:47.444541 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0bd4cb-dc04-4cae-9fa6-b55916d6be40 admin admin] RBAC: Authorizing `identity:create_grant(project_id=96f5fbc03aab48ed80b52ac8bb30d9b4, user_id=c9faf8a8f8e747239a0e062471f4a1ca, role_id=199ac1dd842441d7913c6ee89d8fbecc)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:36:47.447709 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0bd4cb-dc04-4cae-9fa6-b55916d6be40 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:36:47.467079 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1071/2178] 10.222.0.23 () {60 vars in 1482 bytes} [Tue May 10 05:36:47 2022] PUT /identity/v3/projects/96f5fbc03aab48ed80b52ac8bb30d9b4/users/c9faf8a8f8e747239a0e062471f4a1ca/roles/199ac1dd842441d7913c6ee89d8fbecc => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 05:36:47.700695 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73bef0e-9124-48c5-8fdd-71f7ae34a9fb admin admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:36:47.705637 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-c73bef0e-9124-48c5-8fdd-71f7ae34a9fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:36:47.740686 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73bef0e-9124-48c5-8fdd-71f7ae34a9fb admin admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:36:47.840472 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44003a0-538a-466b-8622-a17e8ac1c1f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:36:47.843757 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44003a0-538a-466b-8622-a17e8ac1c1f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:36:47.844405 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44003a0-538a-466b-8622-a17e8ac1c1f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:36:47.846503 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44003a0-538a-466b-8622-a17e8ac1c1f8 admin admin] PATH_INFO: `/v3/projects/f88eeb0863c84a7ebedab78ab7f0b970` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:36:47.849281 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44003a0-538a-466b-8622-a17e8ac1c1f8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f88eeb0863c84a7ebedab78ab7f0b970)` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:36:47.854526 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44003a0-538a-466b-8622-a17e8ac1c1f8 admin admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:36:47.948145 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-d44003a0-538a-466b-8622-a17e8ac1c1f8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f88eeb0863c84a7ebedab78ab7f0b970', 'request_id': 'req-d44003a0-538a-466b-8622-a17e8ac1c1f8'} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:36:47.954863 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-d44003a0-538a-466b-8622-a17e8ac1c1f8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f88eeb0863c84a7ebedab78ab7f0b970', 'request_id': 'req-d44003a0-538a-466b-8622-a17e8ac1c1f8'} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:36:47.965652 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-d44003a0-538a-466b-8622-a17e8ac1c1f8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f88eeb0863c84a7ebedab78ab7f0b970', 'request_id': 'req-d44003a0-538a-466b-8622-a17e8ac1c1f8'} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:36:47.981398 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-d44003a0-538a-466b-8622-a17e8ac1c1f8 admin admin] The token cache is being invalidate because project f88eeb0863c84a7ebedab78ab7f0b970 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79879) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 05:36:47.981693 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-d44003a0-538a-466b-8622-a17e8ac1c1f8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:36:47.982395 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-d44003a0-538a-466b-8622-a17e8ac1c1f8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:36:47.984497 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1108/2179] 10.222.0.23 () {58 vars in 1232 bytes} [Tue May 10 05:36:47 2022] DELETE /identity/v3/projects/f88eeb0863c84a7ebedab78ab7f0b970 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 05:36:47.988778 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0bd4cb-dc04-4cae-9fa6-b55916d6be40 admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:36:47.990797 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-3f0bd4cb-dc04-4cae-9fa6-b55916d6be40 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:36:48.005021 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0bd4cb-dc04-4cae-9fa6-b55916d6be40 admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:36:48.098837 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3590eb-bcc9-49c7-a39f-533aa53fc349 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:36:48.099849 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3590eb-bcc9-49c7-a39f-533aa53fc349 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:36:48.100132 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3590eb-bcc9-49c7-a39f-533aa53fc349 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:36:48.100402 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3590eb-bcc9-49c7-a39f-533aa53fc349 admin admin] PATH_INFO: `/v3/users/337d2a063f4447e9ad01b5a25422b123` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:36:48.101595 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3590eb-bcc9-49c7-a39f-533aa53fc349 admin admin] RBAC: Authorizing `identity:delete_user(user_id=337d2a063f4447e9ad01b5a25422b123)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:36:48.103714 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3590eb-bcc9-49c7-a39f-533aa53fc349 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:36:48.159789 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-5e3590eb-bcc9-49c7-a39f-533aa53fc349 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '337d2a063f4447e9ad01b5a25422b123'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:36:48.173861 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-5e3590eb-bcc9-49c7-a39f-533aa53fc349 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '337d2a063f4447e9ad01b5a25422b123'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:36:48.176435 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-5e3590eb-bcc9-49c7-a39f-533aa53fc349 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '337d2a063f4447e9ad01b5a25422b123'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:36:48.186804 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-5e3590eb-bcc9-49c7-a39f-533aa53fc349 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '337d2a063f4447e9ad01b5a25422b123'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:36:48.187815 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-5e3590eb-bcc9-49c7-a39f-533aa53fc349 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '337d2a063f4447e9ad01b5a25422b123'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:36:48.206724 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1072/2180] 10.222.0.23 () {58 vars in 1223 bytes} [Tue May 10 05:36:47 2022] DELETE /identity/v3/users/337d2a063f4447e9ad01b5a25422b123 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 05:36:48.541155 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44003a0-538a-466b-8622-a17e8ac1c1f8 admin admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:36:48.551996 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44003a0-538a-466b-8622-a17e8ac1c1f8 admin admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:36:48.650695 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd00bc63-2a7b-444f-9cd1-9b60dd0cdf92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:36:48.651775 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd00bc63-2a7b-444f-9cd1-9b60dd0cdf92 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:36:48.652054 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd00bc63-2a7b-444f-9cd1-9b60dd0cdf92 admin admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:36:48.652374 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd00bc63-2a7b-444f-9cd1-9b60dd0cdf92 admin admin] PATH_INFO: `/v3/projects/562fd70bb9234941802bfac352c8012d` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:36:48.653879 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd00bc63-2a7b-444f-9cd1-9b60dd0cdf92 admin admin] RBAC: Authorizing `identity:delete_project(project_id=562fd70bb9234941802bfac352c8012d)` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:36:48.656246 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd00bc63-2a7b-444f-9cd1-9b60dd0cdf92 admin admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:36:48.715276 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-cd00bc63-2a7b-444f-9cd1-9b60dd0cdf92 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '562fd70bb9234941802bfac352c8012d', 'request_id': 'req-cd00bc63-2a7b-444f-9cd1-9b60dd0cdf92'} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:36:48.725144 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-cd00bc63-2a7b-444f-9cd1-9b60dd0cdf92 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '562fd70bb9234941802bfac352c8012d', 'request_id': 'req-cd00bc63-2a7b-444f-9cd1-9b60dd0cdf92'} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:36:48.733737 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-cd00bc63-2a7b-444f-9cd1-9b60dd0cdf92 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '562fd70bb9234941802bfac352c8012d', 'request_id': 'req-cd00bc63-2a7b-444f-9cd1-9b60dd0cdf92'} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:36:48.765963 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-cd00bc63-2a7b-444f-9cd1-9b60dd0cdf92 admin admin] The token cache is being invalidate because project 562fd70bb9234941802bfac352c8012d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79879) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 05:36:48.765963 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-cd00bc63-2a7b-444f-9cd1-9b60dd0cdf92 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:36:48.766934 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-cd00bc63-2a7b-444f-9cd1-9b60dd0cdf92 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:36:48.770511 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1109/2181] 10.222.0.23 () {58 vars in 1232 bytes} [Tue May 10 05:36:48 2022] DELETE /identity/v3/projects/562fd70bb9234941802bfac352c8012d => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 05:36:48.775344 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0775e8-9286-4d3b-bc9b-7a693bfb7b5f None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:36:48.775666 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0775e8-9286-4d3b-bc9b-7a693bfb7b5f None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:36:48.775950 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0775e8-9286-4d3b-bc9b-7a693bfb7b5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:36:48.801774 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-2d0775e8-9286-4d3b-bc9b-7a693bfb7b5f None None] MFA Rules not processed for user `44883b22532e44049d846938dc2cf423`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:36:48.803083 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-2d0775e8-9286-4d3b-bc9b-7a693bfb7b5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:36:48.903079 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1073/2182] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 10 05:36:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 05:36:48.910481 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7078e297-b25e-465a-af65-257c9ce50e89 None None] REQUEST_METHOD: `POST` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:36:48.911066 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7078e297-b25e-465a-af65-257c9ce50e89 None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:36:48.912169 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7078e297-b25e-465a-af65-257c9ce50e89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:36:48.938996 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.auth.core [None req-7078e297-b25e-465a-af65-257c9ce50e89 None None] MFA Rules not processed for user `44883b22532e44049d846938dc2cf423`. Rule list: `[]` (Enabled: `True`). {{(pid=79879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:36:48.940284 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-7078e297-b25e-465a-af65-257c9ce50e89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:36:48.957694 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1110/2183] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 10 05:36:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 05:36:48.959389 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0775e8-9286-4d3b-bc9b-7a693bfb7b5f None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:36:48.971936 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0775e8-9286-4d3b-bc9b-7a693bfb7b5f None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:36:48.977700 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1c5f57-5c61-4427-9704-ee89b5ef0828 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:36:48.978669 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1c5f57-5c61-4427-9704-ee89b5ef0828 admin admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:36:48.979154 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1c5f57-5c61-4427-9704-ee89b5ef0828 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:36:48.979676 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1c5f57-5c61-4427-9704-ee89b5ef0828 admin admin] PATH_INFO: `/v3/domains` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:36:48.980618 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1c5f57-5c61-4427-9704-ee89b5ef0828 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:36:48.981126 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1c5f57-5c61-4427-9704-ee89b5ef0828 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:36:48.983521 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1c5f57-5c61-4427-9704-ee89b5ef0828 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:36:48.998666 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1074/2184] 10.222.0.23 () {58 vars in 1152 bytes} [Tue May 10 05:36:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:36:49.004707 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7078e297-b25e-465a-af65-257c9ce50e89 None None] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:36:49.021217 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7078e297-b25e-465a-af65-257c9ce50e89 None None] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:36:49.027652 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8803349-30d4-4b85-8e82-8f714d33bf02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:36:49.028332 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8803349-30d4-4b85-8e82-8f714d33bf02 admin admin] REQUEST_METHOD: `POST` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:36:49.029790 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8803349-30d4-4b85-8e82-8f714d33bf02 admin admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:36:49.029790 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8803349-30d4-4b85-8e82-8f714d33bf02 admin admin] PATH_INFO: `/v3/projects` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:36:49.029790 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8803349-30d4-4b85-8e82-8f714d33bf02 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:36:49.032520 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8803349-30d4-4b85-8e82-8f714d33bf02 admin admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:36:49.081854 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1111/2185] 10.222.0.23 () {60 vars in 1152 bytes} [Tue May 10 05:36:49 2022] POST /identity/v3/projects => generated 371 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 05:36:49.086626 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1c5f57-5c61-4427-9704-ee89b5ef0828 admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:36:49.100091 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1c5f57-5c61-4427-9704-ee89b5ef0828 admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:36:49.267513 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6308baa2-d960-4df0-a29e-7a8b2e0bac69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:36:49.268741 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6308baa2-d960-4df0-a29e-7a8b2e0bac69 admin admin] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:36:49.269122 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6308baa2-d960-4df0-a29e-7a8b2e0bac69 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:36:49.269619 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6308baa2-d960-4df0-a29e-7a8b2e0bac69 admin admin] PATH_INFO: `/v3/users` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:36:49.270546 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6308baa2-d960-4df0-a29e-7a8b2e0bac69 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:36:49.272777 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6308baa2-d960-4df0-a29e-7a8b2e0bac69 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:36:49.306884 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1075/2186] 10.222.0.23 () {60 vars in 1143 bytes} [Tue May 10 05:36:49 2022] POST /identity/v3/users => generated 286 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 05:36:49.310968 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8803349-30d4-4b85-8e82-8f714d33bf02 admin admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:36:49.325480 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8803349-30d4-4b85-8e82-8f714d33bf02 admin admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:36:49.344382 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5520b2-30c0-4993-9d77-2a513bf90dbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:36:49.345097 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5520b2-30c0-4993-9d77-2a513bf90dbe admin admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:36:49.345375 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5520b2-30c0-4993-9d77-2a513bf90dbe admin admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:36:49.347746 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5520b2-30c0-4993-9d77-2a513bf90dbe admin admin] PATH_INFO: `/v3/roles` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:36:49.348567 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5520b2-30c0-4993-9d77-2a513bf90dbe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:36:49.355412 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5520b2-30c0-4993-9d77-2a513bf90dbe admin admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:36:49.381688 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1112/2187] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 10 05:36:49 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 05:36:49.382910 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6308baa2-d960-4df0-a29e-7a8b2e0bac69 admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:36:49.396308 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6308baa2-d960-4df0-a29e-7a8b2e0bac69 admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:36:49.409213 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae151f4-1102-4edf-a6d8-716c4d0f2700 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:36:49.410261 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae151f4-1102-4edf-a6d8-716c4d0f2700 admin admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:36:49.410261 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae151f4-1102-4edf-a6d8-716c4d0f2700 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:36:49.410517 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae151f4-1102-4edf-a6d8-716c4d0f2700 admin admin] PATH_INFO: `/v3/roles` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:36:49.411245 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae151f4-1102-4edf-a6d8-716c4d0f2700 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:36:49.412839 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae151f4-1102-4edf-a6d8-716c4d0f2700 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:36:49.441897 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1076/2188] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 10 05:36:49 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 05:36:49.446364 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5520b2-30c0-4993-9d77-2a513bf90dbe admin admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:36:49.467703 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5520b2-30c0-4993-9d77-2a513bf90dbe admin admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:36:49.495068 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9ea64b-e196-42e5-805b-fc2858d9749e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:36:49.496026 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9ea64b-e196-42e5-805b-fc2858d9749e admin admin] REQUEST_METHOD: `PUT` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:36:49.496305 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9ea64b-e196-42e5-805b-fc2858d9749e admin admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:36:49.496577 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9ea64b-e196-42e5-805b-fc2858d9749e admin admin] PATH_INFO: `/v3/projects/def716ff123b47f6b525ec0f116ae19a/users/ec3d42da0a234d768a8de33c92bdfdda/roles/382636e67fc142a2b2f486340d959e11` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:36:49.530140 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9ea64b-e196-42e5-805b-fc2858d9749e admin admin] RBAC: Authorizing `identity:create_grant(project_id=def716ff123b47f6b525ec0f116ae19a, user_id=ec3d42da0a234d768a8de33c92bdfdda, role_id=382636e67fc142a2b2f486340d959e11)` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:36:49.533137 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9ea64b-e196-42e5-805b-fc2858d9749e admin admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:36:49.558558 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1113/2189] 10.222.0.23 () {60 vars in 1482 bytes} [Tue May 10 05:36:49 2022] PUT /identity/v3/projects/def716ff123b47f6b525ec0f116ae19a/users/ec3d42da0a234d768a8de33c92bdfdda/roles/382636e67fc142a2b2f486340d959e11 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 05:36:49.569583 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96de7485-01ad-4c88-844b-640a9df5dfbc None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:36:49.570501 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96de7485-01ad-4c88-844b-640a9df5dfbc None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:36:49.570795 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96de7485-01ad-4c88-844b-640a9df5dfbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:36:49.620493 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-96de7485-01ad-4c88-844b-640a9df5dfbc None None] MFA Rules not processed for user `ec3d42da0a234d768a8de33c92bdfdda`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:36:49.622360 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-96de7485-01ad-4c88-844b-640a9df5dfbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:36:49.757958 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1077/2190] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 10 05:36:49 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 05:36:49.771118 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9ea64b-e196-42e5-805b-fc2858d9749e admin admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:36:49.773475 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-4f9ea64b-e196-42e5-805b-fc2858d9749e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:36:49.876061 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9ea64b-e196-42e5-805b-fc2858d9749e admin admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:36:49.880899 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa202bd2-2eff-4d6a-8797-410d5c626fd1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355be413675540a39ccb00e1a0722316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f23435f783540199d6dcfd0417c090e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:36:49.881803 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa202bd2-2eff-4d6a-8797-410d5c626fd1 service cinder] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:36:49.882282 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa202bd2-2eff-4d6a-8797-410d5c626fd1 service cinder] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:36:49.882754 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa202bd2-2eff-4d6a-8797-410d5c626fd1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:36:49.895555 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa202bd2-2eff-4d6a-8797-410d5c626fd1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:36:49.897460 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa202bd2-2eff-4d6a-8797-410d5c626fd1 service cinder] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:36:49.913267 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1114/2191] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 10 05:36:49 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 05:36:49.934843 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96de7485-01ad-4c88-844b-640a9df5dfbc None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:36:50.015771 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96de7485-01ad-4c88-844b-640a9df5dfbc None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:36:50.021343 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef29717a-ce4e-40f7-b202-39e3464eee0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:36:50.022389 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef29717a-ce4e-40f7-b202-39e3464eee0b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:36:50.022679 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef29717a-ce4e-40f7-b202-39e3464eee0b admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:36:50.022998 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef29717a-ce4e-40f7-b202-39e3464eee0b admin admin] PATH_INFO: `/v3/users/ec3d42da0a234d768a8de33c92bdfdda` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:36:50.024468 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef29717a-ce4e-40f7-b202-39e3464eee0b admin admin] RBAC: Authorizing `identity:delete_user(user_id=ec3d42da0a234d768a8de33c92bdfdda)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:36:50.027378 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef29717a-ce4e-40f7-b202-39e3464eee0b admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:36:50.103841 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-ef29717a-ce4e-40f7-b202-39e3464eee0b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ec3d42da0a234d768a8de33c92bdfdda'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:36:50.131496 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-ef29717a-ce4e-40f7-b202-39e3464eee0b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ec3d42da0a234d768a8de33c92bdfdda'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:36:50.133450 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-ef29717a-ce4e-40f7-b202-39e3464eee0b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ec3d42da0a234d768a8de33c92bdfdda'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:36:50.148703 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-ef29717a-ce4e-40f7-b202-39e3464eee0b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ec3d42da0a234d768a8de33c92bdfdda'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:36:50.149933 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-ef29717a-ce4e-40f7-b202-39e3464eee0b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ec3d42da0a234d768a8de33c92bdfdda'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:36:50.176049 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1078/2192] 10.222.0.23 () {58 vars in 1223 bytes} [Tue May 10 05:36:49 2022] DELETE /identity/v3/users/ec3d42da0a234d768a8de33c92bdfdda => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 05:36:50.181495 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de60b88-3ff8-4a66-8881-32ea3930e78f None None] REQUEST_METHOD: `POST` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:36:50.182068 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de60b88-3ff8-4a66-8881-32ea3930e78f None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:36:50.182934 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de60b88-3ff8-4a66-8881-32ea3930e78f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:36:50.220401 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.auth.core [None req-4de60b88-3ff8-4a66-8881-32ea3930e78f None None] MFA Rules not processed for user `44883b22532e44049d846938dc2cf423`. Rule list: `[]` (Enabled: `True`). {{(pid=79879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:36:50.221793 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-4de60b88-3ff8-4a66-8881-32ea3930e78f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:36:50.363642 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1115/2193] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 10 05:36:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 05:36:50.380687 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef29717a-ce4e-40f7-b202-39e3464eee0b admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:36:50.382822 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-ef29717a-ce4e-40f7-b202-39e3464eee0b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:36:50.543423 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef29717a-ce4e-40f7-b202-39e3464eee0b admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:36:50.550379 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee648f4-d872-417a-8384-4ab660669bf0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c8461cfdd9648b8abcaf8d34b7a102a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f23435f783540199d6dcfd0417c090e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:36:50.551471 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee648f4-d872-417a-8384-4ab660669bf0 service neutron] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:36:50.552029 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee648f4-d872-417a-8384-4ab660669bf0 service neutron] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:36:50.552489 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee648f4-d872-417a-8384-4ab660669bf0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:36:50.565250 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee648f4-d872-417a-8384-4ab660669bf0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:36:50.567118 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee648f4-d872-417a-8384-4ab660669bf0 service neutron] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:36:50.593979 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1079/2194] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 10 05:36:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 05:36:51.480728 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de60b88-3ff8-4a66-8881-32ea3930e78f None None] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:36:51.482419 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-4de60b88-3ff8-4a66-8881-32ea3930e78f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:36:51.511001 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de60b88-3ff8-4a66-8881-32ea3930e78f None None] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:36:51.524557 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a2f20a-b97f-4bb0-895b-bcde19f6eccb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:36:51.541921 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a2f20a-b97f-4bb0-895b-bcde19f6eccb admin admin] REQUEST_METHOD: `DELETE` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:36:51.544108 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a2f20a-b97f-4bb0-895b-bcde19f6eccb admin admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:36:51.544486 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a2f20a-b97f-4bb0-895b-bcde19f6eccb admin admin] PATH_INFO: `/v3/projects/def716ff123b47f6b525ec0f116ae19a` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:36:51.548606 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a2f20a-b97f-4bb0-895b-bcde19f6eccb admin admin] RBAC: Authorizing `identity:delete_project(project_id=def716ff123b47f6b525ec0f116ae19a)` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:36:51.557693 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a2f20a-b97f-4bb0-895b-bcde19f6eccb admin admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:36:51.716882 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb6d939-2396-468f-9a28-9fb74fd890ee None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:36:51.717382 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb6d939-2396-468f-9a28-9fb74fd890ee None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:36:51.717868 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-a3a2f20a-b97f-4bb0-895b-bcde19f6eccb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'def716ff123b47f6b525ec0f116ae19a', 'request_id': 'req-a3a2f20a-b97f-4bb0-895b-bcde19f6eccb'} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:36:51.718295 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb6d939-2396-468f-9a28-9fb74fd890ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:36:51.743521 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-a3a2f20a-b97f-4bb0-895b-bcde19f6eccb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'def716ff123b47f6b525ec0f116ae19a', 'request_id': 'req-a3a2f20a-b97f-4bb0-895b-bcde19f6eccb'} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:36:51.754202 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-a3a2f20a-b97f-4bb0-895b-bcde19f6eccb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'def716ff123b47f6b525ec0f116ae19a', 'request_id': 'req-a3a2f20a-b97f-4bb0-895b-bcde19f6eccb'} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:36:51.776301 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-a3a2f20a-b97f-4bb0-895b-bcde19f6eccb admin admin] The token cache is being invalidate because project def716ff123b47f6b525ec0f116ae19a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79879) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 05:36:51.776869 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-a3a2f20a-b97f-4bb0-895b-bcde19f6eccb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:36:51.777254 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-dcb6d939-2396-468f-9a28-9fb74fd890ee None None] MFA Rules not processed for user `da9d43f65eca485b8b629a4c7a867b93`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:36:51.778608 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-dcb6d939-2396-468f-9a28-9fb74fd890ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:36:51.788565 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-a3a2f20a-b97f-4bb0-895b-bcde19f6eccb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:36:51.794793 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1116/2195] 10.222.0.23 () {58 vars in 1232 bytes} [Tue May 10 05:36:51 2022] DELETE /identity/v3/projects/def716ff123b47f6b525ec0f116ae19a => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 05:36:51.807120 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6696f899-84cc-45e2-8376-d84a6ebb0225 None None] REQUEST_METHOD: `POST` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:36:51.812600 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6696f899-84cc-45e2-8376-d84a6ebb0225 None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:36:51.813078 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6696f899-84cc-45e2-8376-d84a6ebb0225 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:36:51.861807 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.auth.core [None req-6696f899-84cc-45e2-8376-d84a6ebb0225 None None] MFA Rules not processed for user `44883b22532e44049d846938dc2cf423`. Rule list: `[]` (Enabled: `True`). {{(pid=79879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:36:51.863054 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-6696f899-84cc-45e2-8376-d84a6ebb0225 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:36:51.984678 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1080/2196] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 10 05:36:51 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 05:36:51.994281 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb6d939-2396-468f-9a28-9fb74fd890ee None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:36:51.996943 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-dcb6d939-2396-468f-9a28-9fb74fd890ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:36:52.012784 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1117/2197] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 10 05:36:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 05:36:52.020576 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e63f482-b415-4f23-982d-807a5d1fa266 None None] REQUEST_METHOD: `POST` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:36:52.021084 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e63f482-b415-4f23-982d-807a5d1fa266 None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:36:52.021641 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e63f482-b415-4f23-982d-807a5d1fa266 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:36:52.053911 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.auth.core [None req-7e63f482-b415-4f23-982d-807a5d1fa266 None None] MFA Rules not processed for user `44883b22532e44049d846938dc2cf423`. Rule list: `[]` (Enabled: `True`). {{(pid=79879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:36:52.055143 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-7e63f482-b415-4f23-982d-807a5d1fa266 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:36:52.064273 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1118/2198] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 10 05:36:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 05:36:52.069909 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e63f482-b415-4f23-982d-807a5d1fa266 None None] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:36:52.098272 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e63f482-b415-4f23-982d-807a5d1fa266 None None] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:36:52.104294 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a38d00a-2299-48a0-ba5e-44ee62fa9c39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:36:52.104986 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a38d00a-2299-48a0-ba5e-44ee62fa9c39 admin admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:36:52.105269 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a38d00a-2299-48a0-ba5e-44ee62fa9c39 admin admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:36:52.105541 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a38d00a-2299-48a0-ba5e-44ee62fa9c39 admin admin] PATH_INFO: `/v3/domains` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:36:52.106276 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a38d00a-2299-48a0-ba5e-44ee62fa9c39 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:36:52.106667 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a38d00a-2299-48a0-ba5e-44ee62fa9c39 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:36:52.108511 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a38d00a-2299-48a0-ba5e-44ee62fa9c39 admin admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:36:52.144585 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1119/2199] 10.222.0.23 () {58 vars in 1152 bytes} [Tue May 10 05:36:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:36:52.148920 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a38d00a-2299-48a0-ba5e-44ee62fa9c39 admin admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:36:52.172009 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a38d00a-2299-48a0-ba5e-44ee62fa9c39 admin admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:36:52.181599 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb6d939-2396-468f-9a28-9fb74fd890ee None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:36:52.188667 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a61f2d-bcfd-4ea2-91a0-cdf3bb6337b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:36:52.189168 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878a7594-162e-4611-9e53-3d6c071a9a7b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f50f224ca944983aecfde86375473da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f23435f783540199d6dcfd0417c090e', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:36:52.189352 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a61f2d-bcfd-4ea2-91a0-cdf3bb6337b8 admin admin] REQUEST_METHOD: `POST` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:36:52.189632 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a61f2d-bcfd-4ea2-91a0-cdf3bb6337b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:36:52.189904 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a61f2d-bcfd-4ea2-91a0-cdf3bb6337b8 admin admin] PATH_INFO: `/v3/projects` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:36:52.190630 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a61f2d-bcfd-4ea2-91a0-cdf3bb6337b8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:36:52.191291 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878a7594-162e-4611-9e53-3d6c071a9a7b service nova] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:36:52.191772 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878a7594-162e-4611-9e53-3d6c071a9a7b service nova] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:36:52.192183 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878a7594-162e-4611-9e53-3d6c071a9a7b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:36:52.195851 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a61f2d-bcfd-4ea2-91a0-cdf3bb6337b8 admin admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:36:52.220240 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878a7594-162e-4611-9e53-3d6c071a9a7b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:36:52.222384 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878a7594-162e-4611-9e53-3d6c071a9a7b service nova] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:36:52.237937 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1081/2200] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 10 05:36:51 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 244 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 05:36:52.257484 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1120/2201] 10.222.0.23 () {60 vars in 1152 bytes} [Tue May 10 05:36:52 2022] POST /identity/v3/projects => generated 367 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 05:36:52.263713 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878a7594-162e-4611-9e53-3d6c071a9a7b service nova] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:36:52.276336 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878a7594-162e-4611-9e53-3d6c071a9a7b service nova] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:36:52.438105 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26407a5e-4ca5-41da-bc80-a94778f0b2e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:36:52.439018 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26407a5e-4ca5-41da-bc80-a94778f0b2e8 admin admin] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:36:52.439358 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26407a5e-4ca5-41da-bc80-a94778f0b2e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:36:52.439788 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26407a5e-4ca5-41da-bc80-a94778f0b2e8 admin admin] PATH_INFO: `/v3/users` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:36:52.441076 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26407a5e-4ca5-41da-bc80-a94778f0b2e8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:36:52.443350 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26407a5e-4ca5-41da-bc80-a94778f0b2e8 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:36:52.484650 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1082/2202] 10.222.0.23 () {60 vars in 1143 bytes} [Tue May 10 05:36:52 2022] POST /identity/v3/users => generated 284 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 05:36:52.488465 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a61f2d-bcfd-4ea2-91a0-cdf3bb6337b8 admin admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:36:52.508457 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a61f2d-bcfd-4ea2-91a0-cdf3bb6337b8 admin admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:36:52.525432 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37737896-9abe-4c99-87f7-eaf670fef162 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:36:52.526244 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37737896-9abe-4c99-87f7-eaf670fef162 admin admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:36:52.526597 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37737896-9abe-4c99-87f7-eaf670fef162 admin admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:36:52.526928 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37737896-9abe-4c99-87f7-eaf670fef162 admin admin] PATH_INFO: `/v3/roles` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:36:52.527916 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37737896-9abe-4c99-87f7-eaf670fef162 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:36:52.531928 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37737896-9abe-4c99-87f7-eaf670fef162 admin admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:36:52.558390 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1121/2203] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 10 05:36:52 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 05:36:52.562213 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26407a5e-4ca5-41da-bc80-a94778f0b2e8 admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:36:52.573811 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26407a5e-4ca5-41da-bc80-a94778f0b2e8 admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:36:52.580859 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbac3501-5128-4f79-8495-c65ec6656fb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:36:52.581835 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbac3501-5128-4f79-8495-c65ec6656fb9 admin admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:36:52.582260 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbac3501-5128-4f79-8495-c65ec6656fb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:36:52.582675 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbac3501-5128-4f79-8495-c65ec6656fb9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:36:52.583593 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbac3501-5128-4f79-8495-c65ec6656fb9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:36:52.585853 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbac3501-5128-4f79-8495-c65ec6656fb9 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:36:52.600131 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1083/2204] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 10 05:36:52 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 05:36:52.604237 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37737896-9abe-4c99-87f7-eaf670fef162 admin admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:36:52.617283 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37737896-9abe-4c99-87f7-eaf670fef162 admin admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:36:52.625105 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefeee3e-4328-4395-99f8-e016eb98709f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:36:52.627043 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefeee3e-4328-4395-99f8-e016eb98709f admin admin] REQUEST_METHOD: `PUT` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:36:52.627728 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefeee3e-4328-4395-99f8-e016eb98709f admin admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:36:52.628150 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefeee3e-4328-4395-99f8-e016eb98709f admin admin] PATH_INFO: `/v3/projects/f720c91a1d2a4802bbb969d3a58580c2/users/5a5651ba1dbd4b768d1ca302cf05f2d3/roles/382636e67fc142a2b2f486340d959e11` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:36:52.650382 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cefeee3e-4328-4395-99f8-e016eb98709f admin admin] RBAC: Authorizing `identity:create_grant(project_id=f720c91a1d2a4802bbb969d3a58580c2, user_id=5a5651ba1dbd4b768d1ca302cf05f2d3, role_id=382636e67fc142a2b2f486340d959e11)` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:36:52.653967 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cefeee3e-4328-4395-99f8-e016eb98709f admin admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:36:52.671197 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1122/2205] 10.222.0.23 () {60 vars in 1482 bytes} [Tue May 10 05:36:52 2022] PUT /identity/v3/projects/f720c91a1d2a4802bbb969d3a58580c2/users/5a5651ba1dbd4b768d1ca302cf05f2d3/roles/382636e67fc142a2b2f486340d959e11 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 05:36:52.682293 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7df087-8fa9-4b70-9e95-bfc048860697 None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:36:52.682561 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7df087-8fa9-4b70-9e95-bfc048860697 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:36:52.682857 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7df087-8fa9-4b70-9e95-bfc048860697 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:36:52.760973 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-3a7df087-8fa9-4b70-9e95-bfc048860697 None None] MFA Rules not processed for user `5a5651ba1dbd4b768d1ca302cf05f2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:36:52.762190 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-3a7df087-8fa9-4b70-9e95-bfc048860697 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:36:52.861471 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1084/2206] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 10 05:36:52 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 05:36:52.874922 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefeee3e-4328-4395-99f8-e016eb98709f admin admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:36:52.877230 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-cefeee3e-4328-4395-99f8-e016eb98709f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:36:53.001720 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefeee3e-4328-4395-99f8-e016eb98709f admin admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:36:53.013212 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fab9cb-9a8a-43a5-91ad-b5108dd37958 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5b56aedcfd74914938b0b9cdd102f48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f23435f783540199d6dcfd0417c090e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:36:53.014148 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fab9cb-9a8a-43a5-91ad-b5108dd37958 service glance] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:36:53.016734 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fab9cb-9a8a-43a5-91ad-b5108dd37958 service glance] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:36:53.017458 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fab9cb-9a8a-43a5-91ad-b5108dd37958 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:36:53.036944 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fab9cb-9a8a-43a5-91ad-b5108dd37958 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:36:53.038907 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fab9cb-9a8a-43a5-91ad-b5108dd37958 service glance] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:36:53.052542 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1123/2207] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 10 05:36:52 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 05:36:54.829322 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7041eda-ec8b-4752-8195-37d528aa906d None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:36:54.830299 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7041eda-ec8b-4752-8195-37d528aa906d None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:36:54.830570 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7041eda-ec8b-4752-8195-37d528aa906d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:36:54.866406 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-b7041eda-ec8b-4752-8195-37d528aa906d None None] MFA Rules not processed for user `da9d43f65eca485b8b629a4c7a867b93`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:36:54.873849 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-b7041eda-ec8b-4752-8195-37d528aa906d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:36:55.018703 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1085/2208] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 10 05:36:54 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 05:36:55.330981 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab214ce-75a1-43d4-abb5-fba35e009c9d None None] REQUEST_METHOD: `POST` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:36:55.331526 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab214ce-75a1-43d4-abb5-fba35e009c9d None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:36:55.331526 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab214ce-75a1-43d4-abb5-fba35e009c9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:36:55.395429 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.auth.core [None req-dab214ce-75a1-43d4-abb5-fba35e009c9d None None] MFA Rules not processed for user `c9faf8a8f8e747239a0e062471f4a1ca`. Rule list: `[]` (Enabled: `True`). {{(pid=79879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:36:55.396827 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-dab214ce-75a1-43d4-abb5-fba35e009c9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:36:55.541740 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1124/2209] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 10 05:36:55 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 05:36:55.555795 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7041eda-ec8b-4752-8195-37d528aa906d None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:36:55.631201 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7041eda-ec8b-4752-8195-37d528aa906d None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:36:55.637653 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eea9e45-e94a-4547-8966-b276186e22d1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f50f224ca944983aecfde86375473da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f23435f783540199d6dcfd0417c090e', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:36:55.638429 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eea9e45-e94a-4547-8966-b276186e22d1 service nova] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:36:55.638827 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eea9e45-e94a-4547-8966-b276186e22d1 service nova] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:36:55.639249 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eea9e45-e94a-4547-8966-b276186e22d1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:36:55.641905 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-0eea9e45-e94a-4547-8966-b276186e22d1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:36:55.763829 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eea9e45-e94a-4547-8966-b276186e22d1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:36:55.765931 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eea9e45-e94a-4547-8966-b276186e22d1 service nova] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:36:55.778490 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1086/2210] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 10 05:36:55 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 05:36:57.896182 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9204f14-1396-4b37-aa9d-0bd724410102 None None] REQUEST_METHOD: `POST` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:36:57.897411 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9204f14-1396-4b37-aa9d-0bd724410102 None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:36:57.897411 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9204f14-1396-4b37-aa9d-0bd724410102 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:36:57.914634 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.auth.core [None req-b9204f14-1396-4b37-aa9d-0bd724410102 None None] MFA Rules not processed for user `8e8273af61e041cbac9974ece62c86ad`. Rule list: `[]` (Enabled: `True`). {{(pid=79879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:36:57.916514 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-b9204f14-1396-4b37-aa9d-0bd724410102 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:36:57.923827 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1125/2211] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 10 05:36:57 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 05:37:32.418591 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eea9e45-e94a-4547-8966-b276186e22d1 service nova] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:37:32.498727 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eea9e45-e94a-4547-8966-b276186e22d1 service nova] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:37:32.503764 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce25452a-c9b0-4939-8817-e38b3293eeef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:37:32.505371 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce25452a-c9b0-4939-8817-e38b3293eeef admin admin] REQUEST_METHOD: `DELETE` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:37:32.505371 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce25452a-c9b0-4939-8817-e38b3293eeef admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:37:32.505371 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce25452a-c9b0-4939-8817-e38b3293eeef admin admin] PATH_INFO: `/v3/users/5a5651ba1dbd4b768d1ca302cf05f2d3` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:37:32.506424 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce25452a-c9b0-4939-8817-e38b3293eeef admin admin] RBAC: Authorizing `identity:delete_user(user_id=5a5651ba1dbd4b768d1ca302cf05f2d3)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:37:32.508528 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce25452a-c9b0-4939-8817-e38b3293eeef admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:37:32.570710 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-ce25452a-c9b0-4939-8817-e38b3293eeef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5a5651ba1dbd4b768d1ca302cf05f2d3'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:37:32.584372 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-ce25452a-c9b0-4939-8817-e38b3293eeef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5a5651ba1dbd4b768d1ca302cf05f2d3'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:37:32.585046 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-ce25452a-c9b0-4939-8817-e38b3293eeef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5a5651ba1dbd4b768d1ca302cf05f2d3'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:37:32.592425 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-ce25452a-c9b0-4939-8817-e38b3293eeef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5a5651ba1dbd4b768d1ca302cf05f2d3'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:37:32.593267 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-ce25452a-c9b0-4939-8817-e38b3293eeef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5a5651ba1dbd4b768d1ca302cf05f2d3'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:37:32.607364 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1087/2212] 10.222.0.23 () {58 vars in 1223 bytes} [Tue May 10 05:37:32 2022] DELETE /identity/v3/users/5a5651ba1dbd4b768d1ca302cf05f2d3 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 05:37:32.612069 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2686cd-1fdf-47b6-8ef0-d5a5ba76e8e8 None None] REQUEST_METHOD: `POST` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:37:32.612600 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2686cd-1fdf-47b6-8ef0-d5a5ba76e8e8 None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:37:32.612600 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2686cd-1fdf-47b6-8ef0-d5a5ba76e8e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:37:32.640992 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.auth.core [None req-da2686cd-1fdf-47b6-8ef0-d5a5ba76e8e8 None None] MFA Rules not processed for user `44883b22532e44049d846938dc2cf423`. Rule list: `[]` (Enabled: `True`). {{(pid=79879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:37:32.642162 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-da2686cd-1fdf-47b6-8ef0-d5a5ba76e8e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:37:32.718502 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1126/2213] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 10 05:37:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 05:37:32.728668 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce25452a-c9b0-4939-8817-e38b3293eeef admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:37:32.730376 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-ce25452a-c9b0-4939-8817-e38b3293eeef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:37:32.792759 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce25452a-c9b0-4939-8817-e38b3293eeef admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:37:32.796704 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39368cb-bc30-4e8d-9724-3494e9900f08 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c8461cfdd9648b8abcaf8d34b7a102a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f23435f783540199d6dcfd0417c090e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:37:32.797360 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39368cb-bc30-4e8d-9724-3494e9900f08 service neutron] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:37:32.797639 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39368cb-bc30-4e8d-9724-3494e9900f08 service neutron] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:37:32.798564 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39368cb-bc30-4e8d-9724-3494e9900f08 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:37:32.807826 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39368cb-bc30-4e8d-9724-3494e9900f08 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:37:32.811750 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39368cb-bc30-4e8d-9724-3494e9900f08 service neutron] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:37:32.819460 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1088/2214] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 10 05:37:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 05:37:33.106160 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2686cd-1fdf-47b6-8ef0-d5a5ba76e8e8 None None] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:37:33.110852 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-da2686cd-1fdf-47b6-8ef0-d5a5ba76e8e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:37:33.124140 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2686cd-1fdf-47b6-8ef0-d5a5ba76e8e8 None None] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:37:33.129477 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2f1be7-d3b6-45a8-a134-4eb4be3f0bb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:37:33.130542 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2f1be7-d3b6-45a8-a134-4eb4be3f0bb1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:37:33.131117 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2f1be7-d3b6-45a8-a134-4eb4be3f0bb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:37:33.131117 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2f1be7-d3b6-45a8-a134-4eb4be3f0bb1 admin admin] PATH_INFO: `/v3/projects/f720c91a1d2a4802bbb969d3a58580c2` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:37:33.132659 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2f1be7-d3b6-45a8-a134-4eb4be3f0bb1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f720c91a1d2a4802bbb969d3a58580c2)` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:37:33.135170 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2f1be7-d3b6-45a8-a134-4eb4be3f0bb1 admin admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:37:33.187226 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-8f2f1be7-d3b6-45a8-a134-4eb4be3f0bb1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f720c91a1d2a4802bbb969d3a58580c2', 'request_id': 'req-8f2f1be7-d3b6-45a8-a134-4eb4be3f0bb1'} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:37:33.194263 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-8f2f1be7-d3b6-45a8-a134-4eb4be3f0bb1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f720c91a1d2a4802bbb969d3a58580c2', 'request_id': 'req-8f2f1be7-d3b6-45a8-a134-4eb4be3f0bb1'} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:37:33.203631 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-8f2f1be7-d3b6-45a8-a134-4eb4be3f0bb1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f720c91a1d2a4802bbb969d3a58580c2', 'request_id': 'req-8f2f1be7-d3b6-45a8-a134-4eb4be3f0bb1'} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:37:33.214481 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-8f2f1be7-d3b6-45a8-a134-4eb4be3f0bb1 admin admin] The token cache is being invalidate because project f720c91a1d2a4802bbb969d3a58580c2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79879) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 05:37:33.214765 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-8f2f1be7-d3b6-45a8-a134-4eb4be3f0bb1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:37:33.215594 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-8f2f1be7-d3b6-45a8-a134-4eb4be3f0bb1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:37:33.217160 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1127/2215] 10.222.0.23 () {58 vars in 1232 bytes} [Tue May 10 05:37:33 2022] DELETE /identity/v3/projects/f720c91a1d2a4802bbb969d3a58580c2 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 05:37:33.222166 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b36c52-4c87-4512-bdfb-52cf04db0545 None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:37:33.222492 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b36c52-4c87-4512-bdfb-52cf04db0545 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:37:33.222773 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b36c52-4c87-4512-bdfb-52cf04db0545 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:37:33.241006 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-e4b36c52-4c87-4512-bdfb-52cf04db0545 None None] MFA Rules not processed for user `44883b22532e44049d846938dc2cf423`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:37:33.242222 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-e4b36c52-4c87-4512-bdfb-52cf04db0545 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:37:33.309647 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1089/2216] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 10 05:37:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 05:37:33.317170 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb95a4e2-4ef0-437e-ae82-32cb39043df3 None None] REQUEST_METHOD: `POST` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:37:33.317458 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb95a4e2-4ef0-437e-ae82-32cb39043df3 None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:37:33.317731 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb95a4e2-4ef0-437e-ae82-32cb39043df3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:37:33.337257 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.auth.core [None req-cb95a4e2-4ef0-437e-ae82-32cb39043df3 None None] MFA Rules not processed for user `44883b22532e44049d846938dc2cf423`. Rule list: `[]` (Enabled: `True`). {{(pid=79879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:37:33.338459 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-cb95a4e2-4ef0-437e-ae82-32cb39043df3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:37:33.347729 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1128/2217] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 10 05:37:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 05:37:33.351567 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b36c52-4c87-4512-bdfb-52cf04db0545 None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:37:33.362052 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b36c52-4c87-4512-bdfb-52cf04db0545 None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:37:33.366716 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155a51a5-0606-4064-ae04-a53c56f24148 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:37:33.367484 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155a51a5-0606-4064-ae04-a53c56f24148 admin admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:37:33.367859 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155a51a5-0606-4064-ae04-a53c56f24148 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:37:33.368196 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155a51a5-0606-4064-ae04-a53c56f24148 admin admin] PATH_INFO: `/v3/domains` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:37:33.369023 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155a51a5-0606-4064-ae04-a53c56f24148 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:37:33.369385 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155a51a5-0606-4064-ae04-a53c56f24148 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:37:33.371033 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155a51a5-0606-4064-ae04-a53c56f24148 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:37:33.387379 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1090/2218] 10.222.0.23 () {58 vars in 1152 bytes} [Tue May 10 05:37:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:37:33.390167 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb95a4e2-4ef0-437e-ae82-32cb39043df3 None None] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:37:33.400504 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb95a4e2-4ef0-437e-ae82-32cb39043df3 None None] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:37:33.409794 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd37cc70-11ad-4070-9ad7-8470916fa5c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:37:33.410567 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd37cc70-11ad-4070-9ad7-8470916fa5c9 admin admin] REQUEST_METHOD: `POST` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:37:33.410801 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd37cc70-11ad-4070-9ad7-8470916fa5c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:37:33.411094 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd37cc70-11ad-4070-9ad7-8470916fa5c9 admin admin] PATH_INFO: `/v3/projects` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:37:33.411901 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd37cc70-11ad-4070-9ad7-8470916fa5c9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:37:33.414815 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd37cc70-11ad-4070-9ad7-8470916fa5c9 admin admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:37:33.449598 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1129/2219] 10.222.0.23 () {60 vars in 1152 bytes} [Tue May 10 05:37:33 2022] POST /identity/v3/projects => generated 373 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 05:37:33.453567 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155a51a5-0606-4064-ae04-a53c56f24148 admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:37:33.464520 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155a51a5-0606-4064-ae04-a53c56f24148 admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:37:33.525952 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c45285-0aa3-470b-b9a1-ff84d7072bc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:37:33.526906 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c45285-0aa3-470b-b9a1-ff84d7072bc8 admin admin] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:37:33.527185 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c45285-0aa3-470b-b9a1-ff84d7072bc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:37:33.527459 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c45285-0aa3-470b-b9a1-ff84d7072bc8 admin admin] PATH_INFO: `/v3/users` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:37:33.528200 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c45285-0aa3-470b-b9a1-ff84d7072bc8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:37:33.530157 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c45285-0aa3-470b-b9a1-ff84d7072bc8 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:37:33.555936 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1091/2220] 10.222.0.23 () {60 vars in 1143 bytes} [Tue May 10 05:37:33 2022] POST /identity/v3/users => generated 287 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 05:37:33.559544 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd37cc70-11ad-4070-9ad7-8470916fa5c9 admin admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:37:33.569742 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd37cc70-11ad-4070-9ad7-8470916fa5c9 admin admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:37:33.575218 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d735bcb5-3140-42ac-a915-015c6463a1da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:37:33.576012 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d735bcb5-3140-42ac-a915-015c6463a1da admin admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:37:33.576288 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d735bcb5-3140-42ac-a915-015c6463a1da admin admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:37:33.576555 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d735bcb5-3140-42ac-a915-015c6463a1da admin admin] PATH_INFO: `/v3/roles` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:37:33.577344 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d735bcb5-3140-42ac-a915-015c6463a1da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:37:33.578953 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d735bcb5-3140-42ac-a915-015c6463a1da admin admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:37:33.591146 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1130/2221] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 10 05:37:33 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 05:37:33.595748 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c45285-0aa3-470b-b9a1-ff84d7072bc8 admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:37:33.608169 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c45285-0aa3-470b-b9a1-ff84d7072bc8 admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:37:33.613457 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c84715-8e02-493d-83ed-6730e8ebc93f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:37:33.614127 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c84715-8e02-493d-83ed-6730e8ebc93f admin admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:37:33.614449 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c84715-8e02-493d-83ed-6730e8ebc93f admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:37:33.614709 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c84715-8e02-493d-83ed-6730e8ebc93f admin admin] PATH_INFO: `/v3/roles` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:37:33.615427 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c84715-8e02-493d-83ed-6730e8ebc93f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:37:33.617304 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c84715-8e02-493d-83ed-6730e8ebc93f admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:37:33.628852 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1092/2222] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 10 05:37:33 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 05:37:33.633492 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d735bcb5-3140-42ac-a915-015c6463a1da admin admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:37:33.645196 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d735bcb5-3140-42ac-a915-015c6463a1da admin admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:37:33.651447 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93561dc3-b7e0-4833-8fdb-074ef7390384 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:37:33.652328 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93561dc3-b7e0-4833-8fdb-074ef7390384 admin admin] REQUEST_METHOD: `PUT` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:37:33.652786 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93561dc3-b7e0-4833-8fdb-074ef7390384 admin admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:37:33.653201 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93561dc3-b7e0-4833-8fdb-074ef7390384 admin admin] PATH_INFO: `/v3/projects/682ef27f50894a2da761097f089a4c4c/users/37c4db130d364655a4f5882a3a96b780/roles/382636e67fc142a2b2f486340d959e11` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:37:33.671401 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93561dc3-b7e0-4833-8fdb-074ef7390384 admin admin] RBAC: Authorizing `identity:create_grant(project_id=682ef27f50894a2da761097f089a4c4c, user_id=37c4db130d364655a4f5882a3a96b780, role_id=382636e67fc142a2b2f486340d959e11)` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:37:33.674140 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93561dc3-b7e0-4833-8fdb-074ef7390384 admin admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:37:33.706260 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1131/2223] 10.222.0.23 () {60 vars in 1482 bytes} [Tue May 10 05:37:33 2022] PUT /identity/v3/projects/682ef27f50894a2da761097f089a4c4c/users/37c4db130d364655a4f5882a3a96b780/roles/382636e67fc142a2b2f486340d959e11 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 05:37:33.716329 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d057134-9947-45b2-be2d-6930db979392 None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:37:33.716823 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d057134-9947-45b2-be2d-6930db979392 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:37:33.717105 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d057134-9947-45b2-be2d-6930db979392 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:37:33.746389 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-3d057134-9947-45b2-be2d-6930db979392 None None] MFA Rules not processed for user `37c4db130d364655a4f5882a3a96b780`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:37:33.748061 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-3d057134-9947-45b2-be2d-6930db979392 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:37:33.821051 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1093/2224] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 10 05:37:33 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 05:37:33.834624 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93561dc3-b7e0-4833-8fdb-074ef7390384 admin admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:37:33.840391 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-93561dc3-b7e0-4833-8fdb-074ef7390384 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:37:33.900696 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93561dc3-b7e0-4833-8fdb-074ef7390384 admin admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:37:33.905495 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038ff7d0-882d-4862-a473-51bca357df01 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355be413675540a39ccb00e1a0722316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f23435f783540199d6dcfd0417c090e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:37:33.906319 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038ff7d0-882d-4862-a473-51bca357df01 service cinder] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:37:33.906740 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038ff7d0-882d-4862-a473-51bca357df01 service cinder] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:37:33.907170 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038ff7d0-882d-4862-a473-51bca357df01 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:37:33.928486 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038ff7d0-882d-4862-a473-51bca357df01 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:37:33.930382 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038ff7d0-882d-4862-a473-51bca357df01 service cinder] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:37:33.947466 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1132/2225] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 10 05:37:33 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 05:37:33.986870 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d057134-9947-45b2-be2d-6930db979392 None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:37:34.065346 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d057134-9947-45b2-be2d-6930db979392 None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:37:34.077506 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d428a3-bb45-4e3b-aa25-d157b465d638 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:37:34.078614 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d428a3-bb45-4e3b-aa25-d157b465d638 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:37:34.079264 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d428a3-bb45-4e3b-aa25-d157b465d638 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:37:34.079768 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d428a3-bb45-4e3b-aa25-d157b465d638 admin admin] PATH_INFO: `/v3/users/37c4db130d364655a4f5882a3a96b780` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:37:34.081280 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d428a3-bb45-4e3b-aa25-d157b465d638 admin admin] RBAC: Authorizing `identity:delete_user(user_id=37c4db130d364655a4f5882a3a96b780)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:37:34.095467 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d428a3-bb45-4e3b-aa25-d157b465d638 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:37:34.165621 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-a1d428a3-bb45-4e3b-aa25-d157b465d638 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '37c4db130d364655a4f5882a3a96b780'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:37:34.183068 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-a1d428a3-bb45-4e3b-aa25-d157b465d638 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '37c4db130d364655a4f5882a3a96b780'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:37:34.184460 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-a1d428a3-bb45-4e3b-aa25-d157b465d638 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '37c4db130d364655a4f5882a3a96b780'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:37:34.200031 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-a1d428a3-bb45-4e3b-aa25-d157b465d638 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '37c4db130d364655a4f5882a3a96b780'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:37:34.208591 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-a1d428a3-bb45-4e3b-aa25-d157b465d638 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '37c4db130d364655a4f5882a3a96b780'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:37:34.232434 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1094/2226] 10.222.0.23 () {58 vars in 1223 bytes} [Tue May 10 05:37:33 2022] DELETE /identity/v3/users/37c4db130d364655a4f5882a3a96b780 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 05:37:34.236760 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de23ad1-65c2-4ee6-814c-82e996ebc957 None None] REQUEST_METHOD: `POST` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:37:34.237058 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de23ad1-65c2-4ee6-814c-82e996ebc957 None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:37:34.237334 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de23ad1-65c2-4ee6-814c-82e996ebc957 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:37:34.261170 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.auth.core [None req-9de23ad1-65c2-4ee6-814c-82e996ebc957 None None] MFA Rules not processed for user `44883b22532e44049d846938dc2cf423`. Rule list: `[]` (Enabled: `True`). {{(pid=79879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:37:34.262386 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-9de23ad1-65c2-4ee6-814c-82e996ebc957 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:37:34.368996 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1133/2227] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 10 05:37:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 05:37:34.379005 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d428a3-bb45-4e3b-aa25-d157b465d638 admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:37:34.380620 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-a1d428a3-bb45-4e3b-aa25-d157b465d638 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:37:34.440426 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d428a3-bb45-4e3b-aa25-d157b465d638 admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:37:34.444808 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af694fe0-7f9d-444f-91cc-84f700e9b5a3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c8461cfdd9648b8abcaf8d34b7a102a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f23435f783540199d6dcfd0417c090e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:37:34.445464 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af694fe0-7f9d-444f-91cc-84f700e9b5a3 service neutron] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:37:34.445746 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af694fe0-7f9d-444f-91cc-84f700e9b5a3 service neutron] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:37:34.446023 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af694fe0-7f9d-444f-91cc-84f700e9b5a3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:37:34.457858 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af694fe0-7f9d-444f-91cc-84f700e9b5a3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:37:34.459654 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af694fe0-7f9d-444f-91cc-84f700e9b5a3 service neutron] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:37:34.477460 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1095/2228] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 10 05:37:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 05:37:34.854083 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de23ad1-65c2-4ee6-814c-82e996ebc957 None None] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:37:34.856515 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-9de23ad1-65c2-4ee6-814c-82e996ebc957 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:37:34.870627 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de23ad1-65c2-4ee6-814c-82e996ebc957 None None] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:37:34.876800 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca80b8f-b795-4cbf-9514-b7761cf68640 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:37:34.877795 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca80b8f-b795-4cbf-9514-b7761cf68640 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:37:34.878318 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca80b8f-b795-4cbf-9514-b7761cf68640 admin admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:37:34.878789 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca80b8f-b795-4cbf-9514-b7761cf68640 admin admin] PATH_INFO: `/v3/projects/682ef27f50894a2da761097f089a4c4c` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:37:34.880773 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca80b8f-b795-4cbf-9514-b7761cf68640 admin admin] RBAC: Authorizing `identity:delete_project(project_id=682ef27f50894a2da761097f089a4c4c)` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:37:34.882680 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca80b8f-b795-4cbf-9514-b7761cf68640 admin admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:37:34.931556 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-eca80b8f-b795-4cbf-9514-b7761cf68640 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '682ef27f50894a2da761097f089a4c4c', 'request_id': 'req-eca80b8f-b795-4cbf-9514-b7761cf68640'} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:37:34.937941 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-eca80b8f-b795-4cbf-9514-b7761cf68640 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '682ef27f50894a2da761097f089a4c4c', 'request_id': 'req-eca80b8f-b795-4cbf-9514-b7761cf68640'} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:37:34.946122 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-eca80b8f-b795-4cbf-9514-b7761cf68640 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '682ef27f50894a2da761097f089a4c4c', 'request_id': 'req-eca80b8f-b795-4cbf-9514-b7761cf68640'} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:37:34.956496 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-eca80b8f-b795-4cbf-9514-b7761cf68640 admin admin] The token cache is being invalidate because project 682ef27f50894a2da761097f089a4c4c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79879) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 05:37:34.956776 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-eca80b8f-b795-4cbf-9514-b7761cf68640 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:37:34.957406 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-eca80b8f-b795-4cbf-9514-b7761cf68640 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:37:34.958988 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1134/2229] 10.222.0.23 () {58 vars in 1232 bytes} [Tue May 10 05:37:34 2022] DELETE /identity/v3/projects/682ef27f50894a2da761097f089a4c4c => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 05:37:34.964048 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d621b73-db0b-41ab-b387-250a8246e5ad None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:37:34.964339 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d621b73-db0b-41ab-b387-250a8246e5ad None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:37:34.964611 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d621b73-db0b-41ab-b387-250a8246e5ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:37:34.981675 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-1d621b73-db0b-41ab-b387-250a8246e5ad None None] MFA Rules not processed for user `44883b22532e44049d846938dc2cf423`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:37:34.982957 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-1d621b73-db0b-41ab-b387-250a8246e5ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:37:35.040141 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1096/2230] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 10 05:37:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 05:37:35.048846 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ca4170-d05f-4511-8fff-32daeb698225 None None] REQUEST_METHOD: `POST` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:37:35.049104 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ca4170-d05f-4511-8fff-32daeb698225 None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:37:35.049379 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ca4170-d05f-4511-8fff-32daeb698225 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:37:35.067642 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.auth.core [None req-26ca4170-d05f-4511-8fff-32daeb698225 None None] MFA Rules not processed for user `44883b22532e44049d846938dc2cf423`. Rule list: `[]` (Enabled: `True`). {{(pid=79879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:37:35.068809 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-26ca4170-d05f-4511-8fff-32daeb698225 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:37:35.077117 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1135/2231] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 10 05:37:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 05:37:35.081213 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d621b73-db0b-41ab-b387-250a8246e5ad None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:37:35.090931 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d621b73-db0b-41ab-b387-250a8246e5ad None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:37:35.096621 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199d97d3-946b-4224-9bad-ea2ba80d467a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:37:35.097271 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199d97d3-946b-4224-9bad-ea2ba80d467a admin admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:37:35.097553 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199d97d3-946b-4224-9bad-ea2ba80d467a admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:37:35.097822 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199d97d3-946b-4224-9bad-ea2ba80d467a admin admin] PATH_INFO: `/v3/domains` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:37:35.098522 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199d97d3-946b-4224-9bad-ea2ba80d467a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:37:35.098857 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199d97d3-946b-4224-9bad-ea2ba80d467a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:37:35.100497 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199d97d3-946b-4224-9bad-ea2ba80d467a admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:37:35.115001 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1097/2232] 10.222.0.23 () {58 vars in 1152 bytes} [Tue May 10 05:37:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 05:37:35.119264 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ca4170-d05f-4511-8fff-32daeb698225 None None] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:37:35.128898 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ca4170-d05f-4511-8fff-32daeb698225 None None] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:37:35.134681 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d49a08-0478-4ce4-8bf4-7fd18c4733e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:37:35.135334 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d49a08-0478-4ce4-8bf4-7fd18c4733e7 admin admin] REQUEST_METHOD: `POST` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:37:35.135878 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d49a08-0478-4ce4-8bf4-7fd18c4733e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:37:35.136129 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d49a08-0478-4ce4-8bf4-7fd18c4733e7 admin admin] PATH_INFO: `/v3/projects` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:37:35.136837 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d49a08-0478-4ce4-8bf4-7fd18c4733e7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:37:35.138746 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d49a08-0478-4ce4-8bf4-7fd18c4733e7 admin admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:37:35.166803 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1136/2233] 10.222.0.23 () {60 vars in 1152 bytes} [Tue May 10 05:37:35 2022] POST /identity/v3/projects => generated 383 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 05:37:35.171212 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199d97d3-946b-4224-9bad-ea2ba80d467a admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:37:35.181145 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199d97d3-946b-4224-9bad-ea2ba80d467a admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:37:35.236298 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15967f6-9fca-4ab9-9f1d-8250d38f0de2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:37:35.236889 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15967f6-9fca-4ab9-9f1d-8250d38f0de2 admin admin] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:37:35.237166 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15967f6-9fca-4ab9-9f1d-8250d38f0de2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:37:35.237440 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15967f6-9fca-4ab9-9f1d-8250d38f0de2 admin admin] PATH_INFO: `/v3/users` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:37:35.238127 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15967f6-9fca-4ab9-9f1d-8250d38f0de2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:37:35.240072 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15967f6-9fca-4ab9-9f1d-8250d38f0de2 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:37:35.266130 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1098/2234] 10.222.0.23 () {60 vars in 1143 bytes} [Tue May 10 05:37:35 2022] POST /identity/v3/users => generated 292 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 05:37:35.271196 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d49a08-0478-4ce4-8bf4-7fd18c4733e7 admin admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:37:35.281944 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d49a08-0478-4ce4-8bf4-7fd18c4733e7 admin admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:37:35.287771 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2fa0c7-a3f8-454c-b7bd-b5cb0e06bc7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:37:35.288425 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2fa0c7-a3f8-454c-b7bd-b5cb0e06bc7e admin admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:37:35.288707 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2fa0c7-a3f8-454c-b7bd-b5cb0e06bc7e admin admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:37:35.288976 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2fa0c7-a3f8-454c-b7bd-b5cb0e06bc7e admin admin] PATH_INFO: `/v3/roles` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:37:35.289713 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2fa0c7-a3f8-454c-b7bd-b5cb0e06bc7e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:37:35.291342 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2fa0c7-a3f8-454c-b7bd-b5cb0e06bc7e admin admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:37:35.302115 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1137/2235] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 10 05:37:35 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 05:37:35.306080 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15967f6-9fca-4ab9-9f1d-8250d38f0de2 admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:37:35.316220 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15967f6-9fca-4ab9-9f1d-8250d38f0de2 admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:37:35.321259 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038dd81b-cb8e-462a-9cb8-df2111eb0aba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:37:35.321942 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038dd81b-cb8e-462a-9cb8-df2111eb0aba admin admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:37:35.322224 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038dd81b-cb8e-462a-9cb8-df2111eb0aba admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:37:35.322497 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038dd81b-cb8e-462a-9cb8-df2111eb0aba admin admin] PATH_INFO: `/v3/roles` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:37:35.323456 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038dd81b-cb8e-462a-9cb8-df2111eb0aba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:37:35.325082 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038dd81b-cb8e-462a-9cb8-df2111eb0aba admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:37:35.335468 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1099/2236] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 10 05:37:35 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 05:37:35.339490 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2fa0c7-a3f8-454c-b7bd-b5cb0e06bc7e admin admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:37:35.349661 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2fa0c7-a3f8-454c-b7bd-b5cb0e06bc7e admin admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:37:35.355512 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80613950-cf00-4634-a808-9a4582197da0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:37:35.356614 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80613950-cf00-4634-a808-9a4582197da0 admin admin] REQUEST_METHOD: `PUT` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:37:35.356872 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80613950-cf00-4634-a808-9a4582197da0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:37:35.357144 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80613950-cf00-4634-a808-9a4582197da0 admin admin] PATH_INFO: `/v3/projects/54da2dd57fd4488ea0266dc8d744cc25/users/1a35edf14fef4d408ae00e7d6fd11399/roles/382636e67fc142a2b2f486340d959e11` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:37:35.376723 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80613950-cf00-4634-a808-9a4582197da0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=54da2dd57fd4488ea0266dc8d744cc25, user_id=1a35edf14fef4d408ae00e7d6fd11399, role_id=382636e67fc142a2b2f486340d959e11)` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:37:35.379390 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80613950-cf00-4634-a808-9a4582197da0 admin admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:37:35.393397 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1138/2237] 10.222.0.23 () {60 vars in 1482 bytes} [Tue May 10 05:37:35 2022] PUT /identity/v3/projects/54da2dd57fd4488ea0266dc8d744cc25/users/1a35edf14fef4d408ae00e7d6fd11399/roles/382636e67fc142a2b2f486340d959e11 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 05:37:35.398236 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6454ea96-514f-4c26-90f4-b1b876ef13fb None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:37:35.398573 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6454ea96-514f-4c26-90f4-b1b876ef13fb None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:37:35.398815 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6454ea96-514f-4c26-90f4-b1b876ef13fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:37:35.416504 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-6454ea96-514f-4c26-90f4-b1b876ef13fb None None] MFA Rules not processed for user `44883b22532e44049d846938dc2cf423`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:37:35.417699 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-6454ea96-514f-4c26-90f4-b1b876ef13fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:37:35.477299 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1100/2238] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 10 05:37:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 05:37:35.486297 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80613950-cf00-4634-a808-9a4582197da0 admin admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:37:35.488187 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-80613950-cf00-4634-a808-9a4582197da0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:37:35.549933 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80613950-cf00-4634-a808-9a4582197da0 admin admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:37:35.553516 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc95203f-8790-4d0e-a09b-b9c4aad9e42f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c8461cfdd9648b8abcaf8d34b7a102a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f23435f783540199d6dcfd0417c090e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:37:35.554159 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc95203f-8790-4d0e-a09b-b9c4aad9e42f service neutron] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:37:35.554437 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc95203f-8790-4d0e-a09b-b9c4aad9e42f service neutron] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:37:35.554705 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc95203f-8790-4d0e-a09b-b9c4aad9e42f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:37:35.563431 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc95203f-8790-4d0e-a09b-b9c4aad9e42f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:37:35.564900 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc95203f-8790-4d0e-a09b-b9c4aad9e42f service neutron] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:37:35.574375 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1139/2239] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 10 05:37:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 05:37:37.311112 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9849b7e-ba7a-482e-b019-1576c36a6b76 None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:37:37.312103 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9849b7e-ba7a-482e-b019-1576c36a6b76 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:37:37.313159 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9849b7e-ba7a-482e-b019-1576c36a6b76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:37:37.331930 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-b9849b7e-ba7a-482e-b019-1576c36a6b76 None None] MFA Rules not processed for user `c5281b2a1c9a461995653be826207db4`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:37:37.333421 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-b9849b7e-ba7a-482e-b019-1576c36a6b76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:37:37.400103 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1101/2240] 10.222.0.23 () {58 vars in 1009 bytes} [Tue May 10 05:37:37 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 05:37:37.478881 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc95203f-8790-4d0e-a09b-b9c4aad9e42f service neutron] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:37:37.482159 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-fc95203f-8790-4d0e-a09b-b9c4aad9e42f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:37:37.556990 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc95203f-8790-4d0e-a09b-b9c4aad9e42f service neutron] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:37:37.562111 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513b126f-6d1c-48cd-9ce0-9b518be8aa91 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd31dacf30804395bd029037b407c12a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f23435f783540199d6dcfd0417c090e', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:37:37.562764 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513b126f-6d1c-48cd-9ce0-9b518be8aa91 service swift] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:37:37.563041 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513b126f-6d1c-48cd-9ce0-9b518be8aa91 service swift] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:37:37.563309 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513b126f-6d1c-48cd-9ce0-9b518be8aa91 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:37:37.572443 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513b126f-6d1c-48cd-9ce0-9b518be8aa91 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:37:37.574347 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513b126f-6d1c-48cd-9ce0-9b518be8aa91 service swift] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:37:37.590088 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1140/2241] 10.222.0.23 () {60 vars in 1384 bytes} [Tue May 10 05:37:37 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 10 05:37:42.552473 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94945114-3a77-4939-8800-6a0569a52eb0 None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:37:42.554429 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94945114-3a77-4939-8800-6a0569a52eb0 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:37:42.555003 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94945114-3a77-4939-8800-6a0569a52eb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:37:42.610808 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-94945114-3a77-4939-8800-6a0569a52eb0 None None] MFA Rules not processed for user `1a35edf14fef4d408ae00e7d6fd11399`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:37:42.612741 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-94945114-3a77-4939-8800-6a0569a52eb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:37:42.717758 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1102/2242] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 10 05:37:42 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 05:37:42.722221 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513b126f-6d1c-48cd-9ce0-9b518be8aa91 service swift] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:37:42.792639 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9e83d5-c3cc-45f2-9f1c-d934539d565f None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:37:42.793453 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9e83d5-c3cc-45f2-9f1c-d934539d565f None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:37:42.794662 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9e83d5-c3cc-45f2-9f1c-d934539d565f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:37:42.808834 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513b126f-6d1c-48cd-9ce0-9b518be8aa91 service swift] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:37:42.816638 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8513c2ff-1ce8-4948-b4d0-b09d581cec81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:37:42.817387 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8513c2ff-1ce8-4948-b4d0-b09d581cec81 admin admin] REQUEST_METHOD: `POST` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:37:42.817671 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8513c2ff-1ce8-4948-b4d0-b09d581cec81 admin admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:37:42.817944 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8513c2ff-1ce8-4948-b4d0-b09d581cec81 admin admin] PATH_INFO: `/v3/projects` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:37:42.818420 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-5e9e83d5-c3cc-45f2-9f1c-d934539d565f None None] MFA Rules not processed for user `952c90085aff498d9aca46518d272553`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:37:42.818794 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8513c2ff-1ce8-4948-b4d0-b09d581cec81 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:37:42.820111 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-5e9e83d5-c3cc-45f2-9f1c-d934539d565f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:37:42.821614 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8513c2ff-1ce8-4948-b4d0-b09d581cec81 admin admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:37:42.879252 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1141/2243] 10.222.0.23 () {60 vars in 1152 bytes} [Tue May 10 05:37:42 2022] POST /identity/v3/projects => generated 383 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 05:37:42.884138 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8513c2ff-1ce8-4948-b4d0-b09d581cec81 admin admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:37:42.911868 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1103/2244] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 10 05:37:42 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 05:37:42.960964 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8513c2ff-1ce8-4948-b4d0-b09d581cec81 admin admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:37:42.966008 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c57b6b-d075-4a7c-9213-8451a15fe281 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:37:42.966680 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c57b6b-d075-4a7c-9213-8451a15fe281 admin admin] REQUEST_METHOD: `POST` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:37:42.966959 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c57b6b-d075-4a7c-9213-8451a15fe281 admin admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:37:42.967234 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c57b6b-d075-4a7c-9213-8451a15fe281 admin admin] PATH_INFO: `/v3/users` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:37:42.967994 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c57b6b-d075-4a7c-9213-8451a15fe281 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:37:42.969965 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c57b6b-d075-4a7c-9213-8451a15fe281 admin admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:37:43.000810 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1142/2245] 10.222.0.23 () {60 vars in 1143 bytes} [Tue May 10 05:37:42 2022] POST /identity/v3/users => generated 298 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 05:37:43.001504 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9e83d5-c3cc-45f2-9f1c-d934539d565f None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:37:43.013175 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9e83d5-c3cc-45f2-9f1c-d934539d565f None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:37:43.023159 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d02a89b-d1be-41df-8498-a5e1f8e868c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:37:43.023953 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d02a89b-d1be-41df-8498-a5e1f8e868c4 admin admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:37:43.024258 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d02a89b-d1be-41df-8498-a5e1f8e868c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:37:43.024690 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d02a89b-d1be-41df-8498-a5e1f8e868c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:37:43.025501 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d02a89b-d1be-41df-8498-a5e1f8e868c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:37:43.027187 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d02a89b-d1be-41df-8498-a5e1f8e868c4 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:37:43.048057 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1104/2246] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 10 05:37:43 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 05:37:43.048928 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c57b6b-d075-4a7c-9213-8451a15fe281 admin admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:37:43.059181 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c57b6b-d075-4a7c-9213-8451a15fe281 admin admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:37:43.069457 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6df70a5-9e27-4506-8493-8faa55cddde6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:37:43.070371 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6df70a5-9e27-4506-8493-8faa55cddde6 admin admin] REQUEST_METHOD: `PUT` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:37:43.070646 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6df70a5-9e27-4506-8493-8faa55cddde6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:37:43.070913 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6df70a5-9e27-4506-8493-8faa55cddde6 admin admin] PATH_INFO: `/v3/projects/ca8030ffa56d425b8386c2aa2d96c1b1/users/f8b05ea570184d6bab70a0e97343a804/roles/199ac1dd842441d7913c6ee89d8fbecc` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:37:43.086656 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6df70a5-9e27-4506-8493-8faa55cddde6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca8030ffa56d425b8386c2aa2d96c1b1, user_id=f8b05ea570184d6bab70a0e97343a804, role_id=199ac1dd842441d7913c6ee89d8fbecc)` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:37:43.089430 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6df70a5-9e27-4506-8493-8faa55cddde6 admin admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:37:43.122420 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1143/2247] 10.222.0.23 () {60 vars in 1482 bytes} [Tue May 10 05:37:43 2022] PUT /identity/v3/projects/ca8030ffa56d425b8386c2aa2d96c1b1/users/f8b05ea570184d6bab70a0e97343a804/roles/199ac1dd842441d7913c6ee89d8fbecc => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 05:37:43.126562 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d02a89b-d1be-41df-8498-a5e1f8e868c4 admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:37:43.142408 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d02a89b-d1be-41df-8498-a5e1f8e868c4 admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:37:43.263395 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a4f26b-cc2b-47b9-8216-e59b9ff4b6d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:37:43.264257 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a4f26b-cc2b-47b9-8216-e59b9ff4b6d8 admin admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:37:43.264423 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a4f26b-cc2b-47b9-8216-e59b9ff4b6d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:37:43.265227 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a4f26b-cc2b-47b9-8216-e59b9ff4b6d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:37:43.267241 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a4f26b-cc2b-47b9-8216-e59b9ff4b6d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:37:43.281898 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a4f26b-cc2b-47b9-8216-e59b9ff4b6d8 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:37:43.300656 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1105/2248] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 10 05:37:43 2022] GET /identity/v3/roles => generated 1420 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 05:37:43.303530 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6df70a5-9e27-4506-8493-8faa55cddde6 admin admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:37:43.325315 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6df70a5-9e27-4506-8493-8faa55cddde6 admin admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:37:43.336727 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243a99ec-2dfe-41e0-8bb1-31e6730416bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:37:43.337647 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243a99ec-2dfe-41e0-8bb1-31e6730416bb admin admin] REQUEST_METHOD: `PUT` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:37:43.338008 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243a99ec-2dfe-41e0-8bb1-31e6730416bb admin admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:37:43.338176 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243a99ec-2dfe-41e0-8bb1-31e6730416bb admin admin] PATH_INFO: `/v3/projects/ca8030ffa56d425b8386c2aa2d96c1b1/users/f8b05ea570184d6bab70a0e97343a804/roles/199ac1dd842441d7913c6ee89d8fbecc` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:37:43.346418 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243a99ec-2dfe-41e0-8bb1-31e6730416bb admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca8030ffa56d425b8386c2aa2d96c1b1, user_id=f8b05ea570184d6bab70a0e97343a804, role_id=199ac1dd842441d7913c6ee89d8fbecc)` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:37:43.349644 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243a99ec-2dfe-41e0-8bb1-31e6730416bb admin admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:37:43.361458 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1144/2249] 10.222.0.23 () {60 vars in 1482 bytes} [Tue May 10 05:37:43 2022] PUT /identity/v3/projects/ca8030ffa56d425b8386c2aa2d96c1b1/users/f8b05ea570184d6bab70a0e97343a804/roles/199ac1dd842441d7913c6ee89d8fbecc => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 05:37:52.711095 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac1aaa0-38d2-4c35-949d-ff8a0fc29dac None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:37:52.711682 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac1aaa0-38d2-4c35-949d-ff8a0fc29dac None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:37:52.711792 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac1aaa0-38d2-4c35-949d-ff8a0fc29dac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:37:52.767624 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-9ac1aaa0-38d2-4c35-949d-ff8a0fc29dac None None] MFA Rules not processed for user `f8b05ea570184d6bab70a0e97343a804`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:37:52.768956 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-9ac1aaa0-38d2-4c35-949d-ff8a0fc29dac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:37:52.857914 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1106/2250] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 10 05:37:52 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 05:37:52.866135 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243a99ec-2dfe-41e0-8bb1-31e6730416bb admin admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:37:52.868766 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-243a99ec-2dfe-41e0-8bb1-31e6730416bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:37:52.996005 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243a99ec-2dfe-41e0-8bb1-31e6730416bb admin admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:37:53.000390 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cf5022-2578-46f4-81f1-03afe58dd628 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5b56aedcfd74914938b0b9cdd102f48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f23435f783540199d6dcfd0417c090e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:37:53.001212 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cf5022-2578-46f4-81f1-03afe58dd628 service glance] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:37:53.001738 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cf5022-2578-46f4-81f1-03afe58dd628 service glance] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:37:53.002113 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cf5022-2578-46f4-81f1-03afe58dd628 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:37:53.076684 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09cf5022-2578-46f4-81f1-03afe58dd628 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:37:53.078189 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09cf5022-2578-46f4-81f1-03afe58dd628 service glance] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:37:53.103748 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1145/2251] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 10 05:37:52 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 05:37:53.278577 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac1aaa0-38d2-4c35-949d-ff8a0fc29dac None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:37:53.299218 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9141b235-2aa9-49f0-80f2-873f197ac549 None None] REQUEST_METHOD: `POST` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:37:53.303258 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9141b235-2aa9-49f0-80f2-873f197ac549 None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:37:53.303791 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9141b235-2aa9-49f0-80f2-873f197ac549 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:37:53.352491 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.auth.core [None req-9141b235-2aa9-49f0-80f2-873f197ac549 None None] MFA Rules not processed for user `c5281b2a1c9a461995653be826207db4`. Rule list: `[]` (Enabled: `True`). {{(pid=79879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:37:53.354026 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-9141b235-2aa9-49f0-80f2-873f197ac549 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:37:53.388674 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac1aaa0-38d2-4c35-949d-ff8a0fc29dac None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:37:53.394503 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0d4394-e74d-48c4-86b5-ef9870e1fb1a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c8461cfdd9648b8abcaf8d34b7a102a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f23435f783540199d6dcfd0417c090e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:37:53.395179 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0d4394-e74d-48c4-86b5-ef9870e1fb1a service neutron] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:37:53.395467 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0d4394-e74d-48c4-86b5-ef9870e1fb1a service neutron] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:37:53.395786 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0d4394-e74d-48c4-86b5-ef9870e1fb1a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:37:53.399023 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-4d0d4394-e74d-48c4-86b5-ef9870e1fb1a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:37:53.443224 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1146/2252] 10.222.0.23 () {58 vars in 1009 bytes} [Tue May 10 05:37:53 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 05:37:53.457272 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9141b235-2aa9-49f0-80f2-873f197ac549 None None] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:37:53.512087 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0d4394-e74d-48c4-86b5-ef9870e1fb1a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:37:53.513809 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0d4394-e74d-48c4-86b5-ef9870e1fb1a service neutron] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:37:53.537711 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1107/2253] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 10 05:37:53 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 259 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 05:37:53.602142 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9141b235-2aa9-49f0-80f2-873f197ac549 None None] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:37:53.612898 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e9e38d-0180-4493-8716-5b5d995c0341 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd31dacf30804395bd029037b407c12a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f23435f783540199d6dcfd0417c090e', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:37:53.613835 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e9e38d-0180-4493-8716-5b5d995c0341 service swift] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:37:53.614331 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e9e38d-0180-4493-8716-5b5d995c0341 service swift] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:37:53.615033 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e9e38d-0180-4493-8716-5b5d995c0341 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:37:53.639974 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e9e38d-0180-4493-8716-5b5d995c0341 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:37:53.641927 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e9e38d-0180-4493-8716-5b5d995c0341 service swift] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:37:53.672131 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1147/2254] 10.222.0.23 () {60 vars in 1384 bytes} [Tue May 10 05:37:53 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 10 05:38:02.302896 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367fa0f5-c9bf-4c1a-b253-519e0e5e652e None None] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:38:02.303564 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367fa0f5-c9bf-4c1a-b253-519e0e5e652e None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:38:02.303564 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367fa0f5-c9bf-4c1a-b253-519e0e5e652e None None] PATH_INFO: `/` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:38:02.305050 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1108/2255] 10.222.0.23 () {54 vars in 921 bytes} [Tue May 10 05:38:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 05:38:02.310934 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b53deb-484e-457d-a0b7-021ca49eeafc None None] REQUEST_METHOD: `POST` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:38:02.311890 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b53deb-484e-457d-a0b7-021ca49eeafc None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:38:02.312352 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b53deb-484e-457d-a0b7-021ca49eeafc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:38:02.388167 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.auth.core [None req-62b53deb-484e-457d-a0b7-021ca49eeafc None None] MFA Rules not processed for user `7f50f224ca944983aecfde86375473da`. Rule list: `[]` (Enabled: `True`). {{(pid=79879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:38:02.389376 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-62b53deb-484e-457d-a0b7-021ca49eeafc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:38:02.489040 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1148/2256] 10.222.0.23 () {58 vars in 1018 bytes} [Tue May 10 05:38:02 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 05:38:02.501855 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367fa0f5-c9bf-4c1a-b253-519e0e5e652e None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:38:02.503782 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-367fa0f5-c9bf-4c1a-b253-519e0e5e652e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:38:02.523147 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367fa0f5-c9bf-4c1a-b253-519e0e5e652e None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:38:02.527200 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8180834a-5c07-4ed0-91f3-c07523a741f3 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5b56aedcfd74914938b0b9cdd102f48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f23435f783540199d6dcfd0417c090e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:38:02.527933 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8180834a-5c07-4ed0-91f3-c07523a741f3 service glance] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:38:02.528214 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8180834a-5c07-4ed0-91f3-c07523a741f3 service glance] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:38:02.528490 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8180834a-5c07-4ed0-91f3-c07523a741f3 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:38:02.543346 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8180834a-5c07-4ed0-91f3-c07523a741f3 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:38:02.544835 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8180834a-5c07-4ed0-91f3-c07523a741f3 service glance] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:38:02.557298 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1109/2257] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 10 05:38:02 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 05:38:02.631546 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f17fa1-9ebc-455b-9dbe-3cb7ca48707c None None] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:38:02.632230 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f17fa1-9ebc-455b-9dbe-3cb7ca48707c None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:38:02.632698 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f17fa1-9ebc-455b-9dbe-3cb7ca48707c None None] PATH_INFO: `/` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:38:02.634584 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1149/2258] 10.222.0.23 () {54 vars in 921 bytes} [Tue May 10 05:38:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 05:38:02.639632 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ce3adb-5124-40b0-8025-96f23b941519 None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:38:02.639930 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ce3adb-5124-40b0-8025-96f23b941519 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:38:02.640205 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ce3adb-5124-40b0-8025-96f23b941519 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:38:02.674820 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-55ce3adb-5124-40b0-8025-96f23b941519 None None] MFA Rules not processed for user `3c8461cfdd9648b8abcaf8d34b7a102a`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:38:02.676030 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-55ce3adb-5124-40b0-8025-96f23b941519 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:38:02.687750 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1110/2259] 10.222.0.23 () {58 vars in 1018 bytes} [Tue May 10 05:38:02 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 05:38:02.696262 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f17fa1-9ebc-455b-9dbe-3cb7ca48707c None None] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:38:02.709970 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f17fa1-9ebc-455b-9dbe-3cb7ca48707c None None] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:38:02.714707 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65bbfff-53fa-4ae7-9395-ef08c26b8d82 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c8461cfdd9648b8abcaf8d34b7a102a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f23435f783540199d6dcfd0417c090e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:38:02.715465 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65bbfff-53fa-4ae7-9395-ef08c26b8d82 service neutron] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:38:02.715828 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65bbfff-53fa-4ae7-9395-ef08c26b8d82 service neutron] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:38:02.716279 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65bbfff-53fa-4ae7-9395-ef08c26b8d82 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:38:02.730599 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65bbfff-53fa-4ae7-9395-ef08c26b8d82 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:38:02.732349 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65bbfff-53fa-4ae7-9395-ef08c26b8d82 service neutron] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:38:02.742660 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1150/2260] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 10 05:38:02 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 05:38:02.846119 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18534d6b-91d7-453b-99b0-9c9366c77a59 None None] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:38:02.846693 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18534d6b-91d7-453b-99b0-9c9366c77a59 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:38:02.847118 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18534d6b-91d7-453b-99b0-9c9366c77a59 None None] PATH_INFO: `/` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:38:02.848966 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1111/2261] 10.222.0.23 () {54 vars in 921 bytes} [Tue May 10 05:38:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 05:38:02.855692 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dfd59a-c29d-4ed4-ba69-f5bbdb9d430b None None] REQUEST_METHOD: `POST` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:38:02.856065 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dfd59a-c29d-4ed4-ba69-f5bbdb9d430b None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:38:02.856413 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dfd59a-c29d-4ed4-ba69-f5bbdb9d430b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:38:02.889418 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.auth.core [None req-83dfd59a-c29d-4ed4-ba69-f5bbdb9d430b None None] MFA Rules not processed for user `7f50f224ca944983aecfde86375473da`. Rule list: `[]` (Enabled: `True`). {{(pid=79879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:38:02.890867 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-83dfd59a-c29d-4ed4-ba69-f5bbdb9d430b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:38:02.904244 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1151/2262] 10.222.0.23 () {58 vars in 1018 bytes} [Tue May 10 05:38:02 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 05:38:02.914470 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18534d6b-91d7-453b-99b0-9c9366c77a59 None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:38:02.928346 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18534d6b-91d7-453b-99b0-9c9366c77a59 None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:38:02.934662 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840ea263-0b10-49c1-8f5d-b40726de5906 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c8461cfdd9648b8abcaf8d34b7a102a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f23435f783540199d6dcfd0417c090e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:38:02.935293 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840ea263-0b10-49c1-8f5d-b40726de5906 service neutron] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:38:02.936058 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840ea263-0b10-49c1-8f5d-b40726de5906 service neutron] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:38:02.941237 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840ea263-0b10-49c1-8f5d-b40726de5906 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:38:02.956962 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840ea263-0b10-49c1-8f5d-b40726de5906 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:38:02.959023 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840ea263-0b10-49c1-8f5d-b40726de5906 service neutron] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:38:02.972984 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1112/2263] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 10 05:38:02 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 05:38:05.908075 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b651bc-4cd5-410f-9aeb-f7ada5c16d1b None None] REQUEST_METHOD: `POST` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:38:05.908926 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b651bc-4cd5-410f-9aeb-f7ada5c16d1b None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:38:05.909380 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b651bc-4cd5-410f-9aeb-f7ada5c16d1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:38:05.935079 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.auth.core [None req-41b651bc-4cd5-410f-9aeb-f7ada5c16d1b None None] MFA Rules not processed for user `c5281b2a1c9a461995653be826207db4`. Rule list: `[]` (Enabled: `True`). {{(pid=79879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:38:05.936197 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-41b651bc-4cd5-410f-9aeb-f7ada5c16d1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:38:05.944529 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1152/2264] 10.222.0.23 () {58 vars in 1009 bytes} [Tue May 10 05:38:05 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 05:38:05.970814 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840ea263-0b10-49c1-8f5d-b40726de5906 service neutron] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:38:05.998378 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840ea263-0b10-49c1-8f5d-b40726de5906 service neutron] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:38:06.019928 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afab359-ee7b-4d8c-a13c-0868ce9cd93a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd31dacf30804395bd029037b407c12a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f23435f783540199d6dcfd0417c090e', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:38:06.020849 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afab359-ee7b-4d8c-a13c-0868ce9cd93a service swift] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:38:06.021151 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afab359-ee7b-4d8c-a13c-0868ce9cd93a service swift] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:38:06.021436 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afab359-ee7b-4d8c-a13c-0868ce9cd93a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:38:06.033396 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afab359-ee7b-4d8c-a13c-0868ce9cd93a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:38:06.034902 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afab359-ee7b-4d8c-a13c-0868ce9cd93a service swift] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:38:06.044502 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1113/2265] 10.222.0.23 () {60 vars in 1384 bytes} [Tue May 10 05:38:05 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 10 05:38:06.250780 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1784620-a1e7-412a-8041-75c1cde02878 None None] REQUEST_METHOD: `POST` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:38:06.251072 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1784620-a1e7-412a-8041-75c1cde02878 None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:38:06.254297 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1784620-a1e7-412a-8041-75c1cde02878 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:38:06.304472 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.auth.core [None req-c1784620-a1e7-412a-8041-75c1cde02878 None None] MFA Rules not processed for user `1a35edf14fef4d408ae00e7d6fd11399`. Rule list: `[]` (Enabled: `True`). {{(pid=79879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:38:06.307608 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-c1784620-a1e7-412a-8041-75c1cde02878 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:38:06.332441 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1153/2266] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 10 05:38:06 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 05:38:17.981484 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a04347-6286-4ff0-8d96-451784abdf44 None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:38:17.982202 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a04347-6286-4ff0-8d96-451784abdf44 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:38:17.982202 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a04347-6286-4ff0-8d96-451784abdf44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:38:18.003750 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-38a04347-6286-4ff0-8d96-451784abdf44 None None] MFA Rules not processed for user `c5281b2a1c9a461995653be826207db4`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:38:18.004966 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-38a04347-6286-4ff0-8d96-451784abdf44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:38:18.012760 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1114/2267] 10.222.0.23 () {58 vars in 1009 bytes} [Tue May 10 05:38:17 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 05:38:18.025507 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1784620-a1e7-412a-8041-75c1cde02878 None None] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:38:18.038973 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1784620-a1e7-412a-8041-75c1cde02878 None None] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:38:18.044063 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a2d0ae-5558-4634-b880-7cb0a97f2029 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd31dacf30804395bd029037b407c12a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f23435f783540199d6dcfd0417c090e', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:38:18.044793 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a2d0ae-5558-4634-b880-7cb0a97f2029 service swift] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:38:18.045137 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a2d0ae-5558-4634-b880-7cb0a97f2029 service swift] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:38:18.045474 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a2d0ae-5558-4634-b880-7cb0a97f2029 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:38:18.054316 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a2d0ae-5558-4634-b880-7cb0a97f2029 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:38:18.056019 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a2d0ae-5558-4634-b880-7cb0a97f2029 service swift] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:38:18.064488 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1154/2268] 10.222.0.23 () {60 vars in 1384 bytes} [Tue May 10 05:38:18 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 10 05:38:33.971921 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a04347-6286-4ff0-8d96-451784abdf44 None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:38:33.973529 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-38a04347-6286-4ff0-8d96-451784abdf44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:38:34.083033 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a04347-6286-4ff0-8d96-451784abdf44 None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:38:34.089007 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fc2bb0-4184-4658-a75b-828865d37711 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67321ca3e5624273acd5b06264738000', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f23435f783540199d6dcfd0417c090e', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:38:34.089667 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fc2bb0-4184-4658-a75b-828865d37711 service placement] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:38:34.090193 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fc2bb0-4184-4658-a75b-828865d37711 service placement] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:38:34.090475 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fc2bb0-4184-4658-a75b-828865d37711 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:38:34.092352 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-02fc2bb0-4184-4658-a75b-828865d37711 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:38:34.104128 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02fc2bb0-4184-4658-a75b-828865d37711 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:38:34.105724 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02fc2bb0-4184-4658-a75b-828865d37711 service placement] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:38:34.115752 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1115/2269] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 10 05:38:33 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 05:38:34.394570 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07bb2c6-15ed-4993-88c4-176eab2e1623 None None] REQUEST_METHOD: `POST` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:38:34.395130 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07bb2c6-15ed-4993-88c4-176eab2e1623 None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:38:34.395228 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07bb2c6-15ed-4993-88c4-176eab2e1623 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:38:34.416187 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.auth.core [None req-c07bb2c6-15ed-4993-88c4-176eab2e1623 None None] MFA Rules not processed for user `da9d43f65eca485b8b629a4c7a867b93`. Rule list: `[]` (Enabled: `True`). {{(pid=79879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:38:34.417451 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-c07bb2c6-15ed-4993-88c4-176eab2e1623 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:38:34.476577 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1155/2270] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 10 05:38:34 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 05:38:37.073381 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d577df-40de-4fc7-9d8f-463e7ddd11ba None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:38:37.074454 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d577df-40de-4fc7-9d8f-463e7ddd11ba None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:38:37.074975 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d577df-40de-4fc7-9d8f-463e7ddd11ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:38:37.138221 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-33d577df-40de-4fc7-9d8f-463e7ddd11ba None None] MFA Rules not processed for user `c5281b2a1c9a461995653be826207db4`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:38:37.139541 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-33d577df-40de-4fc7-9d8f-463e7ddd11ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:38:37.156543 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1116/2271] 10.222.0.23 () {58 vars in 967 bytes} [Tue May 10 05:38:37 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 05:38:37.169482 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07bb2c6-15ed-4993-88c4-176eab2e1623 None None] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:38:37.191779 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07bb2c6-15ed-4993-88c4-176eab2e1623 None None] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:38:37.197440 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc66739-d049-4ed5-aed2-29c282836441 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd31dacf30804395bd029037b407c12a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f23435f783540199d6dcfd0417c090e', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:38:37.198086 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc66739-d049-4ed5-aed2-29c282836441 service swift] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:38:37.198364 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc66739-d049-4ed5-aed2-29c282836441 service swift] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:38:37.198748 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc66739-d049-4ed5-aed2-29c282836441 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:38:37.207393 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc66739-d049-4ed5-aed2-29c282836441 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:38:37.209102 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc66739-d049-4ed5-aed2-29c282836441 service swift] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:38:37.217091 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1156/2272] 10.222.0.23 () {60 vars in 1384 bytes} [Tue May 10 05:38:37 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 10 05:38:52.609637 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d577df-40de-4fc7-9d8f-463e7ddd11ba None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:38:52.611151 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-33d577df-40de-4fc7-9d8f-463e7ddd11ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:38:52.623598 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d577df-40de-4fc7-9d8f-463e7ddd11ba None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:38:52.633705 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148dd909-727a-4cbd-9728-1c2e98697659 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c8461cfdd9648b8abcaf8d34b7a102a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f23435f783540199d6dcfd0417c090e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:38:52.634408 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148dd909-727a-4cbd-9728-1c2e98697659 service neutron] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:38:52.634692 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148dd909-727a-4cbd-9728-1c2e98697659 service neutron] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:38:52.634963 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148dd909-727a-4cbd-9728-1c2e98697659 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:38:52.645896 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148dd909-727a-4cbd-9728-1c2e98697659 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:38:52.647338 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148dd909-727a-4cbd-9728-1c2e98697659 service neutron] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:38:52.657583 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1117/2273] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 10 05:38:52 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 05:39:34.999302 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567dcf4f-fd07-473c-8a65-7c00e9de07bb None None] REQUEST_METHOD: `POST` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:39:35.000295 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567dcf4f-fd07-473c-8a65-7c00e9de07bb None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:39:35.000295 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567dcf4f-fd07-473c-8a65-7c00e9de07bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:39:35.019319 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.auth.core [None req-567dcf4f-fd07-473c-8a65-7c00e9de07bb None None] MFA Rules not processed for user `952c90085aff498d9aca46518d272553`. Rule list: `[]` (Enabled: `True`). {{(pid=79879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:39:35.020723 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-567dcf4f-fd07-473c-8a65-7c00e9de07bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:39:35.107448 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1157/2274] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 10 05:39:34 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 05:39:36.411960 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b379aed-80ce-4117-b034-07cd52b89748 None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:39:36.412476 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b379aed-80ce-4117-b034-07cd52b89748 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:39:36.412769 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b379aed-80ce-4117-b034-07cd52b89748 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:39:36.437366 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-4b379aed-80ce-4117-b034-07cd52b89748 None None] MFA Rules not processed for user `5fd529982ab24820826d466e4d13a07d`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:39:36.438887 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-4b379aed-80ce-4117-b034-07cd52b89748 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:39:36.495664 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1118/2275] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 10 05:39:36 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 05:39:52.634483 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d35dcf-48b0-40fc-a81a-8af440bac8da None None] REQUEST_METHOD: `POST` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:39:52.634994 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d35dcf-48b0-40fc-a81a-8af440bac8da None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:39:52.635136 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d35dcf-48b0-40fc-a81a-8af440bac8da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:39:52.653652 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.auth.core [None req-19d35dcf-48b0-40fc-a81a-8af440bac8da None None] MFA Rules not processed for user `da9d43f65eca485b8b629a4c7a867b93`. Rule list: `[]` (Enabled: `True`). {{(pid=79879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:39:52.654902 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-19d35dcf-48b0-40fc-a81a-8af440bac8da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:39:52.662964 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1158/2276] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 10 05:39:52 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 05:40:15.809126 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5361c8f6-5d36-4e67-821d-81a3152f7b8e None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:40:15.809673 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5361c8f6-5d36-4e67-821d-81a3152f7b8e None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:40:15.809673 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5361c8f6-5d36-4e67-821d-81a3152f7b8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:40:15.828063 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-5361c8f6-5d36-4e67-821d-81a3152f7b8e None None] MFA Rules not processed for user `1fa3b659464a49ef863e2e398aadf22a`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:40:15.829262 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-5361c8f6-5d36-4e67-821d-81a3152f7b8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:40:15.897659 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1119/2277] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 10 05:40:15 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 05:40:22.631986 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d35dcf-48b0-40fc-a81a-8af440bac8da None None] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:40:22.636182 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5361c8f6-5d36-4e67-821d-81a3152f7b8e None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:40:22.642077 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d35dcf-48b0-40fc-a81a-8af440bac8da None None] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:40:22.646163 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8464af-14ed-4603-8dc1-c7e8de333257 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c8461cfdd9648b8abcaf8d34b7a102a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f23435f783540199d6dcfd0417c090e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:40:22.646455 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5361c8f6-5d36-4e67-821d-81a3152f7b8e None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:40:22.646806 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8464af-14ed-4603-8dc1-c7e8de333257 service neutron] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:40:22.647072 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8464af-14ed-4603-8dc1-c7e8de333257 service neutron] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:40:22.647339 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8464af-14ed-4603-8dc1-c7e8de333257 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:40:22.649174 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-3b8464af-14ed-4603-8dc1-c7e8de333257 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:40:22.650654 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cd9736-0455-4f9b-b572-c19b76c756e3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c8461cfdd9648b8abcaf8d34b7a102a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f23435f783540199d6dcfd0417c090e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:40:22.651320 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cd9736-0455-4f9b-b572-c19b76c756e3 service neutron] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:40:22.651646 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cd9736-0455-4f9b-b572-c19b76c756e3 service neutron] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:40:22.651911 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cd9736-0455-4f9b-b572-c19b76c756e3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:40:22.653870 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-a7cd9736-0455-4f9b-b572-c19b76c756e3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:40:22.662451 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8464af-14ed-4603-8dc1-c7e8de333257 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:40:22.663907 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8464af-14ed-4603-8dc1-c7e8de333257 service neutron] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:40:22.667321 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7cd9736-0455-4f9b-b572-c19b76c756e3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:40:22.668779 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7cd9736-0455-4f9b-b572-c19b76c756e3 service neutron] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:40:22.674744 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1159/2278] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 10 05:40:22 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 05:40:22.679751 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1120/2279] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 10 05:40:22 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 05:40:29.950057 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8464af-14ed-4603-8dc1-c7e8de333257 service neutron] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:40:29.958654 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8464af-14ed-4603-8dc1-c7e8de333257 service neutron] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:40:29.962443 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2dc80e-e72a-4d91-8473-9ea13ebbce0d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c8461cfdd9648b8abcaf8d34b7a102a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f23435f783540199d6dcfd0417c090e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:40:29.963122 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2dc80e-e72a-4d91-8473-9ea13ebbce0d service neutron] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:40:29.963402 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2dc80e-e72a-4d91-8473-9ea13ebbce0d service neutron] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:40:29.963719 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2dc80e-e72a-4d91-8473-9ea13ebbce0d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:40:29.965777 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-1f2dc80e-e72a-4d91-8473-9ea13ebbce0d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:40:29.978116 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2dc80e-e72a-4d91-8473-9ea13ebbce0d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:40:29.979608 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2dc80e-e72a-4d91-8473-9ea13ebbce0d service neutron] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:40:29.989036 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1160/2280] 10.222.0.23 () {60 vars in 1396 bytes} [Tue May 10 05:40:29 2022] GET /identity/v3/auth/tokens?allow_expired=1 => generated 3242 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 05:40:35.792875 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cd9736-0455-4f9b-b572-c19b76c756e3 service neutron] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:40:35.794641 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-a7cd9736-0455-4f9b-b572-c19b76c756e3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:40:35.875014 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cd9736-0455-4f9b-b572-c19b76c756e3 service neutron] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:40:35.879258 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a83cd56-3000-4d63-9976-458f42f31e4c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355be413675540a39ccb00e1a0722316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f23435f783540199d6dcfd0417c090e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:40:35.879956 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a83cd56-3000-4d63-9976-458f42f31e4c service cinder] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:40:35.880257 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a83cd56-3000-4d63-9976-458f42f31e4c service cinder] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:40:35.880563 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a83cd56-3000-4d63-9976-458f42f31e4c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:40:35.882722 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-6a83cd56-3000-4d63-9976-458f42f31e4c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:40:35.895181 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a83cd56-3000-4d63-9976-458f42f31e4c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:40:35.896823 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a83cd56-3000-4d63-9976-458f42f31e4c service cinder] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:40:35.907179 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1121/2281] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 10 05:40:35 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 05:40:38.491298 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2dc80e-e72a-4d91-8473-9ea13ebbce0d service neutron] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:40:38.500668 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2dc80e-e72a-4d91-8473-9ea13ebbce0d service neutron] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:40:38.505249 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157a5973-8ea1-4466-bdf3-13e8b1f64d96 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c8461cfdd9648b8abcaf8d34b7a102a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f23435f783540199d6dcfd0417c090e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:40:38.505890 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157a5973-8ea1-4466-bdf3-13e8b1f64d96 service neutron] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:40:38.506170 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157a5973-8ea1-4466-bdf3-13e8b1f64d96 service neutron] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:40:38.506441 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157a5973-8ea1-4466-bdf3-13e8b1f64d96 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:40:38.508544 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-157a5973-8ea1-4466-bdf3-13e8b1f64d96 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:40:38.518688 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157a5973-8ea1-4466-bdf3-13e8b1f64d96 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:40:38.520177 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157a5973-8ea1-4466-bdf3-13e8b1f64d96 service neutron] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:40:38.528551 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1161/2282] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 10 05:40:38 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 05:40:44.834146 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a83cd56-3000-4d63-9976-458f42f31e4c service cinder] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:40:44.835873 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-6a83cd56-3000-4d63-9976-458f42f31e4c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:40:44.852758 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a83cd56-3000-4d63-9976-458f42f31e4c service cinder] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:40:44.859250 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82e21e6-ef5f-4faf-b79e-4a33347288fc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f50f224ca944983aecfde86375473da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f23435f783540199d6dcfd0417c090e', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:40:44.859923 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82e21e6-ef5f-4faf-b79e-4a33347288fc service nova] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:40:44.860201 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82e21e6-ef5f-4faf-b79e-4a33347288fc service nova] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:40:44.860456 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82e21e6-ef5f-4faf-b79e-4a33347288fc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:40:44.862469 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-b82e21e6-ef5f-4faf-b79e-4a33347288fc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:40:44.873560 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82e21e6-ef5f-4faf-b79e-4a33347288fc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:40:44.875480 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82e21e6-ef5f-4faf-b79e-4a33347288fc service nova] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:40:44.885282 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1122/2283] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 10 05:40:44 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 05:40:47.048440 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157a5973-8ea1-4466-bdf3-13e8b1f64d96 service neutron] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:40:47.049916 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-157a5973-8ea1-4466-bdf3-13e8b1f64d96 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:40:47.065347 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157a5973-8ea1-4466-bdf3-13e8b1f64d96 service neutron] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:40:47.070696 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61141b52-bebb-47c1-b645-4a5833285242 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f50f224ca944983aecfde86375473da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f23435f783540199d6dcfd0417c090e', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:40:47.071348 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61141b52-bebb-47c1-b645-4a5833285242 service nova] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:40:47.071660 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61141b52-bebb-47c1-b645-4a5833285242 service nova] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:40:47.071932 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61141b52-bebb-47c1-b645-4a5833285242 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:40:47.073681 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-61141b52-bebb-47c1-b645-4a5833285242 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:40:47.085309 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61141b52-bebb-47c1-b645-4a5833285242 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:40:47.086897 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61141b52-bebb-47c1-b645-4a5833285242 service nova] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:40:47.097234 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1162/2284] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 10 05:40:47 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 05:40:48.430702 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82e21e6-ef5f-4faf-b79e-4a33347288fc service nova] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:40:48.441342 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82e21e6-ef5f-4faf-b79e-4a33347288fc service nova] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:40:48.445948 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f59a65-bf2d-48fe-ba75-dd427ed4bab3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c8461cfdd9648b8abcaf8d34b7a102a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f23435f783540199d6dcfd0417c090e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:40:48.446590 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f59a65-bf2d-48fe-ba75-dd427ed4bab3 service neutron] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:40:48.446862 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f59a65-bf2d-48fe-ba75-dd427ed4bab3 service neutron] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:40:48.447133 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f59a65-bf2d-48fe-ba75-dd427ed4bab3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:40:48.449290 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-12f59a65-bf2d-48fe-ba75-dd427ed4bab3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:40:48.515257 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f59a65-bf2d-48fe-ba75-dd427ed4bab3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:40:48.516747 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f59a65-bf2d-48fe-ba75-dd427ed4bab3 service neutron] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:40:48.526805 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1123/2285] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 10 05:40:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 05:40:49.261426 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db05f91-d5e2-4d77-94a1-be0e89eef720 None None] REQUEST_METHOD: `POST` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:40:49.261900 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db05f91-d5e2-4d77-94a1-be0e89eef720 None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:40:49.262113 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db05f91-d5e2-4d77-94a1-be0e89eef720 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:40:49.280694 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.auth.core [None req-9db05f91-d5e2-4d77-94a1-be0e89eef720 None None] MFA Rules not processed for user `c5281b2a1c9a461995653be826207db4`. Rule list: `[]` (Enabled: `True`). {{(pid=79879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:40:49.281970 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-9db05f91-d5e2-4d77-94a1-be0e89eef720 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:40:49.289656 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1163/2286] 10.222.0.23 () {58 vars in 967 bytes} [Tue May 10 05:40:49 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 05:40:49.338978 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f59a65-bf2d-48fe-ba75-dd427ed4bab3 service neutron] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:40:49.350309 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f59a65-bf2d-48fe-ba75-dd427ed4bab3 service neutron] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:40:49.355505 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8498d6ee-d9c4-4350-8938-c9a6c1d3453f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd31dacf30804395bd029037b407c12a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f23435f783540199d6dcfd0417c090e', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:40:49.356238 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8498d6ee-d9c4-4350-8938-c9a6c1d3453f service swift] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:40:49.356579 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8498d6ee-d9c4-4350-8938-c9a6c1d3453f service swift] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:40:49.356879 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8498d6ee-d9c4-4350-8938-c9a6c1d3453f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:40:49.365025 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8498d6ee-d9c4-4350-8938-c9a6c1d3453f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:40:49.366611 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8498d6ee-d9c4-4350-8938-c9a6c1d3453f service swift] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:40:49.374684 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1124/2287] 10.222.0.23 () {60 vars in 1384 bytes} [Tue May 10 05:40:49 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 10 05:40:52.615490 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db05f91-d5e2-4d77-94a1-be0e89eef720 None None] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:40:52.617324 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-9db05f91-d5e2-4d77-94a1-be0e89eef720 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:40:52.635087 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db05f91-d5e2-4d77-94a1-be0e89eef720 None None] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:40:52.642545 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa25f81-3d74-4da6-937a-66bce9b22806 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:40:52.643944 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa25f81-3d74-4da6-937a-66bce9b22806 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:40:52.644371 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa25f81-3d74-4da6-937a-66bce9b22806 admin admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:40:52.644754 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa25f81-3d74-4da6-937a-66bce9b22806 admin admin] PATH_INFO: `/v3/users/952c90085aff498d9aca46518d272553` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:40:52.646109 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa25f81-3d74-4da6-937a-66bce9b22806 admin admin] RBAC: Authorizing `identity:delete_user(user_id=952c90085aff498d9aca46518d272553)` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:40:52.648815 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa25f81-3d74-4da6-937a-66bce9b22806 admin admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:40:52.700334 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-7fa25f81-3d74-4da6-937a-66bce9b22806 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '952c90085aff498d9aca46518d272553'} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:40:52.707939 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-7fa25f81-3d74-4da6-937a-66bce9b22806 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '952c90085aff498d9aca46518d272553'} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:40:52.708549 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-7fa25f81-3d74-4da6-937a-66bce9b22806 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '952c90085aff498d9aca46518d272553'} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:40:52.720663 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-7fa25f81-3d74-4da6-937a-66bce9b22806 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '952c90085aff498d9aca46518d272553'} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:40:52.727132 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-7fa25f81-3d74-4da6-937a-66bce9b22806 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '952c90085aff498d9aca46518d272553'} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:40:52.733700 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1164/2288] 10.222.0.23 () {58 vars in 1223 bytes} [Tue May 10 05:40:52 2022] DELETE /identity/v3/users/952c90085aff498d9aca46518d272553 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 05:40:52.911766 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8498d6ee-d9c4-4350-8938-c9a6c1d3453f service swift] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:40:52.926288 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8498d6ee-d9c4-4350-8938-c9a6c1d3453f service swift] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:40:52.992305 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138ad536-06e0-4c2c-935d-a9120cbe0b01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:40:52.994247 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138ad536-06e0-4c2c-935d-a9120cbe0b01 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:40:52.994648 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138ad536-06e0-4c2c-935d-a9120cbe0b01 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:40:52.995036 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138ad536-06e0-4c2c-935d-a9120cbe0b01 admin admin] PATH_INFO: `/v3/projects/5655a11bb4d94e7fb7186eb1bec105cb` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:40:52.997312 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138ad536-06e0-4c2c-935d-a9120cbe0b01 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5655a11bb4d94e7fb7186eb1bec105cb)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:40:52.999290 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138ad536-06e0-4c2c-935d-a9120cbe0b01 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:40:53.050612 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-138ad536-06e0-4c2c-935d-a9120cbe0b01 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5655a11bb4d94e7fb7186eb1bec105cb', 'request_id': 'req-138ad536-06e0-4c2c-935d-a9120cbe0b01'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:40:53.057599 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-138ad536-06e0-4c2c-935d-a9120cbe0b01 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5655a11bb4d94e7fb7186eb1bec105cb', 'request_id': 'req-138ad536-06e0-4c2c-935d-a9120cbe0b01'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:40:53.067982 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-138ad536-06e0-4c2c-935d-a9120cbe0b01 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5655a11bb4d94e7fb7186eb1bec105cb', 'request_id': 'req-138ad536-06e0-4c2c-935d-a9120cbe0b01'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:40:53.080942 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-138ad536-06e0-4c2c-935d-a9120cbe0b01 admin admin] The token cache is being invalidate because project 5655a11bb4d94e7fb7186eb1bec105cb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79880) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 05:40:53.081231 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-138ad536-06e0-4c2c-935d-a9120cbe0b01 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:40:53.081872 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-138ad536-06e0-4c2c-935d-a9120cbe0b01 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:40:53.083465 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1125/2289] 10.222.0.23 () {58 vars in 1232 bytes} [Tue May 10 05:40:52 2022] DELETE /identity/v3/projects/5655a11bb4d94e7fb7186eb1bec105cb => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 05:40:53.088382 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb6620d-b3d0-4ee0-ab6f-37b88ddd98cf None None] REQUEST_METHOD: `POST` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:40:53.088744 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb6620d-b3d0-4ee0-ab6f-37b88ddd98cf None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:40:53.089088 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb6620d-b3d0-4ee0-ab6f-37b88ddd98cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:40:53.134610 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.auth.core [None req-beb6620d-b3d0-4ee0-ab6f-37b88ddd98cf None None] MFA Rules not processed for user `44883b22532e44049d846938dc2cf423`. Rule list: `[]` (Enabled: `True`). {{(pid=79879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:40:53.135847 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-beb6620d-b3d0-4ee0-ab6f-37b88ddd98cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:40:53.195455 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1165/2290] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 10 05:40:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 05:40:53.203894 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5163aa-8521-4f0a-a37e-d325a9dc36db None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:40:53.204290 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5163aa-8521-4f0a-a37e-d325a9dc36db None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:40:53.204712 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5163aa-8521-4f0a-a37e-d325a9dc36db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:40:53.224314 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-ec5163aa-8521-4f0a-a37e-d325a9dc36db None None] MFA Rules not processed for user `44883b22532e44049d846938dc2cf423`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:40:53.225536 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-ec5163aa-8521-4f0a-a37e-d325a9dc36db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:40:53.233560 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1126/2291] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 10 05:40:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 05:40:53.238264 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb6620d-b3d0-4ee0-ab6f-37b88ddd98cf None None] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:40:53.248185 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb6620d-b3d0-4ee0-ab6f-37b88ddd98cf None None] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:40:53.253291 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36468e69-40eb-4700-832b-c0215b79928e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:40:53.254022 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36468e69-40eb-4700-832b-c0215b79928e admin admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:40:53.254309 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36468e69-40eb-4700-832b-c0215b79928e admin admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:40:53.254593 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36468e69-40eb-4700-832b-c0215b79928e admin admin] PATH_INFO: `/v3/domains` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:40:53.255351 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36468e69-40eb-4700-832b-c0215b79928e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:40:53.255701 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36468e69-40eb-4700-832b-c0215b79928e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:40:53.257359 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36468e69-40eb-4700-832b-c0215b79928e admin admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:40:53.270163 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1166/2292] 10.222.0.23 () {58 vars in 1152 bytes} [Tue May 10 05:40:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:40:53.274451 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5163aa-8521-4f0a-a37e-d325a9dc36db None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:40:53.284397 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5163aa-8521-4f0a-a37e-d325a9dc36db None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:40:53.290247 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092c5279-a826-4ed3-affc-e9be24176bd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:40:53.290900 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092c5279-a826-4ed3-affc-e9be24176bd8 admin admin] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:40:53.291184 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092c5279-a826-4ed3-affc-e9be24176bd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:40:53.291670 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092c5279-a826-4ed3-affc-e9be24176bd8 admin admin] PATH_INFO: `/v3/projects` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:40:53.292581 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092c5279-a826-4ed3-affc-e9be24176bd8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:40:53.294502 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092c5279-a826-4ed3-affc-e9be24176bd8 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:40:53.325356 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1127/2293] 10.222.0.23 () {60 vars in 1152 bytes} [Tue May 10 05:40:53 2022] POST /identity/v3/projects => generated 403 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 05:40:53.326717 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36468e69-40eb-4700-832b-c0215b79928e admin admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:40:53.337214 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36468e69-40eb-4700-832b-c0215b79928e admin admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:40:53.445895 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96de29ff-baa7-40fe-a6e0-3287204ef5b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:40:53.446653 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96de29ff-baa7-40fe-a6e0-3287204ef5b1 admin admin] REQUEST_METHOD: `POST` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:40:53.447037 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96de29ff-baa7-40fe-a6e0-3287204ef5b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:40:53.448332 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96de29ff-baa7-40fe-a6e0-3287204ef5b1 admin admin] PATH_INFO: `/v3/users` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:40:53.449279 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96de29ff-baa7-40fe-a6e0-3287204ef5b1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:40:53.454459 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96de29ff-baa7-40fe-a6e0-3287204ef5b1 admin admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:40:53.486643 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1167/2294] 10.222.0.23 () {60 vars in 1143 bytes} [Tue May 10 05:40:53 2022] POST /identity/v3/users => generated 302 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 05:40:53.491244 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092c5279-a826-4ed3-affc-e9be24176bd8 admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:40:53.511023 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092c5279-a826-4ed3-affc-e9be24176bd8 admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:40:53.517711 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7038483-63ae-4e57-b25e-836596ff566f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:40:53.518407 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7038483-63ae-4e57-b25e-836596ff566f admin admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:40:53.518696 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7038483-63ae-4e57-b25e-836596ff566f admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:40:53.518975 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7038483-63ae-4e57-b25e-836596ff566f admin admin] PATH_INFO: `/v3/roles` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:40:53.519790 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7038483-63ae-4e57-b25e-836596ff566f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:40:53.521651 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7038483-63ae-4e57-b25e-836596ff566f admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:40:53.536777 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1128/2295] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 10 05:40:53 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 05:40:53.537888 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96de29ff-baa7-40fe-a6e0-3287204ef5b1 admin admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:40:53.557212 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96de29ff-baa7-40fe-a6e0-3287204ef5b1 admin admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:40:53.571413 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e002f9d2-012b-46b9-a79a-b999ea2e3fd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:40:53.572470 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e002f9d2-012b-46b9-a79a-b999ea2e3fd6 admin admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:40:53.572973 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e002f9d2-012b-46b9-a79a-b999ea2e3fd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:40:53.573464 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e002f9d2-012b-46b9-a79a-b999ea2e3fd6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:40:53.574414 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e002f9d2-012b-46b9-a79a-b999ea2e3fd6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:40:53.576678 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e002f9d2-012b-46b9-a79a-b999ea2e3fd6 admin admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:40:53.592236 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1168/2296] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 10 05:40:53 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 05:40:53.596222 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7038483-63ae-4e57-b25e-836596ff566f admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:40:53.609197 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7038483-63ae-4e57-b25e-836596ff566f admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:40:53.615847 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a32d9ca-43b2-458b-921e-42a516113474 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:40:53.616967 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a32d9ca-43b2-458b-921e-42a516113474 admin admin] REQUEST_METHOD: `PUT` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:40:53.617405 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a32d9ca-43b2-458b-921e-42a516113474 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:40:53.618231 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a32d9ca-43b2-458b-921e-42a516113474 admin admin] PATH_INFO: `/v3/projects/a3fb2b89b1294aa3ac9ac6e599658ac6/users/a87f989e89854dca928e4bf5b24f4bb9/roles/382636e67fc142a2b2f486340d959e11` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:40:53.644276 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a32d9ca-43b2-458b-921e-42a516113474 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a3fb2b89b1294aa3ac9ac6e599658ac6, user_id=a87f989e89854dca928e4bf5b24f4bb9, role_id=382636e67fc142a2b2f486340d959e11)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:40:53.647329 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a32d9ca-43b2-458b-921e-42a516113474 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:40:53.668857 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1129/2297] 10.222.0.23 () {60 vars in 1482 bytes} [Tue May 10 05:40:53 2022] PUT /identity/v3/projects/a3fb2b89b1294aa3ac9ac6e599658ac6/users/a87f989e89854dca928e4bf5b24f4bb9/roles/382636e67fc142a2b2f486340d959e11 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 05:40:53.680874 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e062bd49-22c2-4f97-a93e-c38f8a29cb13 None None] REQUEST_METHOD: `POST` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:40:53.681835 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e062bd49-22c2-4f97-a93e-c38f8a29cb13 None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:40:53.682267 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e062bd49-22c2-4f97-a93e-c38f8a29cb13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:40:53.743743 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.auth.core [None req-e062bd49-22c2-4f97-a93e-c38f8a29cb13 None None] MFA Rules not processed for user `a87f989e89854dca928e4bf5b24f4bb9`. Rule list: `[]` (Enabled: `True`). {{(pid=79879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:40:53.745006 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-e062bd49-22c2-4f97-a93e-c38f8a29cb13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:40:53.853415 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1169/2298] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 10 05:40:53 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 05:40:53.857901 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a32d9ca-43b2-458b-921e-42a516113474 admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:40:53.963559 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a32d9ca-43b2-458b-921e-42a516113474 admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:40:53.970358 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010f9664-7a5f-41a6-9db4-7dce682fb01e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:40:53.971282 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010f9664-7a5f-41a6-9db4-7dce682fb01e admin admin] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:40:53.971565 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010f9664-7a5f-41a6-9db4-7dce682fb01e admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:40:53.971960 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010f9664-7a5f-41a6-9db4-7dce682fb01e admin admin] PATH_INFO: `/v3/projects` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:40:53.972813 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010f9664-7a5f-41a6-9db4-7dce682fb01e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:40:53.974798 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010f9664-7a5f-41a6-9db4-7dce682fb01e admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:40:54.022112 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1130/2299] 10.222.0.23 () {60 vars in 1152 bytes} [Tue May 10 05:40:53 2022] POST /identity/v3/projects => generated 405 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 05:40:54.026202 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e062bd49-22c2-4f97-a93e-c38f8a29cb13 None None] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:40:54.038420 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e062bd49-22c2-4f97-a93e-c38f8a29cb13 None None] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:40:54.095197 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cded2e65-573c-4ee1-aa32-ae9f49944549 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:40:54.095913 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cded2e65-573c-4ee1-aa32-ae9f49944549 admin admin] REQUEST_METHOD: `POST` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:40:54.096194 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cded2e65-573c-4ee1-aa32-ae9f49944549 admin admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:40:54.096468 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cded2e65-573c-4ee1-aa32-ae9f49944549 admin admin] PATH_INFO: `/v3/users` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:40:54.097159 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cded2e65-573c-4ee1-aa32-ae9f49944549 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:40:54.099206 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cded2e65-573c-4ee1-aa32-ae9f49944549 admin admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:40:54.120430 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1170/2300] 10.222.0.23 () {60 vars in 1143 bytes} [Tue May 10 05:40:54 2022] POST /identity/v3/users => generated 309 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 05:40:54.124673 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010f9664-7a5f-41a6-9db4-7dce682fb01e admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:40:54.137568 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010f9664-7a5f-41a6-9db4-7dce682fb01e admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:40:54.142484 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283593f2-d58f-4514-8568-c556cbf13b44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:40:54.143239 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283593f2-d58f-4514-8568-c556cbf13b44 admin admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:40:54.143599 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283593f2-d58f-4514-8568-c556cbf13b44 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:40:54.143969 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283593f2-d58f-4514-8568-c556cbf13b44 admin admin] PATH_INFO: `/v3/roles` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:40:54.144762 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283593f2-d58f-4514-8568-c556cbf13b44 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:40:54.146426 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283593f2-d58f-4514-8568-c556cbf13b44 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:40:54.157043 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1131/2301] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 10 05:40:54 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 05:40:54.161707 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cded2e65-573c-4ee1-aa32-ae9f49944549 admin admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:40:54.174155 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cded2e65-573c-4ee1-aa32-ae9f49944549 admin admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:40:54.180274 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae77b368-d8a5-4f03-97ae-29b53bc399e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:40:54.181158 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae77b368-d8a5-4f03-97ae-29b53bc399e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:40:54.181444 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae77b368-d8a5-4f03-97ae-29b53bc399e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:40:54.181729 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae77b368-d8a5-4f03-97ae-29b53bc399e0 admin admin] PATH_INFO: `/v3/projects/440c7dec853e42c1ba8fdbc2d27f082f/users/fc032f9567c44dd7be93354630ef1ab6/roles/199ac1dd842441d7913c6ee89d8fbecc` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:40:54.201992 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae77b368-d8a5-4f03-97ae-29b53bc399e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=440c7dec853e42c1ba8fdbc2d27f082f, user_id=fc032f9567c44dd7be93354630ef1ab6, role_id=199ac1dd842441d7913c6ee89d8fbecc)` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:40:54.204956 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae77b368-d8a5-4f03-97ae-29b53bc399e0 admin admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:40:54.219655 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1171/2302] 10.222.0.23 () {60 vars in 1482 bytes} [Tue May 10 05:40:54 2022] PUT /identity/v3/projects/440c7dec853e42c1ba8fdbc2d27f082f/users/fc032f9567c44dd7be93354630ef1ab6/roles/199ac1dd842441d7913c6ee89d8fbecc => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 05:40:54.223449 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283593f2-d58f-4514-8568-c556cbf13b44 admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:40:54.236752 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283593f2-d58f-4514-8568-c556cbf13b44 admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:40:54.301916 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4351ec55-4945-403b-914c-2bd051217f83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:40:54.302629 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4351ec55-4945-403b-914c-2bd051217f83 admin admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:40:54.302910 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4351ec55-4945-403b-914c-2bd051217f83 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:40:54.303188 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4351ec55-4945-403b-914c-2bd051217f83 admin admin] PATH_INFO: `/v3/roles` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:40:54.303956 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4351ec55-4945-403b-914c-2bd051217f83 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:40:54.305566 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4351ec55-4945-403b-914c-2bd051217f83 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:40:54.315744 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1132/2303] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 10 05:40:54 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 05:40:54.320036 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae77b368-d8a5-4f03-97ae-29b53bc399e0 admin admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:40:54.330943 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae77b368-d8a5-4f03-97ae-29b53bc399e0 admin admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:40:54.336419 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3086973f-d4a5-4afa-96a1-a8246dac969b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:40:54.337306 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3086973f-d4a5-4afa-96a1-a8246dac969b admin admin] REQUEST_METHOD: `PUT` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:40:54.337588 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3086973f-d4a5-4afa-96a1-a8246dac969b admin admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:40:54.337862 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3086973f-d4a5-4afa-96a1-a8246dac969b admin admin] PATH_INFO: `/v3/projects/440c7dec853e42c1ba8fdbc2d27f082f/users/fc032f9567c44dd7be93354630ef1ab6/roles/199ac1dd842441d7913c6ee89d8fbecc` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:40:54.342903 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3086973f-d4a5-4afa-96a1-a8246dac969b admin admin] RBAC: Authorizing `identity:create_grant(project_id=440c7dec853e42c1ba8fdbc2d27f082f, user_id=fc032f9567c44dd7be93354630ef1ab6, role_id=199ac1dd842441d7913c6ee89d8fbecc)` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:40:54.345797 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3086973f-d4a5-4afa-96a1-a8246dac969b admin admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:40:54.359125 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1172/2304] 10.222.0.23 () {60 vars in 1482 bytes} [Tue May 10 05:40:54 2022] PUT /identity/v3/projects/440c7dec853e42c1ba8fdbc2d27f082f/users/fc032f9567c44dd7be93354630ef1ab6/roles/199ac1dd842441d7913c6ee89d8fbecc => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 05:40:54.370560 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a30583-e228-45d3-a933-11acf27448f7 None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:40:54.370853 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a30583-e228-45d3-a933-11acf27448f7 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:40:54.371136 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a30583-e228-45d3-a933-11acf27448f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:40:54.397305 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-33a30583-e228-45d3-a933-11acf27448f7 None None] MFA Rules not processed for user `fc032f9567c44dd7be93354630ef1ab6`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:40:54.398528 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-33a30583-e228-45d3-a933-11acf27448f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:40:54.466507 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1133/2305] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 10 05:40:54 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 05:40:54.477620 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3086973f-d4a5-4afa-96a1-a8246dac969b admin admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:40:54.479406 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-3086973f-d4a5-4afa-96a1-a8246dac969b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:40:54.546215 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3086973f-d4a5-4afa-96a1-a8246dac969b admin admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:40:54.549975 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a7f49c-0843-490a-8471-2d5d29c0cae9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355be413675540a39ccb00e1a0722316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f23435f783540199d6dcfd0417c090e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:40:54.550625 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a7f49c-0843-490a-8471-2d5d29c0cae9 service cinder] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:40:54.550906 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a7f49c-0843-490a-8471-2d5d29c0cae9 service cinder] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:40:54.551180 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a7f49c-0843-490a-8471-2d5d29c0cae9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:40:54.560388 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a7f49c-0843-490a-8471-2d5d29c0cae9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:40:54.561939 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a7f49c-0843-490a-8471-2d5d29c0cae9 service cinder] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:40:54.571374 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1173/2306] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 10 05:40:54 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 05:40:54.709271 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a30583-e228-45d3-a933-11acf27448f7 None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:40:54.771174 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a30583-e228-45d3-a933-11acf27448f7 None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:40:54.775650 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7196f7-807c-4dc5-b729-9969dc2beed8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:40:54.776617 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7196f7-807c-4dc5-b729-9969dc2beed8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:40:54.776937 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7196f7-807c-4dc5-b729-9969dc2beed8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:40:54.777210 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7196f7-807c-4dc5-b729-9969dc2beed8 admin admin] PATH_INFO: `/v3/users/a87f989e89854dca928e4bf5b24f4bb9` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:40:54.778402 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7196f7-807c-4dc5-b729-9969dc2beed8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a87f989e89854dca928e4bf5b24f4bb9)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:40:54.780416 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7196f7-807c-4dc5-b729-9969dc2beed8 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:40:54.826528 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-da7196f7-807c-4dc5-b729-9969dc2beed8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a87f989e89854dca928e4bf5b24f4bb9'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:40:54.837884 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-da7196f7-807c-4dc5-b729-9969dc2beed8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a87f989e89854dca928e4bf5b24f4bb9'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:40:54.838567 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-da7196f7-807c-4dc5-b729-9969dc2beed8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a87f989e89854dca928e4bf5b24f4bb9'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:40:54.845597 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-da7196f7-807c-4dc5-b729-9969dc2beed8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a87f989e89854dca928e4bf5b24f4bb9'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:40:54.846240 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-da7196f7-807c-4dc5-b729-9969dc2beed8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a87f989e89854dca928e4bf5b24f4bb9'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:40:54.858615 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1134/2307] 10.222.0.23 () {58 vars in 1223 bytes} [Tue May 10 05:40:54 2022] DELETE /identity/v3/users/a87f989e89854dca928e4bf5b24f4bb9 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 05:40:54.863141 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3f571e-9451-438c-b17a-12be03972404 None None] REQUEST_METHOD: `POST` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:40:54.863625 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3f571e-9451-438c-b17a-12be03972404 None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:40:54.863752 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3f571e-9451-438c-b17a-12be03972404 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:40:54.881166 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.auth.core [None req-ab3f571e-9451-438c-b17a-12be03972404 None None] MFA Rules not processed for user `44883b22532e44049d846938dc2cf423`. Rule list: `[]` (Enabled: `True`). {{(pid=79879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:40:54.882372 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-ab3f571e-9451-438c-b17a-12be03972404 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:40:54.943892 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1174/2308] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 10 05:40:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 05:40:54.953990 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7196f7-807c-4dc5-b729-9969dc2beed8 admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:40:54.955453 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-da7196f7-807c-4dc5-b729-9969dc2beed8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:40:55.017272 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7196f7-807c-4dc5-b729-9969dc2beed8 admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:40:55.021496 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a07be3-e01c-4d7d-b54b-1368f05aa468 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c8461cfdd9648b8abcaf8d34b7a102a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f23435f783540199d6dcfd0417c090e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:40:55.022525 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a07be3-e01c-4d7d-b54b-1368f05aa468 service neutron] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:40:55.022810 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a07be3-e01c-4d7d-b54b-1368f05aa468 service neutron] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:40:55.023262 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a07be3-e01c-4d7d-b54b-1368f05aa468 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:40:55.034760 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a07be3-e01c-4d7d-b54b-1368f05aa468 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:40:55.036269 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a07be3-e01c-4d7d-b54b-1368f05aa468 service neutron] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:40:55.046924 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1135/2309] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 10 05:40:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 05:40:55.431818 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3f571e-9451-438c-b17a-12be03972404 None None] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:40:55.433446 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-ab3f571e-9451-438c-b17a-12be03972404 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:40:55.445656 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3f571e-9451-438c-b17a-12be03972404 None None] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:40:55.450895 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a5d740-9ef7-44e8-850b-43a88e104f25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:40:55.451834 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a5d740-9ef7-44e8-850b-43a88e104f25 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:40:55.452112 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a5d740-9ef7-44e8-850b-43a88e104f25 admin admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:40:55.452369 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a5d740-9ef7-44e8-850b-43a88e104f25 admin admin] PATH_INFO: `/v3/projects/a3fb2b89b1294aa3ac9ac6e599658ac6` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:40:55.453569 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a5d740-9ef7-44e8-850b-43a88e104f25 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a3fb2b89b1294aa3ac9ac6e599658ac6)` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:40:55.455534 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a5d740-9ef7-44e8-850b-43a88e104f25 admin admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:40:55.506539 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-d3a5d740-9ef7-44e8-850b-43a88e104f25 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a3fb2b89b1294aa3ac9ac6e599658ac6', 'request_id': 'req-d3a5d740-9ef7-44e8-850b-43a88e104f25'} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:40:55.513225 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-d3a5d740-9ef7-44e8-850b-43a88e104f25 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a3fb2b89b1294aa3ac9ac6e599658ac6', 'request_id': 'req-d3a5d740-9ef7-44e8-850b-43a88e104f25'} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:40:55.520959 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-d3a5d740-9ef7-44e8-850b-43a88e104f25 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a3fb2b89b1294aa3ac9ac6e599658ac6', 'request_id': 'req-d3a5d740-9ef7-44e8-850b-43a88e104f25'} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:40:55.531620 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-d3a5d740-9ef7-44e8-850b-43a88e104f25 admin admin] The token cache is being invalidate because project a3fb2b89b1294aa3ac9ac6e599658ac6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79879) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 05:40:55.531841 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-d3a5d740-9ef7-44e8-850b-43a88e104f25 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:40:55.532562 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-d3a5d740-9ef7-44e8-850b-43a88e104f25 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:40:55.534393 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1175/2310] 10.222.0.23 () {58 vars in 1232 bytes} [Tue May 10 05:40:55 2022] DELETE /identity/v3/projects/a3fb2b89b1294aa3ac9ac6e599658ac6 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 05:40:55.538596 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a07be3-e01c-4d7d-b54b-1368f05aa468 service neutron] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:40:55.548792 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a07be3-e01c-4d7d-b54b-1368f05aa468 service neutron] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:40:55.603384 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45edc80b-1bd8-4e61-bdf3-3ae733020710 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:40:55.604299 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45edc80b-1bd8-4e61-bdf3-3ae733020710 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:40:55.604579 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45edc80b-1bd8-4e61-bdf3-3ae733020710 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:40:55.604858 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45edc80b-1bd8-4e61-bdf3-3ae733020710 admin admin] PATH_INFO: `/v3/users/fc032f9567c44dd7be93354630ef1ab6` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:40:55.606139 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45edc80b-1bd8-4e61-bdf3-3ae733020710 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fc032f9567c44dd7be93354630ef1ab6)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:40:55.608229 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45edc80b-1bd8-4e61-bdf3-3ae733020710 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:40:55.655194 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-45edc80b-1bd8-4e61-bdf3-3ae733020710 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fc032f9567c44dd7be93354630ef1ab6'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:40:55.673026 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-45edc80b-1bd8-4e61-bdf3-3ae733020710 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fc032f9567c44dd7be93354630ef1ab6'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:40:55.674523 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-45edc80b-1bd8-4e61-bdf3-3ae733020710 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fc032f9567c44dd7be93354630ef1ab6'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:40:55.682181 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-45edc80b-1bd8-4e61-bdf3-3ae733020710 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fc032f9567c44dd7be93354630ef1ab6'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:40:55.682937 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-45edc80b-1bd8-4e61-bdf3-3ae733020710 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fc032f9567c44dd7be93354630ef1ab6'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:40:55.697288 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1136/2311] 10.222.0.23 () {58 vars in 1223 bytes} [Tue May 10 05:40:55 2022] DELETE /identity/v3/users/fc032f9567c44dd7be93354630ef1ab6 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 05:40:56.116176 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a5d740-9ef7-44e8-850b-43a88e104f25 admin admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:40:56.118544 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-d3a5d740-9ef7-44e8-850b-43a88e104f25 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:40:56.133500 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a5d740-9ef7-44e8-850b-43a88e104f25 admin admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:40:56.205292 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f736a1-4646-4c43-87b1-d4d882cfed87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:40:56.206235 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f736a1-4646-4c43-87b1-d4d882cfed87 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:40:56.206588 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f736a1-4646-4c43-87b1-d4d882cfed87 admin admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:40:56.206926 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f736a1-4646-4c43-87b1-d4d882cfed87 admin admin] PATH_INFO: `/v3/projects/440c7dec853e42c1ba8fdbc2d27f082f` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:40:56.208496 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f736a1-4646-4c43-87b1-d4d882cfed87 admin admin] RBAC: Authorizing `identity:delete_project(project_id=440c7dec853e42c1ba8fdbc2d27f082f)` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:40:56.210500 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f736a1-4646-4c43-87b1-d4d882cfed87 admin admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:40:56.259847 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-d8f736a1-4646-4c43-87b1-d4d882cfed87 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '440c7dec853e42c1ba8fdbc2d27f082f', 'request_id': 'req-d8f736a1-4646-4c43-87b1-d4d882cfed87'} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:40:56.266207 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-d8f736a1-4646-4c43-87b1-d4d882cfed87 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '440c7dec853e42c1ba8fdbc2d27f082f', 'request_id': 'req-d8f736a1-4646-4c43-87b1-d4d882cfed87'} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:40:56.274443 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-d8f736a1-4646-4c43-87b1-d4d882cfed87 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '440c7dec853e42c1ba8fdbc2d27f082f', 'request_id': 'req-d8f736a1-4646-4c43-87b1-d4d882cfed87'} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:40:56.284639 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-d8f736a1-4646-4c43-87b1-d4d882cfed87 admin admin] The token cache is being invalidate because project 440c7dec853e42c1ba8fdbc2d27f082f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79879) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 05:40:56.284925 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-d8f736a1-4646-4c43-87b1-d4d882cfed87 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:40:56.285607 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-d8f736a1-4646-4c43-87b1-d4d882cfed87 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:40:56.287264 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1176/2312] 10.222.0.23 () {58 vars in 1232 bytes} [Tue May 10 05:40:56 2022] DELETE /identity/v3/projects/440c7dec853e42c1ba8fdbc2d27f082f => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 05:40:56.292170 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf9a383-81f1-4933-9168-2a61ec3e2ffe None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:40:56.292684 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf9a383-81f1-4933-9168-2a61ec3e2ffe None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:40:56.292785 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf9a383-81f1-4933-9168-2a61ec3e2ffe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:40:56.312078 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-7cf9a383-81f1-4933-9168-2a61ec3e2ffe None None] MFA Rules not processed for user `44883b22532e44049d846938dc2cf423`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:40:56.313518 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-7cf9a383-81f1-4933-9168-2a61ec3e2ffe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:40:56.379917 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1137/2313] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 10 05:40:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 05:40:56.381683 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37db9ca8-0b38-4b41-a362-4d123c497c9b None None] REQUEST_METHOD: `POST` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:40:56.381975 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37db9ca8-0b38-4b41-a362-4d123c497c9b None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:40:56.382256 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37db9ca8-0b38-4b41-a362-4d123c497c9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:40:56.402196 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.auth.core [None req-37db9ca8-0b38-4b41-a362-4d123c497c9b None None] MFA Rules not processed for user `44883b22532e44049d846938dc2cf423`. Rule list: `[]` (Enabled: `True`). {{(pid=79879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:40:56.403417 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-37db9ca8-0b38-4b41-a362-4d123c497c9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:40:56.413748 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1177/2314] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 10 05:40:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 05:40:56.417911 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf9a383-81f1-4933-9168-2a61ec3e2ffe None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:40:56.428206 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf9a383-81f1-4933-9168-2a61ec3e2ffe None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:40:56.435357 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8120b0c-7922-462b-ba62-f347ba996d6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:40:56.436085 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8120b0c-7922-462b-ba62-f347ba996d6f admin admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:40:56.436362 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8120b0c-7922-462b-ba62-f347ba996d6f admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:40:56.436642 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8120b0c-7922-462b-ba62-f347ba996d6f admin admin] PATH_INFO: `/v3/domains` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:40:56.437357 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8120b0c-7922-462b-ba62-f347ba996d6f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:40:56.437660 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8120b0c-7922-462b-ba62-f347ba996d6f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:40:56.439245 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8120b0c-7922-462b-ba62-f347ba996d6f admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:40:56.454500 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1138/2315] 10.222.0.23 () {58 vars in 1152 bytes} [Tue May 10 05:40:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:40:56.458754 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37db9ca8-0b38-4b41-a362-4d123c497c9b None None] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:40:56.468819 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37db9ca8-0b38-4b41-a362-4d123c497c9b None None] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:40:56.473725 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f197f5-0412-4c94-a99a-5b97b334c464 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:40:56.474562 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f197f5-0412-4c94-a99a-5b97b334c464 admin admin] REQUEST_METHOD: `POST` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:40:56.474942 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f197f5-0412-4c94-a99a-5b97b334c464 admin admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:40:56.475301 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f197f5-0412-4c94-a99a-5b97b334c464 admin admin] PATH_INFO: `/v3/projects` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:40:56.476095 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f197f5-0412-4c94-a99a-5b97b334c464 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:40:56.478112 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f197f5-0412-4c94-a99a-5b97b334c464 admin admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:40:56.507480 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1178/2316] 10.222.0.23 () {60 vars in 1152 bytes} [Tue May 10 05:40:56 2022] POST /identity/v3/projects => generated 357 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 05:40:56.511978 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8120b0c-7922-462b-ba62-f347ba996d6f admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:40:56.522271 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8120b0c-7922-462b-ba62-f347ba996d6f admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:40:56.596312 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13170ef3-378a-4701-9b3f-d73b923e3207 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:40:56.597017 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13170ef3-378a-4701-9b3f-d73b923e3207 admin admin] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:40:56.597302 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13170ef3-378a-4701-9b3f-d73b923e3207 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:40:56.597578 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13170ef3-378a-4701-9b3f-d73b923e3207 admin admin] PATH_INFO: `/v3/users` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:40:56.598396 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13170ef3-378a-4701-9b3f-d73b923e3207 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:40:56.600832 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13170ef3-378a-4701-9b3f-d73b923e3207 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:40:56.624210 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1139/2317] 10.222.0.23 () {60 vars in 1143 bytes} [Tue May 10 05:40:56 2022] POST /identity/v3/users => generated 279 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 05:40:56.628494 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f197f5-0412-4c94-a99a-5b97b334c464 admin admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:40:56.639379 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f197f5-0412-4c94-a99a-5b97b334c464 admin admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:40:56.644799 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46914218-55af-4bc5-8cad-2ec52bf7d551 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:40:56.645603 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46914218-55af-4bc5-8cad-2ec52bf7d551 admin admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:40:56.645949 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46914218-55af-4bc5-8cad-2ec52bf7d551 admin admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:40:56.646429 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46914218-55af-4bc5-8cad-2ec52bf7d551 admin admin] PATH_INFO: `/v3/roles` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:40:56.647464 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46914218-55af-4bc5-8cad-2ec52bf7d551 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:40:56.649351 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46914218-55af-4bc5-8cad-2ec52bf7d551 admin admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:40:56.668756 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1179/2318] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 10 05:40:56 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 05:40:56.672833 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13170ef3-378a-4701-9b3f-d73b923e3207 admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:40:56.683006 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13170ef3-378a-4701-9b3f-d73b923e3207 admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:40:56.687740 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5a9c0c-3852-4daa-bdb0-6558deca4fda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:40:56.688419 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5a9c0c-3852-4daa-bdb0-6558deca4fda admin admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:40:56.688697 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5a9c0c-3852-4daa-bdb0-6558deca4fda admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:40:56.688968 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5a9c0c-3852-4daa-bdb0-6558deca4fda admin admin] PATH_INFO: `/v3/roles` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:40:56.689704 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5a9c0c-3852-4daa-bdb0-6558deca4fda admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:40:56.691316 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5a9c0c-3852-4daa-bdb0-6558deca4fda admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:40:56.701842 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1140/2319] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 10 05:40:56 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 05:40:56.705996 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46914218-55af-4bc5-8cad-2ec52bf7d551 admin admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:40:56.716478 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46914218-55af-4bc5-8cad-2ec52bf7d551 admin admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:40:56.721322 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beeede99-02df-470b-82d6-bc15b303f376 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:40:56.722265 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beeede99-02df-470b-82d6-bc15b303f376 admin admin] REQUEST_METHOD: `PUT` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:40:56.722625 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beeede99-02df-470b-82d6-bc15b303f376 admin admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:40:56.722959 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beeede99-02df-470b-82d6-bc15b303f376 admin admin] PATH_INFO: `/v3/projects/6246b0f30208468e8fd7890200b1a759/users/1915ef3d5dac4af08c4e86dfad737784/roles/382636e67fc142a2b2f486340d959e11` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:40:56.739100 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beeede99-02df-470b-82d6-bc15b303f376 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6246b0f30208468e8fd7890200b1a759, user_id=1915ef3d5dac4af08c4e86dfad737784, role_id=382636e67fc142a2b2f486340d959e11)` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:40:56.741879 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beeede99-02df-470b-82d6-bc15b303f376 admin admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:40:56.756989 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1180/2320] 10.222.0.23 () {60 vars in 1482 bytes} [Tue May 10 05:40:56 2022] PUT /identity/v3/projects/6246b0f30208468e8fd7890200b1a759/users/1915ef3d5dac4af08c4e86dfad737784/roles/382636e67fc142a2b2f486340d959e11 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 05:40:56.767380 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a1bca6-a469-4c24-8307-63d0c4d20dbc None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:40:56.767699 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a1bca6-a469-4c24-8307-63d0c4d20dbc None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:40:56.768001 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a1bca6-a469-4c24-8307-63d0c4d20dbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:40:56.794815 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-c7a1bca6-a469-4c24-8307-63d0c4d20dbc None None] MFA Rules not processed for user `1915ef3d5dac4af08c4e86dfad737784`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:40:56.796395 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-c7a1bca6-a469-4c24-8307-63d0c4d20dbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:40:56.862195 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1141/2321] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 10 05:40:56 2022] POST /identity/v3/auth/tokens => generated 3224 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 05:40:56.866709 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beeede99-02df-470b-82d6-bc15b303f376 admin admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:40:56.926766 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beeede99-02df-470b-82d6-bc15b303f376 admin admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:40:56.931259 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e719818-dc33-4569-b40f-7b5dfb0a85bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:40:56.931960 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e719818-dc33-4569-b40f-7b5dfb0a85bd admin admin] REQUEST_METHOD: `POST` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:40:56.932444 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e719818-dc33-4569-b40f-7b5dfb0a85bd admin admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:40:56.932444 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e719818-dc33-4569-b40f-7b5dfb0a85bd admin admin] PATH_INFO: `/v3/projects` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:40:56.933151 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e719818-dc33-4569-b40f-7b5dfb0a85bd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:40:56.935051 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e719818-dc33-4569-b40f-7b5dfb0a85bd admin admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:40:56.963591 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1181/2322] 10.222.0.23 () {60 vars in 1152 bytes} [Tue May 10 05:40:56 2022] POST /identity/v3/projects => generated 357 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 05:40:56.969582 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a1bca6-a469-4c24-8307-63d0c4d20dbc None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:40:56.981045 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a1bca6-a469-4c24-8307-63d0c4d20dbc None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:40:57.042855 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3caae668-3f96-49f8-b415-fface87f3f8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:40:57.043523 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3caae668-3f96-49f8-b415-fface87f3f8a admin admin] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:40:57.043851 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3caae668-3f96-49f8-b415-fface87f3f8a admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:40:57.044127 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3caae668-3f96-49f8-b415-fface87f3f8a admin admin] PATH_INFO: `/v3/users` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:40:57.044924 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3caae668-3f96-49f8-b415-fface87f3f8a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:40:57.046940 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3caae668-3f96-49f8-b415-fface87f3f8a admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:40:57.075766 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1142/2323] 10.222.0.23 () {60 vars in 1143 bytes} [Tue May 10 05:40:56 2022] POST /identity/v3/users => generated 285 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 05:40:57.077979 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e719818-dc33-4569-b40f-7b5dfb0a85bd admin admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:40:57.088745 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e719818-dc33-4569-b40f-7b5dfb0a85bd admin admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:40:57.093924 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0633512a-09be-46f7-b599-600f458f761b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:40:57.094555 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0633512a-09be-46f7-b599-600f458f761b admin admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:40:57.094835 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0633512a-09be-46f7-b599-600f458f761b admin admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:40:57.095111 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0633512a-09be-46f7-b599-600f458f761b admin admin] PATH_INFO: `/v3/roles` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:40:57.095887 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0633512a-09be-46f7-b599-600f458f761b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:40:57.097635 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0633512a-09be-46f7-b599-600f458f761b admin admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:40:57.132888 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1182/2324] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 10 05:40:57 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 05:40:57.137939 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3caae668-3f96-49f8-b415-fface87f3f8a admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:40:57.151386 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3caae668-3f96-49f8-b415-fface87f3f8a admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:40:57.158210 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b8f22c-55bb-4ccd-bee4-48f18bac37e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:40:57.158774 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b8f22c-55bb-4ccd-bee4-48f18bac37e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:40:57.159083 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b8f22c-55bb-4ccd-bee4-48f18bac37e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:40:57.159359 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b8f22c-55bb-4ccd-bee4-48f18bac37e4 admin admin] PATH_INFO: `/v3/projects/be70541ca09448c39104e35b48bf42f8/users/ccc986d372364b28aeab60867acc04d1/roles/199ac1dd842441d7913c6ee89d8fbecc` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:40:57.176198 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b8f22c-55bb-4ccd-bee4-48f18bac37e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=be70541ca09448c39104e35b48bf42f8, user_id=ccc986d372364b28aeab60867acc04d1, role_id=199ac1dd842441d7913c6ee89d8fbecc)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:40:57.182461 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b8f22c-55bb-4ccd-bee4-48f18bac37e4 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:40:57.201616 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1143/2325] 10.222.0.23 () {60 vars in 1482 bytes} [Tue May 10 05:40:57 2022] PUT /identity/v3/projects/be70541ca09448c39104e35b48bf42f8/users/ccc986d372364b28aeab60867acc04d1/roles/199ac1dd842441d7913c6ee89d8fbecc => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 05:40:57.205897 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0633512a-09be-46f7-b599-600f458f761b admin admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:40:57.220585 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0633512a-09be-46f7-b599-600f458f761b admin admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:40:57.293688 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997940bd-b5da-44d3-80c9-3cad4bcf4084 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:40:57.293854 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997940bd-b5da-44d3-80c9-3cad4bcf4084 admin admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:40:57.294095 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997940bd-b5da-44d3-80c9-3cad4bcf4084 admin admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:40:57.294362 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997940bd-b5da-44d3-80c9-3cad4bcf4084 admin admin] PATH_INFO: `/v3/roles` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:40:57.295155 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997940bd-b5da-44d3-80c9-3cad4bcf4084 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:40:57.296812 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997940bd-b5da-44d3-80c9-3cad4bcf4084 admin admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:40:57.312420 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1183/2326] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 10 05:40:57 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 05:40:57.316451 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b8f22c-55bb-4ccd-bee4-48f18bac37e4 admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:40:57.328839 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b8f22c-55bb-4ccd-bee4-48f18bac37e4 admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:40:57.343012 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095a4ec2-2f83-4619-957d-8b963084e0fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:40:57.345185 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095a4ec2-2f83-4619-957d-8b963084e0fa admin admin] REQUEST_METHOD: `PUT` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:40:57.345654 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095a4ec2-2f83-4619-957d-8b963084e0fa admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:40:57.345941 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095a4ec2-2f83-4619-957d-8b963084e0fa admin admin] PATH_INFO: `/v3/projects/be70541ca09448c39104e35b48bf42f8/users/ccc986d372364b28aeab60867acc04d1/roles/199ac1dd842441d7913c6ee89d8fbecc` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:40:57.352447 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095a4ec2-2f83-4619-957d-8b963084e0fa admin admin] RBAC: Authorizing `identity:create_grant(project_id=be70541ca09448c39104e35b48bf42f8, user_id=ccc986d372364b28aeab60867acc04d1, role_id=199ac1dd842441d7913c6ee89d8fbecc)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:40:57.355762 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095a4ec2-2f83-4619-957d-8b963084e0fa admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:40:57.368866 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1144/2327] 10.222.0.23 () {60 vars in 1482 bytes} [Tue May 10 05:40:57 2022] PUT /identity/v3/projects/be70541ca09448c39104e35b48bf42f8/users/ccc986d372364b28aeab60867acc04d1/roles/199ac1dd842441d7913c6ee89d8fbecc => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 05:40:57.380963 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66be7224-06db-4b1c-9474-288abaefc4c6 None None] REQUEST_METHOD: `POST` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:40:57.381261 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66be7224-06db-4b1c-9474-288abaefc4c6 None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:40:57.381540 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66be7224-06db-4b1c-9474-288abaefc4c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:40:57.418255 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.auth.core [None req-66be7224-06db-4b1c-9474-288abaefc4c6 None None] MFA Rules not processed for user `ccc986d372364b28aeab60867acc04d1`. Rule list: `[]` (Enabled: `True`). {{(pid=79879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:40:57.419736 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-66be7224-06db-4b1c-9474-288abaefc4c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:40:57.507207 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1184/2328] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 10 05:40:57 2022] POST /identity/v3/auth/tokens => generated 3291 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 05:40:57.519793 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095a4ec2-2f83-4619-957d-8b963084e0fa admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:40:57.521611 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-095a4ec2-2f83-4619-957d-8b963084e0fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:40:57.591748 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095a4ec2-2f83-4619-957d-8b963084e0fa admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:40:57.596565 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92cfba8-fab3-44b5-9bea-343683e4e103 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355be413675540a39ccb00e1a0722316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f23435f783540199d6dcfd0417c090e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:40:57.597779 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92cfba8-fab3-44b5-9bea-343683e4e103 service cinder] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:40:57.598061 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92cfba8-fab3-44b5-9bea-343683e4e103 service cinder] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:40:57.598335 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92cfba8-fab3-44b5-9bea-343683e4e103 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:40:57.613110 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92cfba8-fab3-44b5-9bea-343683e4e103 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:40:57.614848 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92cfba8-fab3-44b5-9bea-343683e4e103 service cinder] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:40:57.636273 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1145/2329] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 10 05:40:57 2022] GET /identity/v3/auth/tokens => generated 3291 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 05:40:57.719191 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66be7224-06db-4b1c-9474-288abaefc4c6 None None] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:40:57.720773 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-66be7224-06db-4b1c-9474-288abaefc4c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:40:57.755392 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92cfba8-fab3-44b5-9bea-343683e4e103 service cinder] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:40:57.764572 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92cfba8-fab3-44b5-9bea-343683e4e103 service cinder] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:40:57.769332 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263d9e6b-4dad-46d5-a14b-15b7d5cb41de service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355be413675540a39ccb00e1a0722316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f23435f783540199d6dcfd0417c090e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:40:57.769995 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263d9e6b-4dad-46d5-a14b-15b7d5cb41de service cinder] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:40:57.770325 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263d9e6b-4dad-46d5-a14b-15b7d5cb41de service cinder] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:40:57.770598 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263d9e6b-4dad-46d5-a14b-15b7d5cb41de service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:40:57.827839 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66be7224-06db-4b1c-9474-288abaefc4c6 None None] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:40:57.832345 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2095435d-e4d3-4364-82f2-f5c1d2695069 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:40:57.833245 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2095435d-e4d3-4364-82f2-f5c1d2695069 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:40:57.833539 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2095435d-e4d3-4364-82f2-f5c1d2695069 admin admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:40:57.833799 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2095435d-e4d3-4364-82f2-f5c1d2695069 admin admin] PATH_INFO: `/v3/users/1a35edf14fef4d408ae00e7d6fd11399` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:40:57.834992 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2095435d-e4d3-4364-82f2-f5c1d2695069 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1a35edf14fef4d408ae00e7d6fd11399)` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:40:57.836963 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2095435d-e4d3-4364-82f2-f5c1d2695069 admin admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:40:57.845377 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263d9e6b-4dad-46d5-a14b-15b7d5cb41de service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:40:57.846877 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263d9e6b-4dad-46d5-a14b-15b7d5cb41de service cinder] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:40:57.856865 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1146/2330] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 10 05:40:57 2022] GET /identity/v3/auth/tokens => generated 3224 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 05:40:57.891602 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-2095435d-e4d3-4364-82f2-f5c1d2695069 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1a35edf14fef4d408ae00e7d6fd11399'} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:40:57.899527 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-2095435d-e4d3-4364-82f2-f5c1d2695069 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1a35edf14fef4d408ae00e7d6fd11399'} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:40:57.900173 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-2095435d-e4d3-4364-82f2-f5c1d2695069 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1a35edf14fef4d408ae00e7d6fd11399'} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:40:57.913586 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-2095435d-e4d3-4364-82f2-f5c1d2695069 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1a35edf14fef4d408ae00e7d6fd11399'} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:40:57.921743 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-2095435d-e4d3-4364-82f2-f5c1d2695069 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1a35edf14fef4d408ae00e7d6fd11399'} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:40:57.928052 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1185/2331] 10.222.0.23 () {58 vars in 1223 bytes} [Tue May 10 05:40:57 2022] DELETE /identity/v3/users/1a35edf14fef4d408ae00e7d6fd11399 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 05:40:58.115792 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263d9e6b-4dad-46d5-a14b-15b7d5cb41de service cinder] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:40:58.129580 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263d9e6b-4dad-46d5-a14b-15b7d5cb41de service cinder] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:40:58.192981 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d40e02b-1bab-4cc5-849a-381d02f1b290 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:40:58.193849 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d40e02b-1bab-4cc5-849a-381d02f1b290 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:40:58.194125 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d40e02b-1bab-4cc5-849a-381d02f1b290 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:40:58.194557 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d40e02b-1bab-4cc5-849a-381d02f1b290 admin admin] PATH_INFO: `/v3/projects/54da2dd57fd4488ea0266dc8d744cc25` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:40:58.195894 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d40e02b-1bab-4cc5-849a-381d02f1b290 admin admin] RBAC: Authorizing `identity:delete_project(project_id=54da2dd57fd4488ea0266dc8d744cc25)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:40:58.197802 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d40e02b-1bab-4cc5-849a-381d02f1b290 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:40:58.243793 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-0d40e02b-1bab-4cc5-849a-381d02f1b290 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '54da2dd57fd4488ea0266dc8d744cc25', 'request_id': 'req-0d40e02b-1bab-4cc5-849a-381d02f1b290'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:40:58.250098 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-0d40e02b-1bab-4cc5-849a-381d02f1b290 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '54da2dd57fd4488ea0266dc8d744cc25', 'request_id': 'req-0d40e02b-1bab-4cc5-849a-381d02f1b290'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:40:58.258569 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-0d40e02b-1bab-4cc5-849a-381d02f1b290 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '54da2dd57fd4488ea0266dc8d744cc25', 'request_id': 'req-0d40e02b-1bab-4cc5-849a-381d02f1b290'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:40:58.272506 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-0d40e02b-1bab-4cc5-849a-381d02f1b290 admin admin] The token cache is being invalidate because project 54da2dd57fd4488ea0266dc8d744cc25 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79880) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 05:40:58.272835 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-0d40e02b-1bab-4cc5-849a-381d02f1b290 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:40:58.273718 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-0d40e02b-1bab-4cc5-849a-381d02f1b290 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:40:58.276180 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1147/2332] 10.222.0.23 () {58 vars in 1232 bytes} [Tue May 10 05:40:58 2022] DELETE /identity/v3/projects/54da2dd57fd4488ea0266dc8d744cc25 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 05:40:58.282110 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2095435d-e4d3-4364-82f2-f5c1d2695069 admin admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:40:58.284624 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-2095435d-e4d3-4364-82f2-f5c1d2695069 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:40:58.302605 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2095435d-e4d3-4364-82f2-f5c1d2695069 admin admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:40:58.366714 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa455a1-a5d5-4957-8f2d-fbc4ada776fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:40:58.367534 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa455a1-a5d5-4957-8f2d-fbc4ada776fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:40:58.367840 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa455a1-a5d5-4957-8f2d-fbc4ada776fa admin admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:40:58.368109 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa455a1-a5d5-4957-8f2d-fbc4ada776fa admin admin] PATH_INFO: `/v3/users/f8b05ea570184d6bab70a0e97343a804` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:40:58.369425 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa455a1-a5d5-4957-8f2d-fbc4ada776fa admin admin] RBAC: Authorizing `identity:delete_user(user_id=f8b05ea570184d6bab70a0e97343a804)` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:40:58.371417 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa455a1-a5d5-4957-8f2d-fbc4ada776fa admin admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:40:58.418606 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-2fa455a1-a5d5-4957-8f2d-fbc4ada776fa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f8b05ea570184d6bab70a0e97343a804'} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:40:58.426682 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-2fa455a1-a5d5-4957-8f2d-fbc4ada776fa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f8b05ea570184d6bab70a0e97343a804'} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:40:58.427526 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-2fa455a1-a5d5-4957-8f2d-fbc4ada776fa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f8b05ea570184d6bab70a0e97343a804'} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:40:58.438988 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-2fa455a1-a5d5-4957-8f2d-fbc4ada776fa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f8b05ea570184d6bab70a0e97343a804'} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:40:58.445405 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-2fa455a1-a5d5-4957-8f2d-fbc4ada776fa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f8b05ea570184d6bab70a0e97343a804'} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:40:58.451269 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1186/2333] 10.222.0.23 () {58 vars in 1223 bytes} [Tue May 10 05:40:58 2022] DELETE /identity/v3/users/f8b05ea570184d6bab70a0e97343a804 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 05:40:58.635431 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d40e02b-1bab-4cc5-849a-381d02f1b290 admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:40:58.637001 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-0d40e02b-1bab-4cc5-849a-381d02f1b290 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:40:58.650549 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d40e02b-1bab-4cc5-849a-381d02f1b290 admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:40:58.720165 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5e8135-e5f2-4a96-a049-4e999431b6ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:40:58.721026 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5e8135-e5f2-4a96-a049-4e999431b6ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:40:58.721286 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5e8135-e5f2-4a96-a049-4e999431b6ed admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:40:58.721567 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5e8135-e5f2-4a96-a049-4e999431b6ed admin admin] PATH_INFO: `/v3/projects/ca8030ffa56d425b8386c2aa2d96c1b1` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:40:58.722863 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5e8135-e5f2-4a96-a049-4e999431b6ed admin admin] RBAC: Authorizing `identity:delete_project(project_id=ca8030ffa56d425b8386c2aa2d96c1b1)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:40:58.724831 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5e8135-e5f2-4a96-a049-4e999431b6ed admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:40:58.779383 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-4b5e8135-e5f2-4a96-a049-4e999431b6ed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ca8030ffa56d425b8386c2aa2d96c1b1', 'request_id': 'req-4b5e8135-e5f2-4a96-a049-4e999431b6ed'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:40:58.785352 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-4b5e8135-e5f2-4a96-a049-4e999431b6ed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ca8030ffa56d425b8386c2aa2d96c1b1', 'request_id': 'req-4b5e8135-e5f2-4a96-a049-4e999431b6ed'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:40:58.793475 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-4b5e8135-e5f2-4a96-a049-4e999431b6ed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ca8030ffa56d425b8386c2aa2d96c1b1', 'request_id': 'req-4b5e8135-e5f2-4a96-a049-4e999431b6ed'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:40:58.803729 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-4b5e8135-e5f2-4a96-a049-4e999431b6ed admin admin] The token cache is being invalidate because project ca8030ffa56d425b8386c2aa2d96c1b1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79880) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 05:40:58.804012 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-4b5e8135-e5f2-4a96-a049-4e999431b6ed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:40:58.804663 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-4b5e8135-e5f2-4a96-a049-4e999431b6ed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:40:58.806312 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1148/2334] 10.222.0.23 () {58 vars in 1232 bytes} [Tue May 10 05:40:58 2022] DELETE /identity/v3/projects/ca8030ffa56d425b8386c2aa2d96c1b1 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 05:41:01.460233 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e57ba6-3605-43b9-a56e-0bec69e07a67 None None] REQUEST_METHOD: `POST` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:41:01.460735 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e57ba6-3605-43b9-a56e-0bec69e07a67 None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:41:01.460840 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e57ba6-3605-43b9-a56e-0bec69e07a67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:41:01.479078 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.auth.core [None req-82e57ba6-3605-43b9-a56e-0bec69e07a67 None None] MFA Rules not processed for user `c5281b2a1c9a461995653be826207db4`. Rule list: `[]` (Enabled: `True`). {{(pid=79879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:41:01.480348 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-82e57ba6-3605-43b9-a56e-0bec69e07a67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:41:01.535338 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1187/2335] 10.222.0.23 () {58 vars in 1009 bytes} [Tue May 10 05:41:01 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 05:41:01.547986 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5e8135-e5f2-4a96-a049-4e999431b6ed admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:41:01.549390 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-4b5e8135-e5f2-4a96-a049-4e999431b6ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:41:01.637506 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5e8135-e5f2-4a96-a049-4e999431b6ed admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:41:01.643626 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc41e26-41ff-4956-8a2f-4e13c8c5cac6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd31dacf30804395bd029037b407c12a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f23435f783540199d6dcfd0417c090e', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:41:01.644291 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc41e26-41ff-4956-8a2f-4e13c8c5cac6 service swift] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:41:01.644569 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc41e26-41ff-4956-8a2f-4e13c8c5cac6 service swift] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:41:01.644840 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc41e26-41ff-4956-8a2f-4e13c8c5cac6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:41:01.653169 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc41e26-41ff-4956-8a2f-4e13c8c5cac6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:41:01.654834 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc41e26-41ff-4956-8a2f-4e13c8c5cac6 service swift] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:41:01.662944 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1149/2336] 10.222.0.23 () {60 vars in 1384 bytes} [Tue May 10 05:41:01 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 10 05:41:09.684409 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44350f13-69be-4eac-afa2-4de835d6003a None None] REQUEST_METHOD: `POST` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:41:09.684948 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44350f13-69be-4eac-afa2-4de835d6003a None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:41:09.685224 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44350f13-69be-4eac-afa2-4de835d6003a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:41:09.707364 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.auth.core [None req-44350f13-69be-4eac-afa2-4de835d6003a None None] MFA Rules not processed for user `da9d43f65eca485b8b629a4c7a867b93`. Rule list: `[]` (Enabled: `True`). {{(pid=79879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:41:09.708597 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-44350f13-69be-4eac-afa2-4de835d6003a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:41:09.775324 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1188/2337] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 10 05:41:09 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 05:41:10.108307 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc41e26-41ff-4956-8a2f-4e13c8c5cac6 service swift] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:41:10.109821 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-6dc41e26-41ff-4956-8a2f-4e13c8c5cac6 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:41:10.170132 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc41e26-41ff-4956-8a2f-4e13c8c5cac6 service swift] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:41:10.176277 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6662c8ad-f5fd-4a83-855d-2def30a48ae7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c8461cfdd9648b8abcaf8d34b7a102a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f23435f783540199d6dcfd0417c090e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:41:10.177087 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6662c8ad-f5fd-4a83-855d-2def30a48ae7 service neutron] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:41:10.177441 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6662c8ad-f5fd-4a83-855d-2def30a48ae7 service neutron] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:41:10.177882 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6662c8ad-f5fd-4a83-855d-2def30a48ae7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:41:10.180013 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-6662c8ad-f5fd-4a83-855d-2def30a48ae7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:41:10.202402 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6662c8ad-f5fd-4a83-855d-2def30a48ae7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:41:10.204169 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6662c8ad-f5fd-4a83-855d-2def30a48ae7 service neutron] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:41:10.213920 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1150/2338] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 10 05:41:10 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 05:41:10.704363 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44350f13-69be-4eac-afa2-4de835d6003a None None] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:41:10.705879 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-44350f13-69be-4eac-afa2-4de835d6003a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:41:10.789396 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44350f13-69be-4eac-afa2-4de835d6003a None None] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:41:10.795086 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f274c86-e7d2-45df-8306-4c31f9ee952f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67321ca3e5624273acd5b06264738000', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f23435f783540199d6dcfd0417c090e', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:41:10.795965 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f274c86-e7d2-45df-8306-4c31f9ee952f service placement] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:41:10.796410 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f274c86-e7d2-45df-8306-4c31f9ee952f service placement] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:41:10.796830 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f274c86-e7d2-45df-8306-4c31f9ee952f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:41:10.798813 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-6f274c86-e7d2-45df-8306-4c31f9ee952f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:41:10.812904 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f274c86-e7d2-45df-8306-4c31f9ee952f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:41:10.817587 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f274c86-e7d2-45df-8306-4c31f9ee952f service placement] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:41:10.843549 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1189/2339] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 10 05:41:10 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 05:41:13.443884 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6662c8ad-f5fd-4a83-855d-2def30a48ae7 service neutron] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:41:13.445360 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-6662c8ad-f5fd-4a83-855d-2def30a48ae7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:41:13.524712 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6662c8ad-f5fd-4a83-855d-2def30a48ae7 service neutron] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:41:13.530642 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8030d51f-893b-4162-9fe8-3703049ec665 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:41:13.531533 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8030d51f-893b-4162-9fe8-3703049ec665 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:41:13.531909 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8030d51f-893b-4162-9fe8-3703049ec665 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:41:13.532193 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8030d51f-893b-4162-9fe8-3703049ec665 admin admin] PATH_INFO: `/v3/users/1915ef3d5dac4af08c4e86dfad737784` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:41:13.533439 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8030d51f-893b-4162-9fe8-3703049ec665 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1915ef3d5dac4af08c4e86dfad737784)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:41:13.535554 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8030d51f-893b-4162-9fe8-3703049ec665 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:41:13.591955 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-8030d51f-893b-4162-9fe8-3703049ec665 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1915ef3d5dac4af08c4e86dfad737784'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:41:13.604772 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-8030d51f-893b-4162-9fe8-3703049ec665 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1915ef3d5dac4af08c4e86dfad737784'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:41:13.605485 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-8030d51f-893b-4162-9fe8-3703049ec665 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1915ef3d5dac4af08c4e86dfad737784'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:41:13.612543 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-8030d51f-893b-4162-9fe8-3703049ec665 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1915ef3d5dac4af08c4e86dfad737784'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:41:13.613189 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-8030d51f-893b-4162-9fe8-3703049ec665 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1915ef3d5dac4af08c4e86dfad737784'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:41:13.627019 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1151/2340] 10.222.0.23 () {58 vars in 1223 bytes} [Tue May 10 05:41:13 2022] DELETE /identity/v3/users/1915ef3d5dac4af08c4e86dfad737784 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 05:41:13.631917 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0a1f9f-c256-478b-ae02-deffd11cadc3 None None] REQUEST_METHOD: `POST` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:41:13.632406 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0a1f9f-c256-478b-ae02-deffd11cadc3 None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:41:13.632582 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0a1f9f-c256-478b-ae02-deffd11cadc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:41:13.668578 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.auth.core [None req-8b0a1f9f-c256-478b-ae02-deffd11cadc3 None None] MFA Rules not processed for user `44883b22532e44049d846938dc2cf423`. Rule list: `[]` (Enabled: `True`). {{(pid=79879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:41:13.669988 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-8b0a1f9f-c256-478b-ae02-deffd11cadc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:41:13.750257 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1190/2341] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 10 05:41:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 05:41:13.760555 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8030d51f-893b-4162-9fe8-3703049ec665 admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:41:13.762045 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-8030d51f-893b-4162-9fe8-3703049ec665 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:41:13.818786 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8030d51f-893b-4162-9fe8-3703049ec665 admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:41:13.822547 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776e1eee-e1e1-4d3c-99af-f1d62b3b02b3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c8461cfdd9648b8abcaf8d34b7a102a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f23435f783540199d6dcfd0417c090e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:41:13.823191 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776e1eee-e1e1-4d3c-99af-f1d62b3b02b3 service neutron] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:41:13.823467 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776e1eee-e1e1-4d3c-99af-f1d62b3b02b3 service neutron] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:41:13.823815 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776e1eee-e1e1-4d3c-99af-f1d62b3b02b3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:41:13.834773 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776e1eee-e1e1-4d3c-99af-f1d62b3b02b3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:41:13.836234 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776e1eee-e1e1-4d3c-99af-f1d62b3b02b3 service neutron] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:41:13.845530 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1152/2342] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 10 05:41:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 05:41:14.229343 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0a1f9f-c256-478b-ae02-deffd11cadc3 None None] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:41:14.230874 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-8b0a1f9f-c256-478b-ae02-deffd11cadc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:41:14.243452 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0a1f9f-c256-478b-ae02-deffd11cadc3 None None] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:41:14.257735 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a787c8-b7c7-410e-bf1b-3927dab76b9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:41:14.258723 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a787c8-b7c7-410e-bf1b-3927dab76b9e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:41:14.258889 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a787c8-b7c7-410e-bf1b-3927dab76b9e admin admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:41:14.259183 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a787c8-b7c7-410e-bf1b-3927dab76b9e admin admin] PATH_INFO: `/v3/projects/6246b0f30208468e8fd7890200b1a759` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:41:14.260593 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a787c8-b7c7-410e-bf1b-3927dab76b9e admin admin] RBAC: Authorizing `identity:delete_project(project_id=6246b0f30208468e8fd7890200b1a759)` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:41:14.262502 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a787c8-b7c7-410e-bf1b-3927dab76b9e admin admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:41:14.311567 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-a1a787c8-b7c7-410e-bf1b-3927dab76b9e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6246b0f30208468e8fd7890200b1a759', 'request_id': 'req-a1a787c8-b7c7-410e-bf1b-3927dab76b9e'} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:41:14.318731 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-a1a787c8-b7c7-410e-bf1b-3927dab76b9e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6246b0f30208468e8fd7890200b1a759', 'request_id': 'req-a1a787c8-b7c7-410e-bf1b-3927dab76b9e'} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:41:14.328416 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-a1a787c8-b7c7-410e-bf1b-3927dab76b9e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6246b0f30208468e8fd7890200b1a759', 'request_id': 'req-a1a787c8-b7c7-410e-bf1b-3927dab76b9e'} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:41:14.340530 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-a1a787c8-b7c7-410e-bf1b-3927dab76b9e admin admin] The token cache is being invalidate because project 6246b0f30208468e8fd7890200b1a759 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79879) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 05:41:14.340814 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-a1a787c8-b7c7-410e-bf1b-3927dab76b9e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:41:14.341560 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-a1a787c8-b7c7-410e-bf1b-3927dab76b9e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:41:14.344411 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1191/2343] 10.222.0.23 () {58 vars in 1232 bytes} [Tue May 10 05:41:14 2022] DELETE /identity/v3/projects/6246b0f30208468e8fd7890200b1a759 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 05:41:14.348618 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776e1eee-e1e1-4d3c-99af-f1d62b3b02b3 service neutron] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:41:14.358991 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776e1eee-e1e1-4d3c-99af-f1d62b3b02b3 service neutron] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:41:14.423542 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6ec3d3-c1fa-4d79-9a0a-a699c3c0177e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:41:14.424475 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6ec3d3-c1fa-4d79-9a0a-a699c3c0177e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:41:14.424758 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6ec3d3-c1fa-4d79-9a0a-a699c3c0177e admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:41:14.425033 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6ec3d3-c1fa-4d79-9a0a-a699c3c0177e admin admin] PATH_INFO: `/v3/users/ccc986d372364b28aeab60867acc04d1` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:41:14.426368 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6ec3d3-c1fa-4d79-9a0a-a699c3c0177e admin admin] RBAC: Authorizing `identity:delete_user(user_id=ccc986d372364b28aeab60867acc04d1)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:41:14.428359 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6ec3d3-c1fa-4d79-9a0a-a699c3c0177e admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:41:14.478857 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-9f6ec3d3-c1fa-4d79-9a0a-a699c3c0177e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ccc986d372364b28aeab60867acc04d1'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:41:14.491067 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-9f6ec3d3-c1fa-4d79-9a0a-a699c3c0177e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ccc986d372364b28aeab60867acc04d1'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:41:14.491799 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-9f6ec3d3-c1fa-4d79-9a0a-a699c3c0177e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ccc986d372364b28aeab60867acc04d1'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:41:14.498504 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-9f6ec3d3-c1fa-4d79-9a0a-a699c3c0177e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ccc986d372364b28aeab60867acc04d1'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:41:14.499133 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-9f6ec3d3-c1fa-4d79-9a0a-a699c3c0177e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ccc986d372364b28aeab60867acc04d1'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:41:14.513974 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1153/2344] 10.222.0.23 () {58 vars in 1223 bytes} [Tue May 10 05:41:14 2022] DELETE /identity/v3/users/ccc986d372364b28aeab60867acc04d1 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 05:41:14.960525 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a787c8-b7c7-410e-bf1b-3927dab76b9e admin admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:41:14.962067 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-a1a787c8-b7c7-410e-bf1b-3927dab76b9e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:41:14.975408 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a787c8-b7c7-410e-bf1b-3927dab76b9e admin admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:41:15.043326 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efd55cd-2971-49aa-b662-22eb9f3168a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:41:15.044789 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efd55cd-2971-49aa-b662-22eb9f3168a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:41:15.045044 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efd55cd-2971-49aa-b662-22eb9f3168a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:41:15.045327 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efd55cd-2971-49aa-b662-22eb9f3168a8 admin admin] PATH_INFO: `/v3/projects/be70541ca09448c39104e35b48bf42f8` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:41:15.046665 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2efd55cd-2971-49aa-b662-22eb9f3168a8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=be70541ca09448c39104e35b48bf42f8)` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:41:15.048655 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2efd55cd-2971-49aa-b662-22eb9f3168a8 admin admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:41:15.099644 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-2efd55cd-2971-49aa-b662-22eb9f3168a8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'be70541ca09448c39104e35b48bf42f8', 'request_id': 'req-2efd55cd-2971-49aa-b662-22eb9f3168a8'} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:41:15.105597 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-2efd55cd-2971-49aa-b662-22eb9f3168a8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'be70541ca09448c39104e35b48bf42f8', 'request_id': 'req-2efd55cd-2971-49aa-b662-22eb9f3168a8'} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:41:15.114372 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-2efd55cd-2971-49aa-b662-22eb9f3168a8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'be70541ca09448c39104e35b48bf42f8', 'request_id': 'req-2efd55cd-2971-49aa-b662-22eb9f3168a8'} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:41:15.126201 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-2efd55cd-2971-49aa-b662-22eb9f3168a8 admin admin] The token cache is being invalidate because project be70541ca09448c39104e35b48bf42f8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79879) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 05:41:15.126489 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-2efd55cd-2971-49aa-b662-22eb9f3168a8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:41:15.127158 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-2efd55cd-2971-49aa-b662-22eb9f3168a8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:41:15.128938 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1192/2345] 10.222.0.23 () {58 vars in 1232 bytes} [Tue May 10 05:41:14 2022] DELETE /identity/v3/projects/be70541ca09448c39104e35b48bf42f8 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 05:41:15.133923 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c727b76a-65ed-41a7-bddc-b81bce6eb698 None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:41:15.134312 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c727b76a-65ed-41a7-bddc-b81bce6eb698 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:41:15.134651 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c727b76a-65ed-41a7-bddc-b81bce6eb698 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:41:15.152137 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-c727b76a-65ed-41a7-bddc-b81bce6eb698 None None] MFA Rules not processed for user `44883b22532e44049d846938dc2cf423`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:41:15.153412 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-c727b76a-65ed-41a7-bddc-b81bce6eb698 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:41:15.219184 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1154/2346] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 10 05:41:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 05:41:15.225773 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea3e996-19d3-40d3-9a13-21fa32e8f05a None None] REQUEST_METHOD: `POST` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:41:15.227070 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea3e996-19d3-40d3-9a13-21fa32e8f05a None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:41:15.227070 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea3e996-19d3-40d3-9a13-21fa32e8f05a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:41:15.248134 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.auth.core [None req-aea3e996-19d3-40d3-9a13-21fa32e8f05a None None] MFA Rules not processed for user `44883b22532e44049d846938dc2cf423`. Rule list: `[]` (Enabled: `True`). {{(pid=79879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:41:15.249498 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-aea3e996-19d3-40d3-9a13-21fa32e8f05a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:41:15.261723 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1193/2347] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 10 05:41:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 05:41:15.263694 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c727b76a-65ed-41a7-bddc-b81bce6eb698 None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:41:15.276375 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c727b76a-65ed-41a7-bddc-b81bce6eb698 None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:41:15.285619 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525254e2-0f80-4fe7-8743-25f478fa3c0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:41:15.286958 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525254e2-0f80-4fe7-8743-25f478fa3c0f admin admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:41:15.287255 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525254e2-0f80-4fe7-8743-25f478fa3c0f admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:41:15.287602 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525254e2-0f80-4fe7-8743-25f478fa3c0f admin admin] PATH_INFO: `/v3/domains` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:41:15.288394 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525254e2-0f80-4fe7-8743-25f478fa3c0f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:41:15.289044 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525254e2-0f80-4fe7-8743-25f478fa3c0f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:41:15.291080 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525254e2-0f80-4fe7-8743-25f478fa3c0f admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:41:15.314501 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1155/2348] 10.222.0.23 () {58 vars in 1152 bytes} [Tue May 10 05:41:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:41:15.319993 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea3e996-19d3-40d3-9a13-21fa32e8f05a None None] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:41:15.330412 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea3e996-19d3-40d3-9a13-21fa32e8f05a None None] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:41:15.335408 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a1c7d6-99b4-4d25-9780-8625106bd9b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:41:15.336121 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a1c7d6-99b4-4d25-9780-8625106bd9b3 admin admin] REQUEST_METHOD: `POST` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:41:15.336403 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a1c7d6-99b4-4d25-9780-8625106bd9b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:41:15.336675 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a1c7d6-99b4-4d25-9780-8625106bd9b3 admin admin] PATH_INFO: `/v3/projects` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:41:15.337397 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a1c7d6-99b4-4d25-9780-8625106bd9b3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:41:15.339311 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a1c7d6-99b4-4d25-9780-8625106bd9b3 admin admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:41:15.372029 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525254e2-0f80-4fe7-8743-25f478fa3c0f admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:41:15.378747 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1194/2349] 10.222.0.23 () {60 vars in 1152 bytes} [Tue May 10 05:41:15 2022] POST /identity/v3/projects => generated 363 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 05:41:15.383769 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525254e2-0f80-4fe7-8743-25f478fa3c0f admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:41:15.479566 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93c2b8f-a071-4087-adf9-4efce4cadcb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:41:15.480375 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93c2b8f-a071-4087-adf9-4efce4cadcb6 admin admin] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:41:15.480662 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93c2b8f-a071-4087-adf9-4efce4cadcb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:41:15.481077 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93c2b8f-a071-4087-adf9-4efce4cadcb6 admin admin] PATH_INFO: `/v3/users` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:41:15.482120 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93c2b8f-a071-4087-adf9-4efce4cadcb6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:41:15.484378 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93c2b8f-a071-4087-adf9-4efce4cadcb6 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:41:15.507861 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1156/2350] 10.222.0.23 () {60 vars in 1143 bytes} [Tue May 10 05:41:15 2022] POST /identity/v3/users => generated 282 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 05:41:15.512542 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a1c7d6-99b4-4d25-9780-8625106bd9b3 admin admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:41:15.523974 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a1c7d6-99b4-4d25-9780-8625106bd9b3 admin admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:41:15.528932 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc8d415-8d85-4dea-b488-13cb4fcb1688 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:41:15.529518 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc8d415-8d85-4dea-b488-13cb4fcb1688 admin admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:41:15.529798 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc8d415-8d85-4dea-b488-13cb4fcb1688 admin admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:41:15.530082 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc8d415-8d85-4dea-b488-13cb4fcb1688 admin admin] PATH_INFO: `/v3/roles` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:41:15.531063 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc8d415-8d85-4dea-b488-13cb4fcb1688 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:41:15.533408 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc8d415-8d85-4dea-b488-13cb4fcb1688 admin admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:41:15.544127 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1195/2351] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 10 05:41:15 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 05:41:15.548116 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93c2b8f-a071-4087-adf9-4efce4cadcb6 admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:41:15.560180 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93c2b8f-a071-4087-adf9-4efce4cadcb6 admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:41:15.565833 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0c4a59-6361-4f23-bb75-3c9175c3f65e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:41:15.566659 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0c4a59-6361-4f23-bb75-3c9175c3f65e admin admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:41:15.567034 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0c4a59-6361-4f23-bb75-3c9175c3f65e admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:41:15.567319 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0c4a59-6361-4f23-bb75-3c9175c3f65e admin admin] PATH_INFO: `/v3/roles` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:41:15.568099 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0c4a59-6361-4f23-bb75-3c9175c3f65e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:41:15.570200 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0c4a59-6361-4f23-bb75-3c9175c3f65e admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:41:15.581909 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1157/2352] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 10 05:41:15 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 05:41:15.586462 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc8d415-8d85-4dea-b488-13cb4fcb1688 admin admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:41:15.597112 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc8d415-8d85-4dea-b488-13cb4fcb1688 admin admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:41:15.601962 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d3b86b-26d6-46ba-8b90-93077bc0ff2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:41:15.602923 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d3b86b-26d6-46ba-8b90-93077bc0ff2f admin admin] REQUEST_METHOD: `PUT` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:41:15.603270 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d3b86b-26d6-46ba-8b90-93077bc0ff2f admin admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:41:15.603679 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d3b86b-26d6-46ba-8b90-93077bc0ff2f admin admin] PATH_INFO: `/v3/projects/cab5561c478e42519a949d682a325488/users/7a3a3e603195418ba267ce0979bc1824/roles/382636e67fc142a2b2f486340d959e11` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:41:15.624400 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d3b86b-26d6-46ba-8b90-93077bc0ff2f admin admin] RBAC: Authorizing `identity:create_grant(project_id=cab5561c478e42519a949d682a325488, user_id=7a3a3e603195418ba267ce0979bc1824, role_id=382636e67fc142a2b2f486340d959e11)` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:41:15.627845 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d3b86b-26d6-46ba-8b90-93077bc0ff2f admin admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:41:15.645075 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1196/2353] 10.222.0.23 () {60 vars in 1482 bytes} [Tue May 10 05:41:15 2022] PUT /identity/v3/projects/cab5561c478e42519a949d682a325488/users/7a3a3e603195418ba267ce0979bc1824/roles/382636e67fc142a2b2f486340d959e11 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 05:41:15.656414 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5edc3a-de79-4dc6-8408-7a4adfa1b402 None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:41:15.656709 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5edc3a-de79-4dc6-8408-7a4adfa1b402 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:41:15.656992 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5edc3a-de79-4dc6-8408-7a4adfa1b402 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:41:15.688816 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-fd5edc3a-de79-4dc6-8408-7a4adfa1b402 None None] MFA Rules not processed for user `7a3a3e603195418ba267ce0979bc1824`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:41:15.690033 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-fd5edc3a-de79-4dc6-8408-7a4adfa1b402 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:41:15.753162 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1158/2354] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 10 05:41:15 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 05:41:15.759282 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d3b86b-26d6-46ba-8b90-93077bc0ff2f admin admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:41:15.821325 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d3b86b-26d6-46ba-8b90-93077bc0ff2f admin admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:41:15.828564 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b48196f-7c6d-4f8e-8d93-9ccfe9f0d2cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:41:15.829422 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b48196f-7c6d-4f8e-8d93-9ccfe9f0d2cb admin admin] REQUEST_METHOD: `POST` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:41:15.829701 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b48196f-7c6d-4f8e-8d93-9ccfe9f0d2cb admin admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:41:15.829969 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b48196f-7c6d-4f8e-8d93-9ccfe9f0d2cb admin admin] PATH_INFO: `/v3/projects` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:41:15.830653 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b48196f-7c6d-4f8e-8d93-9ccfe9f0d2cb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:41:15.832752 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b48196f-7c6d-4f8e-8d93-9ccfe9f0d2cb admin admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:41:15.860564 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1197/2355] 10.222.0.23 () {60 vars in 1152 bytes} [Tue May 10 05:41:15 2022] POST /identity/v3/projects => generated 363 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 05:41:15.864362 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5edc3a-de79-4dc6-8408-7a4adfa1b402 None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:41:15.877359 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5edc3a-de79-4dc6-8408-7a4adfa1b402 None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:41:15.922917 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b48196f-7c6d-4f8e-8d93-9ccfe9f0d2cb admin admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:41:15.924322 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-3b48196f-7c6d-4f8e-8d93-9ccfe9f0d2cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:41:15.952498 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ea1009-7dcb-4aeb-b7c5-32b7c75895ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:41:15.953271 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ea1009-7dcb-4aeb-b7c5-32b7c75895ae admin admin] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:41:15.953999 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ea1009-7dcb-4aeb-b7c5-32b7c75895ae admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:41:15.954295 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ea1009-7dcb-4aeb-b7c5-32b7c75895ae admin admin] PATH_INFO: `/v3/users` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:41:15.955045 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ea1009-7dcb-4aeb-b7c5-32b7c75895ae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:41:15.957299 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ea1009-7dcb-4aeb-b7c5-32b7c75895ae admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:41:15.985663 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1159/2356] 10.222.0.23 () {60 vars in 1143 bytes} [Tue May 10 05:41:15 2022] POST /identity/v3/users => generated 288 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 05:41:15.990081 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ea1009-7dcb-4aeb-b7c5-32b7c75895ae admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:41:16.001374 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ea1009-7dcb-4aeb-b7c5-32b7c75895ae admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:41:16.006832 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3219fd84-e786-46fd-9e03-6bbde620dc92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:41:16.007695 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3219fd84-e786-46fd-9e03-6bbde620dc92 admin admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:41:16.007827 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3219fd84-e786-46fd-9e03-6bbde620dc92 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:41:16.008102 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3219fd84-e786-46fd-9e03-6bbde620dc92 admin admin] PATH_INFO: `/v3/roles` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:41:16.008847 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3219fd84-e786-46fd-9e03-6bbde620dc92 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:41:16.010516 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3219fd84-e786-46fd-9e03-6bbde620dc92 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:41:16.021855 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1160/2357] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 10 05:41:15 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 05:41:16.022055 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b48196f-7c6d-4f8e-8d93-9ccfe9f0d2cb admin admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:41:16.026286 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3219fd84-e786-46fd-9e03-6bbde620dc92 admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:41:16.028150 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5378577b-1380-4fa8-a045-a42406be5c4c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f50f224ca944983aecfde86375473da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f23435f783540199d6dcfd0417c090e', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:41:16.028895 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5378577b-1380-4fa8-a045-a42406be5c4c service nova] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:41:16.029431 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5378577b-1380-4fa8-a045-a42406be5c4c service nova] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:41:16.029715 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5378577b-1380-4fa8-a045-a42406be5c4c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:41:16.031754 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-5378577b-1380-4fa8-a045-a42406be5c4c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:41:16.038572 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3219fd84-e786-46fd-9e03-6bbde620dc92 admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:41:16.044289 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0a6493-71e2-4047-8074-f43626ab2fe4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:41:16.044744 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5378577b-1380-4fa8-a045-a42406be5c4c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:41:16.045588 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0a6493-71e2-4047-8074-f43626ab2fe4 admin admin] REQUEST_METHOD: `PUT` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:41:16.046180 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0a6493-71e2-4047-8074-f43626ab2fe4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:41:16.046394 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5378577b-1380-4fa8-a045-a42406be5c4c service nova] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:41:16.046625 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0a6493-71e2-4047-8074-f43626ab2fe4 admin admin] PATH_INFO: `/v3/projects/469723af8b4a402181a45c41d8b1d8b6/users/b1986a02898a43ea837ba685c31b2039/roles/199ac1dd842441d7913c6ee89d8fbecc` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:41:16.057522 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1198/2358] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 10 05:41:15 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 05:41:16.062727 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0a6493-71e2-4047-8074-f43626ab2fe4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=469723af8b4a402181a45c41d8b1d8b6, user_id=b1986a02898a43ea837ba685c31b2039, role_id=199ac1dd842441d7913c6ee89d8fbecc)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:41:16.065442 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0a6493-71e2-4047-8074-f43626ab2fe4 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:41:16.082823 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1161/2359] 10.222.0.23 () {60 vars in 1482 bytes} [Tue May 10 05:41:16 2022] PUT /identity/v3/projects/469723af8b4a402181a45c41d8b1d8b6/users/b1986a02898a43ea837ba685c31b2039/roles/199ac1dd842441d7913c6ee89d8fbecc => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 05:41:16.087103 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5378577b-1380-4fa8-a045-a42406be5c4c service nova] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:41:16.102353 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5378577b-1380-4fa8-a045-a42406be5c4c service nova] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:41:16.157336 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370c1a8d-cf2d-486f-b95a-f3e13defba0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:41:16.158007 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370c1a8d-cf2d-486f-b95a-f3e13defba0a admin admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:41:16.158291 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370c1a8d-cf2d-486f-b95a-f3e13defba0a admin admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:41:16.158567 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370c1a8d-cf2d-486f-b95a-f3e13defba0a admin admin] PATH_INFO: `/v3/roles` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:41:16.159299 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370c1a8d-cf2d-486f-b95a-f3e13defba0a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:41:16.160952 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370c1a8d-cf2d-486f-b95a-f3e13defba0a admin admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:41:16.170721 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1199/2360] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 10 05:41:16 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 05:41:16.175298 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0a6493-71e2-4047-8074-f43626ab2fe4 admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:41:16.186187 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0a6493-71e2-4047-8074-f43626ab2fe4 admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:41:16.191222 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06b74f4-c0b8-4fca-9103-8ef123e089f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:41:16.192198 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06b74f4-c0b8-4fca-9103-8ef123e089f2 admin admin] REQUEST_METHOD: `PUT` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:41:16.192510 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06b74f4-c0b8-4fca-9103-8ef123e089f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:41:16.192892 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06b74f4-c0b8-4fca-9103-8ef123e089f2 admin admin] PATH_INFO: `/v3/projects/469723af8b4a402181a45c41d8b1d8b6/users/b1986a02898a43ea837ba685c31b2039/roles/199ac1dd842441d7913c6ee89d8fbecc` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:41:16.194874 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06b74f4-c0b8-4fca-9103-8ef123e089f2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=469723af8b4a402181a45c41d8b1d8b6, user_id=b1986a02898a43ea837ba685c31b2039, role_id=199ac1dd842441d7913c6ee89d8fbecc)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:41:16.197843 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06b74f4-c0b8-4fca-9103-8ef123e089f2 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:41:16.209056 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1162/2361] 10.222.0.23 () {60 vars in 1482 bytes} [Tue May 10 05:41:16 2022] PUT /identity/v3/projects/469723af8b4a402181a45c41d8b1d8b6/users/b1986a02898a43ea837ba685c31b2039/roles/199ac1dd842441d7913c6ee89d8fbecc => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 05:41:16.219465 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a07fc5-8b52-432a-9cf4-3ca54b65a98a None None] REQUEST_METHOD: `POST` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:41:16.219780 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a07fc5-8b52-432a-9cf4-3ca54b65a98a None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:41:16.220037 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a07fc5-8b52-432a-9cf4-3ca54b65a98a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:41:16.250958 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.auth.core [None req-54a07fc5-8b52-432a-9cf4-3ca54b65a98a None None] MFA Rules not processed for user `b1986a02898a43ea837ba685c31b2039`. Rule list: `[]` (Enabled: `True`). {{(pid=79879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:41:16.252226 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-54a07fc5-8b52-432a-9cf4-3ca54b65a98a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:41:16.330575 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1200/2362] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 10 05:41:16 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 05:41:16.343032 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06b74f4-c0b8-4fca-9103-8ef123e089f2 admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:41:16.344998 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-b06b74f4-c0b8-4fca-9103-8ef123e089f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:41:16.410943 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06b74f4-c0b8-4fca-9103-8ef123e089f2 admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:41:16.415017 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e29db1-b49b-4e0d-b8be-2777110aeed7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355be413675540a39ccb00e1a0722316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f23435f783540199d6dcfd0417c090e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:41:16.415687 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e29db1-b49b-4e0d-b8be-2777110aeed7 service cinder] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:41:16.415989 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e29db1-b49b-4e0d-b8be-2777110aeed7 service cinder] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:41:16.416257 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e29db1-b49b-4e0d-b8be-2777110aeed7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:41:16.425287 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e29db1-b49b-4e0d-b8be-2777110aeed7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:41:16.426722 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e29db1-b49b-4e0d-b8be-2777110aeed7 service cinder] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:41:16.436270 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1163/2363] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 10 05:41:16 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 05:41:16.512881 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a07fc5-8b52-432a-9cf4-3ca54b65a98a None None] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:41:16.523494 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a07fc5-8b52-432a-9cf4-3ca54b65a98a None None] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:41:16.527288 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e51da69-f55e-4fa8-a9cb-87f5ee26dbe2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355be413675540a39ccb00e1a0722316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f23435f783540199d6dcfd0417c090e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:41:16.528206 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e51da69-f55e-4fa8-a9cb-87f5ee26dbe2 service cinder] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:41:16.528375 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e51da69-f55e-4fa8-a9cb-87f5ee26dbe2 service cinder] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:41:16.528653 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e51da69-f55e-4fa8-a9cb-87f5ee26dbe2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:41:16.598472 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e51da69-f55e-4fa8-a9cb-87f5ee26dbe2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:41:16.600181 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e51da69-f55e-4fa8-a9cb-87f5ee26dbe2 service cinder] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:41:16.609812 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1201/2364] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 10 05:41:16 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 05:41:18.061567 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8f6aaa-5f4c-45d8-8b3d-ef3820141407 None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:41:18.062472 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8f6aaa-5f4c-45d8-8b3d-ef3820141407 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:41:18.062761 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8f6aaa-5f4c-45d8-8b3d-ef3820141407 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:41:18.083551 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-7d8f6aaa-5f4c-45d8-8b3d-ef3820141407 None None] MFA Rules not processed for user `c5281b2a1c9a461995653be826207db4`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:41:18.084968 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-7d8f6aaa-5f4c-45d8-8b3d-ef3820141407 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:41:18.141723 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1164/2365] 10.222.0.23 () {58 vars in 1009 bytes} [Tue May 10 05:41:18 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 05:41:18.154474 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e51da69-f55e-4fa8-a9cb-87f5ee26dbe2 service cinder] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:41:18.155944 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-5e51da69-f55e-4fa8-a9cb-87f5ee26dbe2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:41:18.231523 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e51da69-f55e-4fa8-a9cb-87f5ee26dbe2 service cinder] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:41:18.237071 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c794bf-111e-4d97-b4f1-721cd0622a46 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd31dacf30804395bd029037b407c12a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f23435f783540199d6dcfd0417c090e', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:41:18.237728 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c794bf-111e-4d97-b4f1-721cd0622a46 service swift] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:41:18.238027 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c794bf-111e-4d97-b4f1-721cd0622a46 service swift] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:41:18.238303 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c794bf-111e-4d97-b4f1-721cd0622a46 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:41:18.247740 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c794bf-111e-4d97-b4f1-721cd0622a46 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:41:18.249393 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c794bf-111e-4d97-b4f1-721cd0622a46 service swift] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:41:18.257832 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1202/2366] 10.222.0.23 () {60 vars in 1384 bytes} [Tue May 10 05:41:18 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 10 05:41:19.355011 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8f6aaa-5f4c-45d8-8b3d-ef3820141407 None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:41:19.425702 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8f6aaa-5f4c-45d8-8b3d-ef3820141407 None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:41:19.430734 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841518e7-5b73-404a-8162-b30b4be9fd52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:41:19.431953 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841518e7-5b73-404a-8162-b30b4be9fd52 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:41:19.432434 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841518e7-5b73-404a-8162-b30b4be9fd52 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:41:19.432916 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841518e7-5b73-404a-8162-b30b4be9fd52 admin admin] PATH_INFO: `/v3/users/7a3a3e603195418ba267ce0979bc1824` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:41:19.434502 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841518e7-5b73-404a-8162-b30b4be9fd52 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7a3a3e603195418ba267ce0979bc1824)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:41:19.436583 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841518e7-5b73-404a-8162-b30b4be9fd52 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:41:19.489466 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-841518e7-5b73-404a-8162-b30b4be9fd52 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7a3a3e603195418ba267ce0979bc1824'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:41:19.502254 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-841518e7-5b73-404a-8162-b30b4be9fd52 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7a3a3e603195418ba267ce0979bc1824'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:41:19.503041 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-841518e7-5b73-404a-8162-b30b4be9fd52 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7a3a3e603195418ba267ce0979bc1824'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:41:19.510239 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-841518e7-5b73-404a-8162-b30b4be9fd52 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7a3a3e603195418ba267ce0979bc1824'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:41:19.510962 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-841518e7-5b73-404a-8162-b30b4be9fd52 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7a3a3e603195418ba267ce0979bc1824'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:41:19.525273 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1165/2367] 10.222.0.23 () {58 vars in 1223 bytes} [Tue May 10 05:41:19 2022] DELETE /identity/v3/users/7a3a3e603195418ba267ce0979bc1824 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 05:41:19.530237 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddd6017-b428-4296-a98e-46f6f8f9f257 None None] REQUEST_METHOD: `POST` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:41:19.532900 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddd6017-b428-4296-a98e-46f6f8f9f257 None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:41:19.533199 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddd6017-b428-4296-a98e-46f6f8f9f257 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:41:19.554463 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.auth.core [None req-3ddd6017-b428-4296-a98e-46f6f8f9f257 None None] MFA Rules not processed for user `44883b22532e44049d846938dc2cf423`. Rule list: `[]` (Enabled: `True`). {{(pid=79879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:41:19.555744 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-3ddd6017-b428-4296-a98e-46f6f8f9f257 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:41:19.615478 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1203/2368] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 10 05:41:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 05:41:19.626598 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841518e7-5b73-404a-8162-b30b4be9fd52 admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:41:19.628362 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-841518e7-5b73-404a-8162-b30b4be9fd52 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:41:19.685494 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841518e7-5b73-404a-8162-b30b4be9fd52 admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:41:19.689439 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2eaa4cb-df0f-4f76-8e96-919f545672e1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c8461cfdd9648b8abcaf8d34b7a102a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f23435f783540199d6dcfd0417c090e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:41:19.690124 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2eaa4cb-df0f-4f76-8e96-919f545672e1 service neutron] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:41:19.690409 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2eaa4cb-df0f-4f76-8e96-919f545672e1 service neutron] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:41:19.690683 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2eaa4cb-df0f-4f76-8e96-919f545672e1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:41:19.700018 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2eaa4cb-df0f-4f76-8e96-919f545672e1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:41:19.701527 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2eaa4cb-df0f-4f76-8e96-919f545672e1 service neutron] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:41:19.710961 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1166/2369] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 10 05:41:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 05:41:20.028641 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddd6017-b428-4296-a98e-46f6f8f9f257 None None] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:41:20.030264 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-3ddd6017-b428-4296-a98e-46f6f8f9f257 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:41:20.056440 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddd6017-b428-4296-a98e-46f6f8f9f257 None None] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:41:20.089019 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222c48a2-28d9-4f02-8861-38e11ab4d26c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:41:20.090308 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222c48a2-28d9-4f02-8861-38e11ab4d26c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:41:20.090694 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222c48a2-28d9-4f02-8861-38e11ab4d26c admin admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:41:20.090920 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222c48a2-28d9-4f02-8861-38e11ab4d26c admin admin] PATH_INFO: `/v3/projects/cab5561c478e42519a949d682a325488` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:41:20.093624 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222c48a2-28d9-4f02-8861-38e11ab4d26c admin admin] RBAC: Authorizing `identity:delete_project(project_id=cab5561c478e42519a949d682a325488)` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:41:20.095662 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222c48a2-28d9-4f02-8861-38e11ab4d26c admin admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:41:20.151045 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-222c48a2-28d9-4f02-8861-38e11ab4d26c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cab5561c478e42519a949d682a325488', 'request_id': 'req-222c48a2-28d9-4f02-8861-38e11ab4d26c'} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:41:20.157409 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-222c48a2-28d9-4f02-8861-38e11ab4d26c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cab5561c478e42519a949d682a325488', 'request_id': 'req-222c48a2-28d9-4f02-8861-38e11ab4d26c'} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:41:20.170242 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-222c48a2-28d9-4f02-8861-38e11ab4d26c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cab5561c478e42519a949d682a325488', 'request_id': 'req-222c48a2-28d9-4f02-8861-38e11ab4d26c'} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:41:20.202740 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-222c48a2-28d9-4f02-8861-38e11ab4d26c admin admin] The token cache is being invalidate because project cab5561c478e42519a949d682a325488 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79879) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 05:41:20.203061 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-222c48a2-28d9-4f02-8861-38e11ab4d26c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:41:20.203814 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-222c48a2-28d9-4f02-8861-38e11ab4d26c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:41:20.206264 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1204/2370] 10.222.0.23 () {58 vars in 1232 bytes} [Tue May 10 05:41:20 2022] DELETE /identity/v3/projects/cab5561c478e42519a949d682a325488 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 05:41:20.210183 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2eaa4cb-df0f-4f76-8e96-919f545672e1 service neutron] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:41:20.221872 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2eaa4cb-df0f-4f76-8e96-919f545672e1 service neutron] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:41:20.302177 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a26289-4b40-466e-87ba-64b84de20b45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:41:20.303223 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a26289-4b40-466e-87ba-64b84de20b45 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:41:20.303488 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a26289-4b40-466e-87ba-64b84de20b45 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:41:20.303869 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a26289-4b40-466e-87ba-64b84de20b45 admin admin] PATH_INFO: `/v3/users/b1986a02898a43ea837ba685c31b2039` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:41:20.305465 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a26289-4b40-466e-87ba-64b84de20b45 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b1986a02898a43ea837ba685c31b2039)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:41:20.308399 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a26289-4b40-466e-87ba-64b84de20b45 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:41:20.377126 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-40a26289-4b40-466e-87ba-64b84de20b45 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b1986a02898a43ea837ba685c31b2039'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:41:20.390503 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-40a26289-4b40-466e-87ba-64b84de20b45 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b1986a02898a43ea837ba685c31b2039'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:41:20.391299 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-40a26289-4b40-466e-87ba-64b84de20b45 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b1986a02898a43ea837ba685c31b2039'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:41:20.398473 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-40a26289-4b40-466e-87ba-64b84de20b45 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b1986a02898a43ea837ba685c31b2039'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:41:20.399449 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-40a26289-4b40-466e-87ba-64b84de20b45 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b1986a02898a43ea837ba685c31b2039'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:41:20.412826 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1167/2371] 10.222.0.23 () {58 vars in 1223 bytes} [Tue May 10 05:41:20 2022] DELETE /identity/v3/users/b1986a02898a43ea837ba685c31b2039 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 05:41:20.712601 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222c48a2-28d9-4f02-8861-38e11ab4d26c admin admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:41:20.714249 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-222c48a2-28d9-4f02-8861-38e11ab4d26c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:41:20.736397 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222c48a2-28d9-4f02-8861-38e11ab4d26c admin admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:41:20.794097 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fcd397-0faf-42cb-be7c-9cc2111fec28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:41:20.794984 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fcd397-0faf-42cb-be7c-9cc2111fec28 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:41:20.795261 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fcd397-0faf-42cb-be7c-9cc2111fec28 admin admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:41:20.795531 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fcd397-0faf-42cb-be7c-9cc2111fec28 admin admin] PATH_INFO: `/v3/projects/469723af8b4a402181a45c41d8b1d8b6` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:41:20.796747 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6fcd397-0faf-42cb-be7c-9cc2111fec28 admin admin] RBAC: Authorizing `identity:delete_project(project_id=469723af8b4a402181a45c41d8b1d8b6)` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:41:20.798669 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6fcd397-0faf-42cb-be7c-9cc2111fec28 admin admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:41:20.847244 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-c6fcd397-0faf-42cb-be7c-9cc2111fec28 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '469723af8b4a402181a45c41d8b1d8b6', 'request_id': 'req-c6fcd397-0faf-42cb-be7c-9cc2111fec28'} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:41:20.853293 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-c6fcd397-0faf-42cb-be7c-9cc2111fec28 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '469723af8b4a402181a45c41d8b1d8b6', 'request_id': 'req-c6fcd397-0faf-42cb-be7c-9cc2111fec28'} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:41:20.860613 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-c6fcd397-0faf-42cb-be7c-9cc2111fec28 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '469723af8b4a402181a45c41d8b1d8b6', 'request_id': 'req-c6fcd397-0faf-42cb-be7c-9cc2111fec28'} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:41:20.870552 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-c6fcd397-0faf-42cb-be7c-9cc2111fec28 admin admin] The token cache is being invalidate because project 469723af8b4a402181a45c41d8b1d8b6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79879) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 05:41:20.870833 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-c6fcd397-0faf-42cb-be7c-9cc2111fec28 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:41:20.871449 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-c6fcd397-0faf-42cb-be7c-9cc2111fec28 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:41:20.873085 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1205/2372] 10.222.0.23 () {58 vars in 1232 bytes} [Tue May 10 05:41:20 2022] DELETE /identity/v3/projects/469723af8b4a402181a45c41d8b1d8b6 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 05:41:20.878350 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d3d68f-f37c-438a-96b6-0651f3cd565f None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:41:20.878636 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d3d68f-f37c-438a-96b6-0651f3cd565f None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:41:20.878914 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d3d68f-f37c-438a-96b6-0651f3cd565f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:41:20.897133 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-d7d3d68f-f37c-438a-96b6-0651f3cd565f None None] MFA Rules not processed for user `44883b22532e44049d846938dc2cf423`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:41:20.898332 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-d7d3d68f-f37c-438a-96b6-0651f3cd565f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:41:20.958730 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1168/2373] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 10 05:41:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 05:41:20.967334 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dabf7f7-1029-461b-a2bc-e056c13b0d8f None None] REQUEST_METHOD: `POST` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:41:20.967817 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dabf7f7-1029-461b-a2bc-e056c13b0d8f None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:41:20.968101 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dabf7f7-1029-461b-a2bc-e056c13b0d8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:41:20.988740 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.auth.core [None req-5dabf7f7-1029-461b-a2bc-e056c13b0d8f None None] MFA Rules not processed for user `44883b22532e44049d846938dc2cf423`. Rule list: `[]` (Enabled: `True`). {{(pid=79879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:41:20.990025 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-5dabf7f7-1029-461b-a2bc-e056c13b0d8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:41:21.002829 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1206/2374] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 10 05:41:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 05:41:21.004424 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d3d68f-f37c-438a-96b6-0651f3cd565f None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:41:21.015468 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d3d68f-f37c-438a-96b6-0651f3cd565f None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:41:21.020341 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788be6d4-48e7-4268-b84f-43e83b4048d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:41:21.021023 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788be6d4-48e7-4268-b84f-43e83b4048d5 admin admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:41:21.021297 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788be6d4-48e7-4268-b84f-43e83b4048d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:41:21.021575 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788be6d4-48e7-4268-b84f-43e83b4048d5 admin admin] PATH_INFO: `/v3/domains` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:41:21.022452 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788be6d4-48e7-4268-b84f-43e83b4048d5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:41:21.022766 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788be6d4-48e7-4268-b84f-43e83b4048d5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:41:21.024775 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788be6d4-48e7-4268-b84f-43e83b4048d5 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:41:21.055700 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1169/2375] 10.222.0.23 () {58 vars in 1152 bytes} [Tue May 10 05:41:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:41:21.061616 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dabf7f7-1029-461b-a2bc-e056c13b0d8f None None] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:41:21.074274 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dabf7f7-1029-461b-a2bc-e056c13b0d8f None None] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:41:21.079317 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5782913-0747-4d64-8aed-332de71f53db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:41:21.084247 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5782913-0747-4d64-8aed-332de71f53db admin admin] REQUEST_METHOD: `POST` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:41:21.084613 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5782913-0747-4d64-8aed-332de71f53db admin admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:41:21.084987 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5782913-0747-4d64-8aed-332de71f53db admin admin] PATH_INFO: `/v3/projects` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:41:21.085702 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5782913-0747-4d64-8aed-332de71f53db admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:41:21.087686 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5782913-0747-4d64-8aed-332de71f53db admin admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:41:21.113971 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1207/2376] 10.222.0.23 () {60 vars in 1152 bytes} [Tue May 10 05:41:21 2022] POST /identity/v3/projects => generated 399 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 05:41:21.117902 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788be6d4-48e7-4268-b84f-43e83b4048d5 admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:41:21.129470 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788be6d4-48e7-4268-b84f-43e83b4048d5 admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:41:21.189566 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ae3ce1-77c9-414c-8aa9-94ccb877e782 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:41:21.190270 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ae3ce1-77c9-414c-8aa9-94ccb877e782 admin admin] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:41:21.190573 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ae3ce1-77c9-414c-8aa9-94ccb877e782 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:41:21.190850 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ae3ce1-77c9-414c-8aa9-94ccb877e782 admin admin] PATH_INFO: `/v3/users` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:41:21.191685 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ae3ce1-77c9-414c-8aa9-94ccb877e782 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:41:21.194528 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ae3ce1-77c9-414c-8aa9-94ccb877e782 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:41:21.216679 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1170/2377] 10.222.0.23 () {60 vars in 1143 bytes} [Tue May 10 05:41:21 2022] POST /identity/v3/users => generated 300 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 05:41:21.220886 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5782913-0747-4d64-8aed-332de71f53db admin admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:41:21.232025 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5782913-0747-4d64-8aed-332de71f53db admin admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:41:21.237538 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61a46db-d8a0-422b-8471-a2a31bb00dc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:41:21.238222 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61a46db-d8a0-422b-8471-a2a31bb00dc4 admin admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:41:21.238525 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61a46db-d8a0-422b-8471-a2a31bb00dc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:41:21.238799 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61a46db-d8a0-422b-8471-a2a31bb00dc4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:41:21.239596 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61a46db-d8a0-422b-8471-a2a31bb00dc4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:41:21.241209 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61a46db-d8a0-422b-8471-a2a31bb00dc4 admin admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:41:21.252253 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1208/2378] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 10 05:41:21 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 05:41:21.256263 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ae3ce1-77c9-414c-8aa9-94ccb877e782 admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:41:21.266088 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ae3ce1-77c9-414c-8aa9-94ccb877e782 admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:41:21.271813 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98a2d5a-7179-4ade-a245-f7306af1e11b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:41:21.272446 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98a2d5a-7179-4ade-a245-f7306af1e11b admin admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:41:21.272728 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98a2d5a-7179-4ade-a245-f7306af1e11b admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:41:21.272999 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98a2d5a-7179-4ade-a245-f7306af1e11b admin admin] PATH_INFO: `/v3/roles` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:41:21.273734 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98a2d5a-7179-4ade-a245-f7306af1e11b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:41:21.275363 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98a2d5a-7179-4ade-a245-f7306af1e11b admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:41:21.297675 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1171/2379] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 10 05:41:21 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 05:41:21.299020 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61a46db-d8a0-422b-8471-a2a31bb00dc4 admin admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:41:21.317707 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61a46db-d8a0-422b-8471-a2a31bb00dc4 admin admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:41:21.326563 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fd484d-d043-4d5a-a99e-6ecd5ccabd2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:41:21.327498 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fd484d-d043-4d5a-a99e-6ecd5ccabd2b admin admin] REQUEST_METHOD: `PUT` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:41:21.327829 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fd484d-d043-4d5a-a99e-6ecd5ccabd2b admin admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:41:21.328106 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fd484d-d043-4d5a-a99e-6ecd5ccabd2b admin admin] PATH_INFO: `/v3/projects/769a93f13fff4d98a55d8eab07b8dd0c/users/cf3fc3133efc476b9336d8a3c6bf97fc/roles/382636e67fc142a2b2f486340d959e11` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:41:21.344773 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82fd484d-d043-4d5a-a99e-6ecd5ccabd2b admin admin] RBAC: Authorizing `identity:create_grant(project_id=769a93f13fff4d98a55d8eab07b8dd0c, user_id=cf3fc3133efc476b9336d8a3c6bf97fc, role_id=382636e67fc142a2b2f486340d959e11)` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:41:21.359251 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82fd484d-d043-4d5a-a99e-6ecd5ccabd2b admin admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:41:21.384103 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1209/2380] 10.222.0.23 () {60 vars in 1482 bytes} [Tue May 10 05:41:21 2022] PUT /identity/v3/projects/769a93f13fff4d98a55d8eab07b8dd0c/users/cf3fc3133efc476b9336d8a3c6bf97fc/roles/382636e67fc142a2b2f486340d959e11 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 05:41:21.395546 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa56035-ed2b-49b9-b1a5-08d1d54e639a None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:41:21.396536 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa56035-ed2b-49b9-b1a5-08d1d54e639a None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:41:21.396981 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa56035-ed2b-49b9-b1a5-08d1d54e639a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:41:21.424064 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-baa56035-ed2b-49b9-b1a5-08d1d54e639a None None] MFA Rules not processed for user `cf3fc3133efc476b9336d8a3c6bf97fc`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:41:21.426497 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-baa56035-ed2b-49b9-b1a5-08d1d54e639a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:41:21.491851 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1172/2381] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 10 05:41:21 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 05:41:21.496392 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fd484d-d043-4d5a-a99e-6ecd5ccabd2b admin admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:41:21.555388 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fd484d-d043-4d5a-a99e-6ecd5ccabd2b admin admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:41:21.559999 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76157d7-71b0-4e8c-83c8-b112cda19bc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:41:21.560777 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76157d7-71b0-4e8c-83c8-b112cda19bc1 admin admin] REQUEST_METHOD: `POST` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:41:21.561051 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76157d7-71b0-4e8c-83c8-b112cda19bc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:41:21.561318 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76157d7-71b0-4e8c-83c8-b112cda19bc1 admin admin] PATH_INFO: `/v3/projects` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:41:21.562013 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76157d7-71b0-4e8c-83c8-b112cda19bc1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:41:21.563951 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76157d7-71b0-4e8c-83c8-b112cda19bc1 admin admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:41:21.589332 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1210/2382] 10.222.0.23 () {60 vars in 1152 bytes} [Tue May 10 05:41:21 2022] POST /identity/v3/projects => generated 401 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 05:41:21.593266 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa56035-ed2b-49b9-b1a5-08d1d54e639a None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:41:21.604373 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa56035-ed2b-49b9-b1a5-08d1d54e639a None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:41:21.662369 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd824a0-5629-4f2f-b684-3cff0835b871 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:41:21.662951 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd824a0-5629-4f2f-b684-3cff0835b871 admin admin] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:41:21.663234 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd824a0-5629-4f2f-b684-3cff0835b871 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:41:21.663511 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd824a0-5629-4f2f-b684-3cff0835b871 admin admin] PATH_INFO: `/v3/users` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:41:21.664245 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd824a0-5629-4f2f-b684-3cff0835b871 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:41:21.666161 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd824a0-5629-4f2f-b684-3cff0835b871 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:41:21.686843 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1173/2383] 10.222.0.23 () {60 vars in 1143 bytes} [Tue May 10 05:41:21 2022] POST /identity/v3/users => generated 307 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 05:41:21.690890 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76157d7-71b0-4e8c-83c8-b112cda19bc1 admin admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:41:21.701673 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76157d7-71b0-4e8c-83c8-b112cda19bc1 admin admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:41:21.707325 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7caa7a3d-5216-4bfc-894d-6dd1429d5ecc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:41:21.708051 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7caa7a3d-5216-4bfc-894d-6dd1429d5ecc admin admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:41:21.708323 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7caa7a3d-5216-4bfc-894d-6dd1429d5ecc admin admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:41:21.708592 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7caa7a3d-5216-4bfc-894d-6dd1429d5ecc admin admin] PATH_INFO: `/v3/roles` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:41:21.709318 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7caa7a3d-5216-4bfc-894d-6dd1429d5ecc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:41:21.710926 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7caa7a3d-5216-4bfc-894d-6dd1429d5ecc admin admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:41:21.723460 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1211/2384] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 10 05:41:21 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 05:41:21.728559 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd824a0-5629-4f2f-b684-3cff0835b871 admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:41:21.740498 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd824a0-5629-4f2f-b684-3cff0835b871 admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:41:21.746261 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5182ca-4d73-4370-ad79-6156bff752dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:41:21.747266 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5182ca-4d73-4370-ad79-6156bff752dd admin admin] REQUEST_METHOD: `PUT` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:41:21.747675 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5182ca-4d73-4370-ad79-6156bff752dd admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:41:21.748139 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5182ca-4d73-4370-ad79-6156bff752dd admin admin] PATH_INFO: `/v3/projects/2df50fdcbc4d43f08a28d2a7f77c8a01/users/22d9f657cccd4532ae1bf681993a86f1/roles/199ac1dd842441d7913c6ee89d8fbecc` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:41:21.768265 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5182ca-4d73-4370-ad79-6156bff752dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=2df50fdcbc4d43f08a28d2a7f77c8a01, user_id=22d9f657cccd4532ae1bf681993a86f1, role_id=199ac1dd842441d7913c6ee89d8fbecc)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:41:21.771113 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5182ca-4d73-4370-ad79-6156bff752dd admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:41:21.790770 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1174/2385] 10.222.0.23 () {60 vars in 1482 bytes} [Tue May 10 05:41:21 2022] PUT /identity/v3/projects/2df50fdcbc4d43f08a28d2a7f77c8a01/users/22d9f657cccd4532ae1bf681993a86f1/roles/199ac1dd842441d7913c6ee89d8fbecc => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 05:41:21.793131 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7caa7a3d-5216-4bfc-894d-6dd1429d5ecc admin admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:41:21.806028 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7caa7a3d-5216-4bfc-894d-6dd1429d5ecc admin admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:41:21.865728 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a303c11-5a44-44f2-921c-3703129fea71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:41:21.866398 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a303c11-5a44-44f2-921c-3703129fea71 admin admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:41:21.866678 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a303c11-5a44-44f2-921c-3703129fea71 admin admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:41:21.866944 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a303c11-5a44-44f2-921c-3703129fea71 admin admin] PATH_INFO: `/v3/roles` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:41:21.867736 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a303c11-5a44-44f2-921c-3703129fea71 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:41:21.869334 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a303c11-5a44-44f2-921c-3703129fea71 admin admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:41:21.882503 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1212/2386] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 10 05:41:21 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 05:41:21.883805 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5182ca-4d73-4370-ad79-6156bff752dd admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:41:21.894441 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5182ca-4d73-4370-ad79-6156bff752dd admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:41:21.899068 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e3c786-d9a2-4a1e-a602-150340b03eb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:41:21.899995 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e3c786-d9a2-4a1e-a602-150340b03eb4 admin admin] REQUEST_METHOD: `PUT` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:41:21.900282 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e3c786-d9a2-4a1e-a602-150340b03eb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:41:21.900550 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e3c786-d9a2-4a1e-a602-150340b03eb4 admin admin] PATH_INFO: `/v3/projects/2df50fdcbc4d43f08a28d2a7f77c8a01/users/22d9f657cccd4532ae1bf681993a86f1/roles/199ac1dd842441d7913c6ee89d8fbecc` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:41:21.902492 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e3c786-d9a2-4a1e-a602-150340b03eb4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2df50fdcbc4d43f08a28d2a7f77c8a01, user_id=22d9f657cccd4532ae1bf681993a86f1, role_id=199ac1dd842441d7913c6ee89d8fbecc)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:41:21.905202 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e3c786-d9a2-4a1e-a602-150340b03eb4 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:41:21.915085 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1175/2387] 10.222.0.23 () {60 vars in 1482 bytes} [Tue May 10 05:41:21 2022] PUT /identity/v3/projects/2df50fdcbc4d43f08a28d2a7f77c8a01/users/22d9f657cccd4532ae1bf681993a86f1/roles/199ac1dd842441d7913c6ee89d8fbecc => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 05:41:21.925898 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8171de27-ea8d-4e2a-a537-9154e81ae6bd None None] REQUEST_METHOD: `POST` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:41:21.926183 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8171de27-ea8d-4e2a-a537-9154e81ae6bd None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:41:21.926459 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8171de27-ea8d-4e2a-a537-9154e81ae6bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:41:21.955397 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.auth.core [None req-8171de27-ea8d-4e2a-a537-9154e81ae6bd None None] MFA Rules not processed for user `22d9f657cccd4532ae1bf681993a86f1`. Rule list: `[]` (Enabled: `True`). {{(pid=79879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:41:21.956637 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-8171de27-ea8d-4e2a-a537-9154e81ae6bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:41:22.036978 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1213/2388] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 10 05:41:21 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 05:41:22.049642 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e3c786-d9a2-4a1e-a602-150340b03eb4 admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:41:22.051499 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-f8e3c786-d9a2-4a1e-a602-150340b03eb4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:41:22.106793 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e3c786-d9a2-4a1e-a602-150340b03eb4 admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:41:22.110632 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8219b486-0f85-4495-9308-8d1fb8e22985 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355be413675540a39ccb00e1a0722316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f23435f783540199d6dcfd0417c090e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:41:22.111245 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8219b486-0f85-4495-9308-8d1fb8e22985 service cinder] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:41:22.111540 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8219b486-0f85-4495-9308-8d1fb8e22985 service cinder] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:41:22.111845 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8219b486-0f85-4495-9308-8d1fb8e22985 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:41:22.121103 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8219b486-0f85-4495-9308-8d1fb8e22985 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:41:22.123900 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8219b486-0f85-4495-9308-8d1fb8e22985 service cinder] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:41:22.137395 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1176/2389] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 10 05:41:22 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 05:41:22.232519 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8171de27-ea8d-4e2a-a537-9154e81ae6bd None None] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:41:22.243681 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8171de27-ea8d-4e2a-a537-9154e81ae6bd None None] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:41:22.247740 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c62e6c0-8eca-4b4e-90b8-a15c10e593a9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355be413675540a39ccb00e1a0722316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f23435f783540199d6dcfd0417c090e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:41:22.248576 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c62e6c0-8eca-4b4e-90b8-a15c10e593a9 service cinder] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:41:22.248943 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c62e6c0-8eca-4b4e-90b8-a15c10e593a9 service cinder] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:41:22.249408 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c62e6c0-8eca-4b4e-90b8-a15c10e593a9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:41:22.305962 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c62e6c0-8eca-4b4e-90b8-a15c10e593a9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:41:22.307411 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c62e6c0-8eca-4b4e-90b8-a15c10e593a9 service cinder] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:41:22.316464 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1214/2390] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 10 05:41:22 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 05:41:26.451410 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8219b486-0f85-4495-9308-8d1fb8e22985 service cinder] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:41:26.522557 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8219b486-0f85-4495-9308-8d1fb8e22985 service cinder] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:41:26.527816 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5409c5e9-daa2-4ef9-b5fc-fb3a80439470 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:41:26.528733 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5409c5e9-daa2-4ef9-b5fc-fb3a80439470 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:41:26.529161 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5409c5e9-daa2-4ef9-b5fc-fb3a80439470 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:41:26.529440 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5409c5e9-daa2-4ef9-b5fc-fb3a80439470 admin admin] PATH_INFO: `/v3/users/cf3fc3133efc476b9336d8a3c6bf97fc` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:41:26.530735 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5409c5e9-daa2-4ef9-b5fc-fb3a80439470 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cf3fc3133efc476b9336d8a3c6bf97fc)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:41:26.532715 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5409c5e9-daa2-4ef9-b5fc-fb3a80439470 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:41:26.583926 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-5409c5e9-daa2-4ef9-b5fc-fb3a80439470 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cf3fc3133efc476b9336d8a3c6bf97fc'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:41:26.597988 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-5409c5e9-daa2-4ef9-b5fc-fb3a80439470 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cf3fc3133efc476b9336d8a3c6bf97fc'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:41:26.598739 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-5409c5e9-daa2-4ef9-b5fc-fb3a80439470 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cf3fc3133efc476b9336d8a3c6bf97fc'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:41:26.605515 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-5409c5e9-daa2-4ef9-b5fc-fb3a80439470 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cf3fc3133efc476b9336d8a3c6bf97fc'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:41:26.606163 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-5409c5e9-daa2-4ef9-b5fc-fb3a80439470 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cf3fc3133efc476b9336d8a3c6bf97fc'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:41:26.620470 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1177/2391] 10.222.0.23 () {58 vars in 1223 bytes} [Tue May 10 05:41:26 2022] DELETE /identity/v3/users/cf3fc3133efc476b9336d8a3c6bf97fc => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 05:41:26.625261 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226f1f5e-57d8-47f6-b6b9-768aaf05c410 None None] REQUEST_METHOD: `POST` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:41:26.626094 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226f1f5e-57d8-47f6-b6b9-768aaf05c410 None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:41:26.626195 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226f1f5e-57d8-47f6-b6b9-768aaf05c410 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:41:26.642723 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.auth.core [None req-226f1f5e-57d8-47f6-b6b9-768aaf05c410 None None] MFA Rules not processed for user `44883b22532e44049d846938dc2cf423`. Rule list: `[]` (Enabled: `True`). {{(pid=79879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:41:26.643965 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-226f1f5e-57d8-47f6-b6b9-768aaf05c410 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:41:26.700694 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1215/2392] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 10 05:41:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 05:41:26.710561 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5409c5e9-daa2-4ef9-b5fc-fb3a80439470 admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:41:26.712383 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-5409c5e9-daa2-4ef9-b5fc-fb3a80439470 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:41:26.772993 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5409c5e9-daa2-4ef9-b5fc-fb3a80439470 admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:41:26.776932 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fdeeda-782d-456e-bdd1-436207a707c9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c8461cfdd9648b8abcaf8d34b7a102a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f23435f783540199d6dcfd0417c090e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:41:26.777570 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fdeeda-782d-456e-bdd1-436207a707c9 service neutron] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:41:26.777849 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fdeeda-782d-456e-bdd1-436207a707c9 service neutron] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:41:26.778121 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fdeeda-782d-456e-bdd1-436207a707c9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:41:26.790184 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fdeeda-782d-456e-bdd1-436207a707c9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:41:26.792483 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fdeeda-782d-456e-bdd1-436207a707c9 service neutron] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:41:26.807485 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1178/2393] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 10 05:41:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 05:41:27.162246 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226f1f5e-57d8-47f6-b6b9-768aaf05c410 None None] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:41:27.163811 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-226f1f5e-57d8-47f6-b6b9-768aaf05c410 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:41:27.176193 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226f1f5e-57d8-47f6-b6b9-768aaf05c410 None None] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:41:27.181573 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba7433f-27a6-4243-b1ed-6ef36fcbc9e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:41:27.182635 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba7433f-27a6-4243-b1ed-6ef36fcbc9e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:41:27.182898 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba7433f-27a6-4243-b1ed-6ef36fcbc9e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:41:27.183185 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba7433f-27a6-4243-b1ed-6ef36fcbc9e2 admin admin] PATH_INFO: `/v3/projects/769a93f13fff4d98a55d8eab07b8dd0c` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:41:27.184692 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba7433f-27a6-4243-b1ed-6ef36fcbc9e2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=769a93f13fff4d98a55d8eab07b8dd0c)` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:41:27.187085 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba7433f-27a6-4243-b1ed-6ef36fcbc9e2 admin admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:41:27.238595 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-0ba7433f-27a6-4243-b1ed-6ef36fcbc9e2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '769a93f13fff4d98a55d8eab07b8dd0c', 'request_id': 'req-0ba7433f-27a6-4243-b1ed-6ef36fcbc9e2'} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:41:27.248002 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-0ba7433f-27a6-4243-b1ed-6ef36fcbc9e2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '769a93f13fff4d98a55d8eab07b8dd0c', 'request_id': 'req-0ba7433f-27a6-4243-b1ed-6ef36fcbc9e2'} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:41:27.263321 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-0ba7433f-27a6-4243-b1ed-6ef36fcbc9e2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '769a93f13fff4d98a55d8eab07b8dd0c', 'request_id': 'req-0ba7433f-27a6-4243-b1ed-6ef36fcbc9e2'} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:41:27.277248 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-0ba7433f-27a6-4243-b1ed-6ef36fcbc9e2 admin admin] The token cache is being invalidate because project 769a93f13fff4d98a55d8eab07b8dd0c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79879) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 05:41:27.277535 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-0ba7433f-27a6-4243-b1ed-6ef36fcbc9e2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:41:27.282384 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-0ba7433f-27a6-4243-b1ed-6ef36fcbc9e2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:41:27.284366 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1216/2394] 10.222.0.23 () {58 vars in 1232 bytes} [Tue May 10 05:41:27 2022] DELETE /identity/v3/projects/769a93f13fff4d98a55d8eab07b8dd0c => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 05:41:27.288542 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fdeeda-782d-456e-bdd1-436207a707c9 service neutron] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:41:27.307307 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fdeeda-782d-456e-bdd1-436207a707c9 service neutron] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:41:27.377498 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65199610-199c-4113-95f5-3d2ca7916865 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:41:27.378385 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65199610-199c-4113-95f5-3d2ca7916865 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:41:27.378668 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65199610-199c-4113-95f5-3d2ca7916865 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:41:27.378946 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65199610-199c-4113-95f5-3d2ca7916865 admin admin] PATH_INFO: `/v3/users/22d9f657cccd4532ae1bf681993a86f1` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:41:27.380190 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65199610-199c-4113-95f5-3d2ca7916865 admin admin] RBAC: Authorizing `identity:delete_user(user_id=22d9f657cccd4532ae1bf681993a86f1)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:41:27.382157 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65199610-199c-4113-95f5-3d2ca7916865 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:41:27.427560 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-65199610-199c-4113-95f5-3d2ca7916865 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '22d9f657cccd4532ae1bf681993a86f1'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:41:27.439422 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-65199610-199c-4113-95f5-3d2ca7916865 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '22d9f657cccd4532ae1bf681993a86f1'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:41:27.439912 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-65199610-199c-4113-95f5-3d2ca7916865 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '22d9f657cccd4532ae1bf681993a86f1'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:41:27.446520 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-65199610-199c-4113-95f5-3d2ca7916865 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '22d9f657cccd4532ae1bf681993a86f1'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:41:27.447156 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-65199610-199c-4113-95f5-3d2ca7916865 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '22d9f657cccd4532ae1bf681993a86f1'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:41:27.460067 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1179/2395] 10.222.0.23 () {58 vars in 1223 bytes} [Tue May 10 05:41:27 2022] DELETE /identity/v3/users/22d9f657cccd4532ae1bf681993a86f1 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 05:41:27.750385 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba7433f-27a6-4243-b1ed-6ef36fcbc9e2 admin admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:41:27.752402 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-0ba7433f-27a6-4243-b1ed-6ef36fcbc9e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:41:27.766094 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba7433f-27a6-4243-b1ed-6ef36fcbc9e2 admin admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:41:27.837148 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47bcb44-66ea-47bb-b505-fa1dab1a6ab2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:41:27.838013 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47bcb44-66ea-47bb-b505-fa1dab1a6ab2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:41:27.838293 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47bcb44-66ea-47bb-b505-fa1dab1a6ab2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:41:27.838563 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47bcb44-66ea-47bb-b505-fa1dab1a6ab2 admin admin] PATH_INFO: `/v3/projects/2df50fdcbc4d43f08a28d2a7f77c8a01` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:41:27.839764 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47bcb44-66ea-47bb-b505-fa1dab1a6ab2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2df50fdcbc4d43f08a28d2a7f77c8a01)` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:41:27.841720 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47bcb44-66ea-47bb-b505-fa1dab1a6ab2 admin admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:41:27.889577 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-c47bcb44-66ea-47bb-b505-fa1dab1a6ab2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2df50fdcbc4d43f08a28d2a7f77c8a01', 'request_id': 'req-c47bcb44-66ea-47bb-b505-fa1dab1a6ab2'} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:41:27.895804 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-c47bcb44-66ea-47bb-b505-fa1dab1a6ab2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2df50fdcbc4d43f08a28d2a7f77c8a01', 'request_id': 'req-c47bcb44-66ea-47bb-b505-fa1dab1a6ab2'} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:41:27.904036 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-c47bcb44-66ea-47bb-b505-fa1dab1a6ab2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2df50fdcbc4d43f08a28d2a7f77c8a01', 'request_id': 'req-c47bcb44-66ea-47bb-b505-fa1dab1a6ab2'} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:41:27.914659 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-c47bcb44-66ea-47bb-b505-fa1dab1a6ab2 admin admin] The token cache is being invalidate because project 2df50fdcbc4d43f08a28d2a7f77c8a01 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79879) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 05:41:27.914948 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-c47bcb44-66ea-47bb-b505-fa1dab1a6ab2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:41:27.915652 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-c47bcb44-66ea-47bb-b505-fa1dab1a6ab2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:41:27.917229 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1217/2396] 10.222.0.23 () {58 vars in 1232 bytes} [Tue May 10 05:41:27 2022] DELETE /identity/v3/projects/2df50fdcbc4d43f08a28d2a7f77c8a01 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 05:41:27.922369 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3306aeff-8202-4800-a6ab-009619a89540 None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:41:27.922657 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3306aeff-8202-4800-a6ab-009619a89540 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:41:27.922933 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3306aeff-8202-4800-a6ab-009619a89540 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:41:27.940987 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-3306aeff-8202-4800-a6ab-009619a89540 None None] MFA Rules not processed for user `44883b22532e44049d846938dc2cf423`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:41:27.942168 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-3306aeff-8202-4800-a6ab-009619a89540 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:41:28.000255 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1180/2397] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 10 05:41:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 05:41:28.008507 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e90f2f5-d851-4fad-ad09-6088b4802aed None None] REQUEST_METHOD: `POST` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:41:28.008802 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e90f2f5-d851-4fad-ad09-6088b4802aed None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:41:28.009081 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e90f2f5-d851-4fad-ad09-6088b4802aed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:41:28.034665 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.auth.core [None req-4e90f2f5-d851-4fad-ad09-6088b4802aed None None] MFA Rules not processed for user `44883b22532e44049d846938dc2cf423`. Rule list: `[]` (Enabled: `True`). {{(pid=79879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:41:28.036017 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-4e90f2f5-d851-4fad-ad09-6088b4802aed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:41:28.047938 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1218/2398] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 10 05:41:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 05:41:28.052355 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3306aeff-8202-4800-a6ab-009619a89540 None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:41:28.065702 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3306aeff-8202-4800-a6ab-009619a89540 None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:41:28.071041 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62f62d9-cc8b-43a3-a2e8-03347a67905f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:41:28.071775 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62f62d9-cc8b-43a3-a2e8-03347a67905f admin admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:41:28.072059 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62f62d9-cc8b-43a3-a2e8-03347a67905f admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:41:28.072343 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62f62d9-cc8b-43a3-a2e8-03347a67905f admin admin] PATH_INFO: `/v3/domains` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:41:28.073092 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62f62d9-cc8b-43a3-a2e8-03347a67905f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:41:28.073402 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62f62d9-cc8b-43a3-a2e8-03347a67905f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:41:28.075044 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62f62d9-cc8b-43a3-a2e8-03347a67905f admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:41:28.091536 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1181/2399] 10.222.0.23 () {58 vars in 1152 bytes} [Tue May 10 05:41:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 05:41:28.092749 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e90f2f5-d851-4fad-ad09-6088b4802aed None None] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:41:28.103474 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e90f2f5-d851-4fad-ad09-6088b4802aed None None] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:41:28.108837 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1187d44d-535f-4a5e-be87-79f7fc4bdcab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:41:28.109502 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1187d44d-535f-4a5e-be87-79f7fc4bdcab admin admin] REQUEST_METHOD: `POST` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:41:28.109781 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1187d44d-535f-4a5e-be87-79f7fc4bdcab admin admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:41:28.110055 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1187d44d-535f-4a5e-be87-79f7fc4bdcab admin admin] PATH_INFO: `/v3/projects` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:41:28.110762 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1187d44d-535f-4a5e-be87-79f7fc4bdcab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:41:28.112724 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1187d44d-535f-4a5e-be87-79f7fc4bdcab admin admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:41:28.143336 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1219/2400] 10.222.0.23 () {60 vars in 1152 bytes} [Tue May 10 05:41:28 2022] POST /identity/v3/projects => generated 377 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 05:41:28.147137 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62f62d9-cc8b-43a3-a2e8-03347a67905f admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:41:28.157589 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62f62d9-cc8b-43a3-a2e8-03347a67905f admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:41:28.218543 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad41930b-24a4-4ae6-8b09-290779177ba7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:41:28.219336 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad41930b-24a4-4ae6-8b09-290779177ba7 admin admin] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:41:28.219686 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad41930b-24a4-4ae6-8b09-290779177ba7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:41:28.220000 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad41930b-24a4-4ae6-8b09-290779177ba7 admin admin] PATH_INFO: `/v3/users` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:41:28.220731 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad41930b-24a4-4ae6-8b09-290779177ba7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:41:28.222631 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad41930b-24a4-4ae6-8b09-290779177ba7 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:41:28.243948 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1182/2401] 10.222.0.23 () {60 vars in 1143 bytes} [Tue May 10 05:41:28 2022] POST /identity/v3/users => generated 289 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 05:41:28.248204 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1187d44d-535f-4a5e-be87-79f7fc4bdcab admin admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:41:28.258771 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1187d44d-535f-4a5e-be87-79f7fc4bdcab admin admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:41:28.264207 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c206c2f4-e524-4043-a36a-52b7352a3354 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:41:28.264873 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c206c2f4-e524-4043-a36a-52b7352a3354 admin admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:41:28.265155 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c206c2f4-e524-4043-a36a-52b7352a3354 admin admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:41:28.265433 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c206c2f4-e524-4043-a36a-52b7352a3354 admin admin] PATH_INFO: `/v3/roles` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:41:28.266180 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c206c2f4-e524-4043-a36a-52b7352a3354 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:41:28.267859 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c206c2f4-e524-4043-a36a-52b7352a3354 admin admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:41:28.278672 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1220/2402] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 10 05:41:28 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 05:41:28.282870 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad41930b-24a4-4ae6-8b09-290779177ba7 admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:41:28.292830 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad41930b-24a4-4ae6-8b09-290779177ba7 admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:41:28.297896 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3a4c9f-543b-4bf1-962d-b8acce57969f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:41:28.298575 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3a4c9f-543b-4bf1-962d-b8acce57969f admin admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:41:28.298847 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3a4c9f-543b-4bf1-962d-b8acce57969f admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:41:28.299124 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3a4c9f-543b-4bf1-962d-b8acce57969f admin admin] PATH_INFO: `/v3/roles` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:41:28.299900 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3a4c9f-543b-4bf1-962d-b8acce57969f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:41:28.301619 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3a4c9f-543b-4bf1-962d-b8acce57969f admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:41:28.312185 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1183/2403] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 10 05:41:28 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 05:41:28.316242 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c206c2f4-e524-4043-a36a-52b7352a3354 admin admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:41:28.326220 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c206c2f4-e524-4043-a36a-52b7352a3354 admin admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:41:28.330776 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2066128c-2fa2-4c54-924b-2e4719150e42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:41:28.332205 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2066128c-2fa2-4c54-924b-2e4719150e42 admin admin] REQUEST_METHOD: `PUT` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:41:28.332205 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2066128c-2fa2-4c54-924b-2e4719150e42 admin admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:41:28.332205 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2066128c-2fa2-4c54-924b-2e4719150e42 admin admin] PATH_INFO: `/v3/projects/df7da4e5d5e64c5eaf63261b8b1b9397/users/56d068ded9224d26a4a6fcddfffb9529/roles/382636e67fc142a2b2f486340d959e11` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:41:28.346639 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2066128c-2fa2-4c54-924b-2e4719150e42 admin admin] RBAC: Authorizing `identity:create_grant(project_id=df7da4e5d5e64c5eaf63261b8b1b9397, user_id=56d068ded9224d26a4a6fcddfffb9529, role_id=382636e67fc142a2b2f486340d959e11)` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:41:28.349448 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2066128c-2fa2-4c54-924b-2e4719150e42 admin admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:41:28.364351 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1221/2404] 10.222.0.23 () {60 vars in 1482 bytes} [Tue May 10 05:41:28 2022] PUT /identity/v3/projects/df7da4e5d5e64c5eaf63261b8b1b9397/users/56d068ded9224d26a4a6fcddfffb9529/roles/382636e67fc142a2b2f486340d959e11 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 05:41:28.376429 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609666bb-86f5-4f4d-8ff0-fcd114380081 None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:41:28.376719 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609666bb-86f5-4f4d-8ff0-fcd114380081 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:41:28.376994 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609666bb-86f5-4f4d-8ff0-fcd114380081 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:41:28.404362 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-609666bb-86f5-4f4d-8ff0-fcd114380081 None None] MFA Rules not processed for user `56d068ded9224d26a4a6fcddfffb9529`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:41:28.405585 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-609666bb-86f5-4f4d-8ff0-fcd114380081 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:41:28.494361 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1184/2405] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 10 05:41:28 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 05:41:28.512354 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2066128c-2fa2-4c54-924b-2e4719150e42 admin admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:41:28.514626 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-2066128c-2fa2-4c54-924b-2e4719150e42 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:41:28.571275 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2066128c-2fa2-4c54-924b-2e4719150e42 admin admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:41:28.574907 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531bde68-8123-4c0b-9a1d-510d3042e4a4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355be413675540a39ccb00e1a0722316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f23435f783540199d6dcfd0417c090e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:41:28.575548 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531bde68-8123-4c0b-9a1d-510d3042e4a4 service cinder] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:41:28.576004 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531bde68-8123-4c0b-9a1d-510d3042e4a4 service cinder] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:41:28.576278 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531bde68-8123-4c0b-9a1d-510d3042e4a4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:41:28.584610 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531bde68-8123-4c0b-9a1d-510d3042e4a4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:41:28.586070 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531bde68-8123-4c0b-9a1d-510d3042e4a4 service cinder] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:41:28.594721 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1222/2406] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 10 05:41:28 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 05:41:40.490056 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928e47f8-3122-4a6b-9aea-1ccaff4d2e9e None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:41:40.490626 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928e47f8-3122-4a6b-9aea-1ccaff4d2e9e None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:41:40.490626 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928e47f8-3122-4a6b-9aea-1ccaff4d2e9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:41:40.508688 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-928e47f8-3122-4a6b-9aea-1ccaff4d2e9e None None] MFA Rules not processed for user `c5281b2a1c9a461995653be826207db4`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:41:40.509886 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-928e47f8-3122-4a6b-9aea-1ccaff4d2e9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:41:40.565515 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1185/2407] 10.222.0.23 () {58 vars in 967 bytes} [Tue May 10 05:41:40 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 05:41:40.577845 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531bde68-8123-4c0b-9a1d-510d3042e4a4 service cinder] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:41:40.579283 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-531bde68-8123-4c0b-9a1d-510d3042e4a4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:41:40.647942 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531bde68-8123-4c0b-9a1d-510d3042e4a4 service cinder] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:41:40.653206 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5036cff0-bf37-4cd3-842b-b34f75626b85 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd31dacf30804395bd029037b407c12a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f23435f783540199d6dcfd0417c090e', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:41:40.653887 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5036cff0-bf37-4cd3-842b-b34f75626b85 service swift] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:41:40.654165 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5036cff0-bf37-4cd3-842b-b34f75626b85 service swift] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:41:40.654406 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5036cff0-bf37-4cd3-842b-b34f75626b85 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:41:40.662648 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5036cff0-bf37-4cd3-842b-b34f75626b85 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:41:40.664282 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5036cff0-bf37-4cd3-842b-b34f75626b85 service swift] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:41:40.672684 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1223/2408] 10.222.0.23 () {60 vars in 1384 bytes} [Tue May 10 05:41:40 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 10 05:41:40.740801 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928e47f8-3122-4a6b-9aea-1ccaff4d2e9e None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:41:40.742208 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-928e47f8-3122-4a6b-9aea-1ccaff4d2e9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:41:40.830157 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928e47f8-3122-4a6b-9aea-1ccaff4d2e9e None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:41:40.836975 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba133656-c7e7-4f82-81b9-6023a9ecef8b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f50f224ca944983aecfde86375473da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f23435f783540199d6dcfd0417c090e', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:41:40.837537 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba133656-c7e7-4f82-81b9-6023a9ecef8b service nova] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:41:40.837826 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba133656-c7e7-4f82-81b9-6023a9ecef8b service nova] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:41:40.838121 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba133656-c7e7-4f82-81b9-6023a9ecef8b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:41:40.839989 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-ba133656-c7e7-4f82-81b9-6023a9ecef8b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:41:40.853575 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba133656-c7e7-4f82-81b9-6023a9ecef8b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:41:40.855200 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba133656-c7e7-4f82-81b9-6023a9ecef8b service nova] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:41:40.866478 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1186/2409] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 10 05:41:40 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 05:41:48.307084 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5036cff0-bf37-4cd3-842b-b34f75626b85 service swift] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:41:48.373127 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5036cff0-bf37-4cd3-842b-b34f75626b85 service swift] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:41:48.378295 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1211e45d-3819-48ad-b25c-49fc30127a04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:41:48.379155 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1211e45d-3819-48ad-b25c-49fc30127a04 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:41:48.379434 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1211e45d-3819-48ad-b25c-49fc30127a04 admin admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:41:48.379732 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1211e45d-3819-48ad-b25c-49fc30127a04 admin admin] PATH_INFO: `/v3/users/56d068ded9224d26a4a6fcddfffb9529` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:41:48.380960 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1211e45d-3819-48ad-b25c-49fc30127a04 admin admin] RBAC: Authorizing `identity:delete_user(user_id=56d068ded9224d26a4a6fcddfffb9529)` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:41:48.382888 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1211e45d-3819-48ad-b25c-49fc30127a04 admin admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:41:48.430094 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-1211e45d-3819-48ad-b25c-49fc30127a04 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '56d068ded9224d26a4a6fcddfffb9529'} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:41:48.439381 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-1211e45d-3819-48ad-b25c-49fc30127a04 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '56d068ded9224d26a4a6fcddfffb9529'} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:41:48.440269 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-1211e45d-3819-48ad-b25c-49fc30127a04 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '56d068ded9224d26a4a6fcddfffb9529'} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:41:48.453905 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-1211e45d-3819-48ad-b25c-49fc30127a04 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '56d068ded9224d26a4a6fcddfffb9529'} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:41:48.460969 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-1211e45d-3819-48ad-b25c-49fc30127a04 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '56d068ded9224d26a4a6fcddfffb9529'} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:41:48.467243 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1224/2410] 10.222.0.23 () {58 vars in 1223 bytes} [Tue May 10 05:41:48 2022] DELETE /identity/v3/users/56d068ded9224d26a4a6fcddfffb9529 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 05:41:48.473610 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5b22b8-14eb-481a-97b2-7227bd0a731f None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:41:48.473610 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5b22b8-14eb-481a-97b2-7227bd0a731f None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:41:48.473610 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5b22b8-14eb-481a-97b2-7227bd0a731f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:41:48.492203 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-0b5b22b8-14eb-481a-97b2-7227bd0a731f None None] MFA Rules not processed for user `44883b22532e44049d846938dc2cf423`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:41:48.493436 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-0b5b22b8-14eb-481a-97b2-7227bd0a731f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:41:48.553024 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1187/2411] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 10 05:41:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 05:41:48.564609 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1211e45d-3819-48ad-b25c-49fc30127a04 admin admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:41:48.566314 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-1211e45d-3819-48ad-b25c-49fc30127a04 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:41:48.624878 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1211e45d-3819-48ad-b25c-49fc30127a04 admin admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:41:48.629004 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae8d63d-c4fe-4fc6-af09-6a52c348514a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c8461cfdd9648b8abcaf8d34b7a102a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f23435f783540199d6dcfd0417c090e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:41:48.629635 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae8d63d-c4fe-4fc6-af09-6a52c348514a service neutron] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:41:48.629914 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae8d63d-c4fe-4fc6-af09-6a52c348514a service neutron] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:41:48.630186 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae8d63d-c4fe-4fc6-af09-6a52c348514a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:41:48.639205 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae8d63d-c4fe-4fc6-af09-6a52c348514a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:41:48.640673 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae8d63d-c4fe-4fc6-af09-6a52c348514a service neutron] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:41:48.650094 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1225/2412] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 10 05:41:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 05:41:48.923975 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5b22b8-14eb-481a-97b2-7227bd0a731f None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:41:48.925400 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-0b5b22b8-14eb-481a-97b2-7227bd0a731f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:41:48.937555 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5b22b8-14eb-481a-97b2-7227bd0a731f None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:41:48.942417 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3a4c08-5d82-4ca0-8e03-5bf71c280979 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:41:48.943280 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3a4c08-5d82-4ca0-8e03-5bf71c280979 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:41:48.943562 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3a4c08-5d82-4ca0-8e03-5bf71c280979 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:41:48.943867 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3a4c08-5d82-4ca0-8e03-5bf71c280979 admin admin] PATH_INFO: `/v3/projects/df7da4e5d5e64c5eaf63261b8b1b9397` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:41:48.945426 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3a4c08-5d82-4ca0-8e03-5bf71c280979 admin admin] RBAC: Authorizing `identity:delete_project(project_id=df7da4e5d5e64c5eaf63261b8b1b9397)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:41:48.947371 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3a4c08-5d82-4ca0-8e03-5bf71c280979 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:41:48.993248 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-3d3a4c08-5d82-4ca0-8e03-5bf71c280979 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'df7da4e5d5e64c5eaf63261b8b1b9397', 'request_id': 'req-3d3a4c08-5d82-4ca0-8e03-5bf71c280979'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:41:48.999609 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-3d3a4c08-5d82-4ca0-8e03-5bf71c280979 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'df7da4e5d5e64c5eaf63261b8b1b9397', 'request_id': 'req-3d3a4c08-5d82-4ca0-8e03-5bf71c280979'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:41:49.011449 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-3d3a4c08-5d82-4ca0-8e03-5bf71c280979 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'df7da4e5d5e64c5eaf63261b8b1b9397', 'request_id': 'req-3d3a4c08-5d82-4ca0-8e03-5bf71c280979'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:41:49.021895 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-3d3a4c08-5d82-4ca0-8e03-5bf71c280979 admin admin] The token cache is being invalidate because project df7da4e5d5e64c5eaf63261b8b1b9397 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79880) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 05:41:49.022175 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-3d3a4c08-5d82-4ca0-8e03-5bf71c280979 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:41:49.022873 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-3d3a4c08-5d82-4ca0-8e03-5bf71c280979 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:41:49.024571 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1188/2413] 10.222.0.23 () {58 vars in 1232 bytes} [Tue May 10 05:41:48 2022] DELETE /identity/v3/projects/df7da4e5d5e64c5eaf63261b8b1b9397 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 05:41:49.030677 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc074b1-87d4-4ea1-baa2-a9dd1dd8ffcc None None] REQUEST_METHOD: `POST` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:41:49.030964 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc074b1-87d4-4ea1-baa2-a9dd1dd8ffcc None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:41:49.031240 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc074b1-87d4-4ea1-baa2-a9dd1dd8ffcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:41:49.050711 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.auth.core [None req-3cc074b1-87d4-4ea1-baa2-a9dd1dd8ffcc None None] MFA Rules not processed for user `44883b22532e44049d846938dc2cf423`. Rule list: `[]` (Enabled: `True`). {{(pid=79879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:41:49.051959 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-3cc074b1-87d4-4ea1-baa2-a9dd1dd8ffcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:41:49.114865 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1226/2414] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 10 05:41:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 05:41:49.125715 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4fcee6-59cc-4530-a683-63abbb50ec88 None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:41:49.126304 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4fcee6-59cc-4530-a683-63abbb50ec88 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:41:49.126578 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4fcee6-59cc-4530-a683-63abbb50ec88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:41:49.146216 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-5f4fcee6-59cc-4530-a683-63abbb50ec88 None None] MFA Rules not processed for user `44883b22532e44049d846938dc2cf423`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:41:49.147411 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-5f4fcee6-59cc-4530-a683-63abbb50ec88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:41:49.156612 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1189/2415] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 10 05:41:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 05:41:49.160910 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc074b1-87d4-4ea1-baa2-a9dd1dd8ffcc None None] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:41:49.170944 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc074b1-87d4-4ea1-baa2-a9dd1dd8ffcc None None] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:41:49.176871 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3354c3-af5f-4643-9a52-eed7e885ee32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:41:49.177521 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3354c3-af5f-4643-9a52-eed7e885ee32 admin admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:41:49.177820 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3354c3-af5f-4643-9a52-eed7e885ee32 admin admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:41:49.178077 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3354c3-af5f-4643-9a52-eed7e885ee32 admin admin] PATH_INFO: `/v3/domains` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:41:49.178805 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3354c3-af5f-4643-9a52-eed7e885ee32 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:41:49.179113 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3354c3-af5f-4643-9a52-eed7e885ee32 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:41:49.180766 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3354c3-af5f-4643-9a52-eed7e885ee32 admin admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:41:49.192947 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1227/2416] 10.222.0.23 () {58 vars in 1152 bytes} [Tue May 10 05:41:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:41:49.197187 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4fcee6-59cc-4530-a683-63abbb50ec88 None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:41:49.206340 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4fcee6-59cc-4530-a683-63abbb50ec88 None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:41:49.211808 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6651525-41c2-46fd-9d49-e24a36afbf1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:41:49.212444 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6651525-41c2-46fd-9d49-e24a36afbf1d admin admin] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:41:49.212727 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6651525-41c2-46fd-9d49-e24a36afbf1d admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:41:49.213001 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6651525-41c2-46fd-9d49-e24a36afbf1d admin admin] PATH_INFO: `/v3/projects` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:41:49.213688 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6651525-41c2-46fd-9d49-e24a36afbf1d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:41:49.215597 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6651525-41c2-46fd-9d49-e24a36afbf1d admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:41:49.253564 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1190/2417] 10.222.0.23 () {60 vars in 1152 bytes} [Tue May 10 05:41:49 2022] POST /identity/v3/projects => generated 373 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 05:41:49.257760 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3354c3-af5f-4643-9a52-eed7e885ee32 admin admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:41:49.267813 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3354c3-af5f-4643-9a52-eed7e885ee32 admin admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:41:49.324515 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e154063-778e-446a-a81e-367dc10bb6e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:41:49.325134 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e154063-778e-446a-a81e-367dc10bb6e4 admin admin] REQUEST_METHOD: `POST` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:41:49.325448 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e154063-778e-446a-a81e-367dc10bb6e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:41:49.325777 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e154063-778e-446a-a81e-367dc10bb6e4 admin admin] PATH_INFO: `/v3/users` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:41:49.326458 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e154063-778e-446a-a81e-367dc10bb6e4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:41:49.328424 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e154063-778e-446a-a81e-367dc10bb6e4 admin admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:41:49.349953 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1228/2418] 10.222.0.23 () {60 vars in 1143 bytes} [Tue May 10 05:41:49 2022] POST /identity/v3/users => generated 287 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 05:41:49.354167 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6651525-41c2-46fd-9d49-e24a36afbf1d admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:41:49.364453 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6651525-41c2-46fd-9d49-e24a36afbf1d admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:41:49.369101 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d74df5e-4412-46c8-8770-1da304152df5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:41:49.369748 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d74df5e-4412-46c8-8770-1da304152df5 admin admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:41:49.370028 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d74df5e-4412-46c8-8770-1da304152df5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:41:49.370301 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d74df5e-4412-46c8-8770-1da304152df5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:41:49.371025 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d74df5e-4412-46c8-8770-1da304152df5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:41:49.372668 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d74df5e-4412-46c8-8770-1da304152df5 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:41:49.383171 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1191/2419] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 10 05:41:49 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 05:41:49.387408 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e154063-778e-446a-a81e-367dc10bb6e4 admin admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:41:49.398604 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e154063-778e-446a-a81e-367dc10bb6e4 admin admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:41:49.404949 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67446a98-7c94-4917-905f-1f7025fba80a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:41:49.405609 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67446a98-7c94-4917-905f-1f7025fba80a admin admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:41:49.405890 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67446a98-7c94-4917-905f-1f7025fba80a admin admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:41:49.406160 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67446a98-7c94-4917-905f-1f7025fba80a admin admin] PATH_INFO: `/v3/roles` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:41:49.406920 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67446a98-7c94-4917-905f-1f7025fba80a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:41:49.408590 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67446a98-7c94-4917-905f-1f7025fba80a admin admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:41:49.419771 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1229/2420] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 10 05:41:49 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 05:41:49.423996 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d74df5e-4412-46c8-8770-1da304152df5 admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:41:49.433898 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d74df5e-4412-46c8-8770-1da304152df5 admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:41:49.438890 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62aea1ba-1a38-4456-bdd4-2b2dbab0c55f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:41:49.439851 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62aea1ba-1a38-4456-bdd4-2b2dbab0c55f admin admin] REQUEST_METHOD: `PUT` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:41:49.440135 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62aea1ba-1a38-4456-bdd4-2b2dbab0c55f admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:41:49.440388 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62aea1ba-1a38-4456-bdd4-2b2dbab0c55f admin admin] PATH_INFO: `/v3/projects/f30671a1cf9d44f9836dc7dbeadb550d/users/c8bf96cf78524df884d525542e5c8226/roles/382636e67fc142a2b2f486340d959e11` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:41:49.455385 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62aea1ba-1a38-4456-bdd4-2b2dbab0c55f admin admin] RBAC: Authorizing `identity:create_grant(project_id=f30671a1cf9d44f9836dc7dbeadb550d, user_id=c8bf96cf78524df884d525542e5c8226, role_id=382636e67fc142a2b2f486340d959e11)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:41:49.458093 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62aea1ba-1a38-4456-bdd4-2b2dbab0c55f admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:41:49.473515 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1192/2421] 10.222.0.23 () {60 vars in 1482 bytes} [Tue May 10 05:41:49 2022] PUT /identity/v3/projects/f30671a1cf9d44f9836dc7dbeadb550d/users/c8bf96cf78524df884d525542e5c8226/roles/382636e67fc142a2b2f486340d959e11 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 05:41:49.485395 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4b7cab-36a4-4fdc-8a4d-3f4693aa3781 None None] REQUEST_METHOD: `POST` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:41:49.485774 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4b7cab-36a4-4fdc-8a4d-3f4693aa3781 None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:41:49.486054 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4b7cab-36a4-4fdc-8a4d-3f4693aa3781 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:41:49.517148 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.auth.core [None req-ff4b7cab-36a4-4fdc-8a4d-3f4693aa3781 None None] MFA Rules not processed for user `c8bf96cf78524df884d525542e5c8226`. Rule list: `[]` (Enabled: `True`). {{(pid=79879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:41:49.519085 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-ff4b7cab-36a4-4fdc-8a4d-3f4693aa3781 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:41:49.585624 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1230/2422] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 10 05:41:49 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 05:41:49.596989 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62aea1ba-1a38-4456-bdd4-2b2dbab0c55f admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:41:49.598836 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-62aea1ba-1a38-4456-bdd4-2b2dbab0c55f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:41:49.661445 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62aea1ba-1a38-4456-bdd4-2b2dbab0c55f admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:41:49.665932 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b572461c-8bcc-4731-ab49-558d36fa5873 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355be413675540a39ccb00e1a0722316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f23435f783540199d6dcfd0417c090e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:41:49.666584 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b572461c-8bcc-4731-ab49-558d36fa5873 service cinder] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:41:49.666865 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b572461c-8bcc-4731-ab49-558d36fa5873 service cinder] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:41:49.667137 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b572461c-8bcc-4731-ab49-558d36fa5873 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:41:49.676012 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b572461c-8bcc-4731-ab49-558d36fa5873 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:41:49.677464 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b572461c-8bcc-4731-ab49-558d36fa5873 service cinder] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:41:49.686250 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1193/2423] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 10 05:41:49 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 05:41:59.848255 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4b7cab-36a4-4fdc-8a4d-3f4693aa3781 None None] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:41:59.912602 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4b7cab-36a4-4fdc-8a4d-3f4693aa3781 None None] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:41:59.917222 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56903b0-bae4-4d80-9339-e3446bedd9f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:41:59.918105 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56903b0-bae4-4d80-9339-e3446bedd9f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:41:59.918385 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56903b0-bae4-4d80-9339-e3446bedd9f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:41:59.918651 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56903b0-bae4-4d80-9339-e3446bedd9f1 admin admin] PATH_INFO: `/v3/users/c8bf96cf78524df884d525542e5c8226` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:41:59.919995 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56903b0-bae4-4d80-9339-e3446bedd9f1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c8bf96cf78524df884d525542e5c8226)` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:41:59.921938 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56903b0-bae4-4d80-9339-e3446bedd9f1 admin admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:41:59.969565 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-f56903b0-bae4-4d80-9339-e3446bedd9f1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c8bf96cf78524df884d525542e5c8226'} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:41:59.980070 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-f56903b0-bae4-4d80-9339-e3446bedd9f1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c8bf96cf78524df884d525542e5c8226'} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:41:59.980693 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-f56903b0-bae4-4d80-9339-e3446bedd9f1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c8bf96cf78524df884d525542e5c8226'} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:41:59.992320 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-f56903b0-bae4-4d80-9339-e3446bedd9f1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c8bf96cf78524df884d525542e5c8226'} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:42:00.000019 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-f56903b0-bae4-4d80-9339-e3446bedd9f1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c8bf96cf78524df884d525542e5c8226'} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:42:00.006205 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1231/2424] 10.222.0.23 () {58 vars in 1223 bytes} [Tue May 10 05:41:59 2022] DELETE /identity/v3/users/c8bf96cf78524df884d525542e5c8226 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 05:42:00.010777 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0371d93c-0bef-460f-bf02-bbc209c6ce77 None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:42:00.011277 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0371d93c-0bef-460f-bf02-bbc209c6ce77 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:42:00.011375 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0371d93c-0bef-460f-bf02-bbc209c6ce77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:42:00.028673 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-0371d93c-0bef-460f-bf02-bbc209c6ce77 None None] MFA Rules not processed for user `44883b22532e44049d846938dc2cf423`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:42:00.029968 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-0371d93c-0bef-460f-bf02-bbc209c6ce77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:42:00.101309 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1194/2425] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 10 05:42:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 05:42:00.112965 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56903b0-bae4-4d80-9339-e3446bedd9f1 admin admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:42:00.115282 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-f56903b0-bae4-4d80-9339-e3446bedd9f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:42:00.177871 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56903b0-bae4-4d80-9339-e3446bedd9f1 admin admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:42:00.182399 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50be7c0d-fe37-4924-a192-03c978608ea1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c8461cfdd9648b8abcaf8d34b7a102a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f23435f783540199d6dcfd0417c090e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:42:00.183081 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50be7c0d-fe37-4924-a192-03c978608ea1 service neutron] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:42:00.183364 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50be7c0d-fe37-4924-a192-03c978608ea1 service neutron] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:42:00.183673 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50be7c0d-fe37-4924-a192-03c978608ea1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:42:00.198125 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50be7c0d-fe37-4924-a192-03c978608ea1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:42:00.200277 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50be7c0d-fe37-4924-a192-03c978608ea1 service neutron] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:42:00.215118 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1232/2426] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 10 05:42:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 05:42:00.499881 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0371d93c-0bef-460f-bf02-bbc209c6ce77 None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:42:00.501654 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-0371d93c-0bef-460f-bf02-bbc209c6ce77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:42:00.514633 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0371d93c-0bef-460f-bf02-bbc209c6ce77 None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:42:00.521605 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68f460e-faee-4221-8cd1-709eb8435e32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:42:00.523132 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68f460e-faee-4221-8cd1-709eb8435e32 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:42:00.523417 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68f460e-faee-4221-8cd1-709eb8435e32 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:42:00.525485 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68f460e-faee-4221-8cd1-709eb8435e32 admin admin] PATH_INFO: `/v3/projects/f30671a1cf9d44f9836dc7dbeadb550d` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:42:00.526714 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68f460e-faee-4221-8cd1-709eb8435e32 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f30671a1cf9d44f9836dc7dbeadb550d)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:42:00.529690 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68f460e-faee-4221-8cd1-709eb8435e32 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:42:00.580151 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-b68f460e-faee-4221-8cd1-709eb8435e32 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f30671a1cf9d44f9836dc7dbeadb550d', 'request_id': 'req-b68f460e-faee-4221-8cd1-709eb8435e32'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:42:00.586721 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-b68f460e-faee-4221-8cd1-709eb8435e32 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f30671a1cf9d44f9836dc7dbeadb550d', 'request_id': 'req-b68f460e-faee-4221-8cd1-709eb8435e32'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:42:00.598217 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-b68f460e-faee-4221-8cd1-709eb8435e32 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f30671a1cf9d44f9836dc7dbeadb550d', 'request_id': 'req-b68f460e-faee-4221-8cd1-709eb8435e32'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:42:00.608762 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-b68f460e-faee-4221-8cd1-709eb8435e32 admin admin] The token cache is being invalidate because project f30671a1cf9d44f9836dc7dbeadb550d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79880) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 05:42:00.609045 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-b68f460e-faee-4221-8cd1-709eb8435e32 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:42:00.609716 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-b68f460e-faee-4221-8cd1-709eb8435e32 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:42:00.611343 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1195/2427] 10.222.0.23 () {58 vars in 1232 bytes} [Tue May 10 05:42:00 2022] DELETE /identity/v3/projects/f30671a1cf9d44f9836dc7dbeadb550d => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 05:42:00.616241 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e609bb-9770-4923-9af0-a90e254c4514 None None] REQUEST_METHOD: `POST` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:42:00.616559 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e609bb-9770-4923-9af0-a90e254c4514 None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:42:00.616834 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e609bb-9770-4923-9af0-a90e254c4514 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:42:00.635364 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.auth.core [None req-d1e609bb-9770-4923-9af0-a90e254c4514 None None] MFA Rules not processed for user `44883b22532e44049d846938dc2cf423`. Rule list: `[]` (Enabled: `True`). {{(pid=79879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:42:00.636621 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-d1e609bb-9770-4923-9af0-a90e254c4514 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:42:00.695830 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1233/2428] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 10 05:42:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 05:42:00.703861 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c629a9a-a247-4fe8-81fd-9298f7b6fe7f None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:42:00.704148 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c629a9a-a247-4fe8-81fd-9298f7b6fe7f None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:42:00.704425 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c629a9a-a247-4fe8-81fd-9298f7b6fe7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:42:00.723299 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-8c629a9a-a247-4fe8-81fd-9298f7b6fe7f None None] MFA Rules not processed for user `44883b22532e44049d846938dc2cf423`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:42:00.724531 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-8c629a9a-a247-4fe8-81fd-9298f7b6fe7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:42:00.732880 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1196/2429] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 10 05:42:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 05:42:00.737347 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e609bb-9770-4923-9af0-a90e254c4514 None None] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:42:00.747168 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e609bb-9770-4923-9af0-a90e254c4514 None None] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:42:00.752141 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db426f7-b81e-4702-aa70-9f21824c257c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:42:00.752800 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db426f7-b81e-4702-aa70-9f21824c257c admin admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:42:00.753078 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db426f7-b81e-4702-aa70-9f21824c257c admin admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:42:00.753345 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db426f7-b81e-4702-aa70-9f21824c257c admin admin] PATH_INFO: `/v3/domains` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:42:00.754066 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db426f7-b81e-4702-aa70-9f21824c257c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:42:00.754355 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db426f7-b81e-4702-aa70-9f21824c257c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:42:00.755988 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db426f7-b81e-4702-aa70-9f21824c257c admin admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:42:00.767366 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1234/2430] 10.222.0.23 () {58 vars in 1152 bytes} [Tue May 10 05:42:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:42:00.771851 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c629a9a-a247-4fe8-81fd-9298f7b6fe7f None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:42:00.780966 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c629a9a-a247-4fe8-81fd-9298f7b6fe7f None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:42:00.785647 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50343153-9b53-43ef-890a-c3a817417d96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:42:00.786294 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50343153-9b53-43ef-890a-c3a817417d96 admin admin] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:42:00.786586 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50343153-9b53-43ef-890a-c3a817417d96 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:42:00.786845 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50343153-9b53-43ef-890a-c3a817417d96 admin admin] PATH_INFO: `/v3/projects` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:42:00.787596 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50343153-9b53-43ef-890a-c3a817417d96 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:42:00.789478 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50343153-9b53-43ef-890a-c3a817417d96 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:42:00.819132 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1197/2431] 10.222.0.23 () {60 vars in 1152 bytes} [Tue May 10 05:42:00 2022] POST /identity/v3/projects => generated 381 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 05:42:00.823541 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db426f7-b81e-4702-aa70-9f21824c257c admin admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:42:00.834123 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db426f7-b81e-4702-aa70-9f21824c257c admin admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:42:00.891112 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971447ea-fe8e-4c09-94f2-5cbe3e3db107 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:42:00.892405 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971447ea-fe8e-4c09-94f2-5cbe3e3db107 admin admin] REQUEST_METHOD: `POST` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:42:00.892850 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971447ea-fe8e-4c09-94f2-5cbe3e3db107 admin admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:42:00.893071 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971447ea-fe8e-4c09-94f2-5cbe3e3db107 admin admin] PATH_INFO: `/v3/users` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:42:00.894062 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971447ea-fe8e-4c09-94f2-5cbe3e3db107 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:42:00.896019 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971447ea-fe8e-4c09-94f2-5cbe3e3db107 admin admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:42:00.915931 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1235/2432] 10.222.0.23 () {60 vars in 1143 bytes} [Tue May 10 05:42:00 2022] POST /identity/v3/users => generated 291 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 05:42:00.920273 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50343153-9b53-43ef-890a-c3a817417d96 admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:42:00.930523 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50343153-9b53-43ef-890a-c3a817417d96 admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:42:00.935603 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d67c75b-3a60-407c-836b-1c46aa518a26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:42:00.936280 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d67c75b-3a60-407c-836b-1c46aa518a26 admin admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:42:00.936565 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d67c75b-3a60-407c-836b-1c46aa518a26 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:42:00.936844 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d67c75b-3a60-407c-836b-1c46aa518a26 admin admin] PATH_INFO: `/v3/roles` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:42:00.937580 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d67c75b-3a60-407c-836b-1c46aa518a26 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:42:00.939310 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d67c75b-3a60-407c-836b-1c46aa518a26 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:42:00.950134 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1198/2433] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 10 05:42:00 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 05:42:00.954315 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971447ea-fe8e-4c09-94f2-5cbe3e3db107 admin admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:42:00.965992 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971447ea-fe8e-4c09-94f2-5cbe3e3db107 admin admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:42:00.971073 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a6252a-29d1-46e8-b9c5-2d2bdeea4fa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:42:00.971797 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a6252a-29d1-46e8-b9c5-2d2bdeea4fa5 admin admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:42:00.972083 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a6252a-29d1-46e8-b9c5-2d2bdeea4fa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:42:00.972387 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a6252a-29d1-46e8-b9c5-2d2bdeea4fa5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:42:00.973126 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a6252a-29d1-46e8-b9c5-2d2bdeea4fa5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:42:00.974737 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a6252a-29d1-46e8-b9c5-2d2bdeea4fa5 admin admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:42:00.987750 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1236/2434] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 10 05:42:00 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 05:42:00.991862 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d67c75b-3a60-407c-836b-1c46aa518a26 admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:42:01.002831 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d67c75b-3a60-407c-836b-1c46aa518a26 admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:42:01.010421 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adc401c-eebe-4aba-a3e7-f195f6a195cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:42:01.011324 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adc401c-eebe-4aba-a3e7-f195f6a195cf admin admin] REQUEST_METHOD: `PUT` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:42:01.011952 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adc401c-eebe-4aba-a3e7-f195f6a195cf admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:42:01.011952 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adc401c-eebe-4aba-a3e7-f195f6a195cf admin admin] PATH_INFO: `/v3/projects/93824ac1a89b4d37b29b6dcd0065dac1/users/40fc391e5388450bb37f541da17e95e0/roles/382636e67fc142a2b2f486340d959e11` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:42:01.029861 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8adc401c-eebe-4aba-a3e7-f195f6a195cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=93824ac1a89b4d37b29b6dcd0065dac1, user_id=40fc391e5388450bb37f541da17e95e0, role_id=382636e67fc142a2b2f486340d959e11)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:42:01.033282 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8adc401c-eebe-4aba-a3e7-f195f6a195cf admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:42:01.052470 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1199/2435] 10.222.0.23 () {60 vars in 1482 bytes} [Tue May 10 05:42:00 2022] PUT /identity/v3/projects/93824ac1a89b4d37b29b6dcd0065dac1/users/40fc391e5388450bb37f541da17e95e0/roles/382636e67fc142a2b2f486340d959e11 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 05:42:01.054232 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44bbdbd-9dbf-40b5-a685-f344d8b2e8f1 None None] REQUEST_METHOD: `POST` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:42:01.054524 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44bbdbd-9dbf-40b5-a685-f344d8b2e8f1 None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:42:01.054804 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44bbdbd-9dbf-40b5-a685-f344d8b2e8f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:42:01.073822 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.auth.core [None req-d44bbdbd-9dbf-40b5-a685-f344d8b2e8f1 None None] MFA Rules not processed for user `44883b22532e44049d846938dc2cf423`. Rule list: `[]` (Enabled: `True`). {{(pid=79879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:42:01.075255 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-d44bbdbd-9dbf-40b5-a685-f344d8b2e8f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:42:01.143528 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1237/2436] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 10 05:42:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 05:42:01.153245 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adc401c-eebe-4aba-a3e7-f195f6a195cf admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:42:01.155045 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-8adc401c-eebe-4aba-a3e7-f195f6a195cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:42:01.227150 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adc401c-eebe-4aba-a3e7-f195f6a195cf admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:42:01.232662 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45018f3-c47b-46ac-89b8-ff665ec6bfa8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c8461cfdd9648b8abcaf8d34b7a102a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f23435f783540199d6dcfd0417c090e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:42:01.233318 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45018f3-c47b-46ac-89b8-ff665ec6bfa8 service neutron] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:42:01.233595 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45018f3-c47b-46ac-89b8-ff665ec6bfa8 service neutron] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:42:01.233868 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45018f3-c47b-46ac-89b8-ff665ec6bfa8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:42:01.243401 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45018f3-c47b-46ac-89b8-ff665ec6bfa8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:42:01.244884 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45018f3-c47b-46ac-89b8-ff665ec6bfa8 service neutron] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:42:01.254867 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1200/2437] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 10 05:42:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 05:42:01.934695 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb009ef-caa8-47b1-8bfa-b6f02ecfeaec None None] REQUEST_METHOD: `POST` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:42:01.935266 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb009ef-caa8-47b1-8bfa-b6f02ecfeaec None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:42:01.935266 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb009ef-caa8-47b1-8bfa-b6f02ecfeaec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:42:01.966824 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.auth.core [None req-afb009ef-caa8-47b1-8bfa-b6f02ecfeaec None None] MFA Rules not processed for user `40fc391e5388450bb37f541da17e95e0`. Rule list: `[]` (Enabled: `True`). {{(pid=79879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:42:01.968335 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-afb009ef-caa8-47b1-8bfa-b6f02ecfeaec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:42:02.045871 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1238/2438] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 10 05:42:01 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 05:42:02.060132 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45018f3-c47b-46ac-89b8-ff665ec6bfa8 service neutron] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:42:02.061698 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-a45018f3-c47b-46ac-89b8-ff665ec6bfa8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:42:02.142994 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45018f3-c47b-46ac-89b8-ff665ec6bfa8 service neutron] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:42:02.149734 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035284e0-aa88-4e7b-846c-a5fd7761c2b3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355be413675540a39ccb00e1a0722316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f23435f783540199d6dcfd0417c090e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:42:02.150628 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035284e0-aa88-4e7b-846c-a5fd7761c2b3 service cinder] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:42:02.150908 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035284e0-aa88-4e7b-846c-a5fd7761c2b3 service cinder] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:42:02.151201 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035284e0-aa88-4e7b-846c-a5fd7761c2b3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:42:02.161342 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035284e0-aa88-4e7b-846c-a5fd7761c2b3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:42:02.164058 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035284e0-aa88-4e7b-846c-a5fd7761c2b3 service cinder] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:42:02.174452 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1201/2439] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 10 05:42:02 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 05:42:03.625333 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb97e642-ac22-4f67-bc4c-d85ed58026f8 None None] REQUEST_METHOD: `POST` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:42:03.626521 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb97e642-ac22-4f67-bc4c-d85ed58026f8 None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:42:03.626521 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb97e642-ac22-4f67-bc4c-d85ed58026f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:42:03.648813 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.auth.core [None req-bb97e642-ac22-4f67-bc4c-d85ed58026f8 None None] MFA Rules not processed for user `40fc391e5388450bb37f541da17e95e0`. Rule list: `[]` (Enabled: `True`). {{(pid=79879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:42:03.650015 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-bb97e642-ac22-4f67-bc4c-d85ed58026f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:42:03.657773 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1239/2440] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 10 05:42:03 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 05:42:03.900790 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035284e0-aa88-4e7b-846c-a5fd7761c2b3 service cinder] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:42:03.910314 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035284e0-aa88-4e7b-846c-a5fd7761c2b3 service cinder] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:42:03.914216 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a076cd32-a378-44e2-912c-c2f275d069ae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c8461cfdd9648b8abcaf8d34b7a102a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f23435f783540199d6dcfd0417c090e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:42:03.914843 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a076cd32-a378-44e2-912c-c2f275d069ae service neutron] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:42:03.915115 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a076cd32-a378-44e2-912c-c2f275d069ae service neutron] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:42:03.915390 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a076cd32-a378-44e2-912c-c2f275d069ae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:42:03.917628 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-a076cd32-a378-44e2-912c-c2f275d069ae service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:42:03.927944 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a076cd32-a378-44e2-912c-c2f275d069ae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:42:03.929390 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a076cd32-a378-44e2-912c-c2f275d069ae service neutron] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:42:03.937658 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1202/2441] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 10 05:42:03 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 05:42:06.453909 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb97e642-ac22-4f67-bc4c-d85ed58026f8 None None] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:42:06.465126 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb97e642-ac22-4f67-bc4c-d85ed58026f8 None None] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:42:06.470391 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6734df-0d3f-4296-9d4d-e2919c8bafe2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c8461cfdd9648b8abcaf8d34b7a102a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f23435f783540199d6dcfd0417c090e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:42:06.471320 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6734df-0d3f-4296-9d4d-e2919c8bafe2 service neutron] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:42:06.471834 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6734df-0d3f-4296-9d4d-e2919c8bafe2 service neutron] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:42:06.472297 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6734df-0d3f-4296-9d4d-e2919c8bafe2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:42:06.475775 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-9a6734df-0d3f-4296-9d4d-e2919c8bafe2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:42:06.489884 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6734df-0d3f-4296-9d4d-e2919c8bafe2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:42:06.491264 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6734df-0d3f-4296-9d4d-e2919c8bafe2 service neutron] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:42:06.502310 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1240/2442] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 10 05:42:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 05:42:10.015316 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a076cd32-a378-44e2-912c-c2f275d069ae service neutron] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:42:10.021157 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-a076cd32-a378-44e2-912c-c2f275d069ae service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:42:10.040097 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a076cd32-a378-44e2-912c-c2f275d069ae service neutron] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:42:10.044901 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb08432-83a6-4020-82fd-ae87c04b9994 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:42:10.046002 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb08432-83a6-4020-82fd-ae87c04b9994 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:42:10.046284 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb08432-83a6-4020-82fd-ae87c04b9994 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:42:10.046558 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb08432-83a6-4020-82fd-ae87c04b9994 admin admin] PATH_INFO: `/v3/users/1fa3b659464a49ef863e2e398aadf22a` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:42:10.047793 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb08432-83a6-4020-82fd-ae87c04b9994 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1fa3b659464a49ef863e2e398aadf22a)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:42:10.049811 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb08432-83a6-4020-82fd-ae87c04b9994 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:42:10.095451 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-efb08432-83a6-4020-82fd-ae87c04b9994 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1fa3b659464a49ef863e2e398aadf22a'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:42:10.106941 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-efb08432-83a6-4020-82fd-ae87c04b9994 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1fa3b659464a49ef863e2e398aadf22a'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:42:10.107593 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-efb08432-83a6-4020-82fd-ae87c04b9994 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1fa3b659464a49ef863e2e398aadf22a'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:42:10.114449 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-efb08432-83a6-4020-82fd-ae87c04b9994 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1fa3b659464a49ef863e2e398aadf22a'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:42:10.115098 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-efb08432-83a6-4020-82fd-ae87c04b9994 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1fa3b659464a49ef863e2e398aadf22a'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:42:10.130298 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1203/2443] 10.222.0.23 () {58 vars in 1223 bytes} [Tue May 10 05:42:10 2022] DELETE /identity/v3/users/1fa3b659464a49ef863e2e398aadf22a => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 05:42:10.315145 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6734df-0d3f-4296-9d4d-e2919c8bafe2 service neutron] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:42:10.326212 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6734df-0d3f-4296-9d4d-e2919c8bafe2 service neutron] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:42:10.393152 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d26468-704b-4f58-a6ce-a6e17ee90739 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:42:10.393954 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d26468-704b-4f58-a6ce-a6e17ee90739 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:42:10.394235 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d26468-704b-4f58-a6ce-a6e17ee90739 admin admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:42:10.394507 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d26468-704b-4f58-a6ce-a6e17ee90739 admin admin] PATH_INFO: `/v3/projects/9a950288ff0b408ea461a2206204f2e6` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:42:10.395889 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d26468-704b-4f58-a6ce-a6e17ee90739 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9a950288ff0b408ea461a2206204f2e6)` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:42:10.397843 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d26468-704b-4f58-a6ce-a6e17ee90739 admin admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:42:10.451999 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-73d26468-704b-4f58-a6ce-a6e17ee90739 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9a950288ff0b408ea461a2206204f2e6', 'request_id': 'req-73d26468-704b-4f58-a6ce-a6e17ee90739'} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:42:10.459261 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-73d26468-704b-4f58-a6ce-a6e17ee90739 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9a950288ff0b408ea461a2206204f2e6', 'request_id': 'req-73d26468-704b-4f58-a6ce-a6e17ee90739'} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:42:10.473262 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-73d26468-704b-4f58-a6ce-a6e17ee90739 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9a950288ff0b408ea461a2206204f2e6', 'request_id': 'req-73d26468-704b-4f58-a6ce-a6e17ee90739'} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:42:10.485484 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-73d26468-704b-4f58-a6ce-a6e17ee90739 admin admin] The token cache is being invalidate because project 9a950288ff0b408ea461a2206204f2e6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79879) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 05:42:10.485949 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-73d26468-704b-4f58-a6ce-a6e17ee90739 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:42:10.486663 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-73d26468-704b-4f58-a6ce-a6e17ee90739 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:42:10.491662 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1241/2444] 10.222.0.23 () {58 vars in 1232 bytes} [Tue May 10 05:42:10 2022] DELETE /identity/v3/projects/9a950288ff0b408ea461a2206204f2e6 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 05:42:10.495018 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77766775-37ea-4af5-afb1-1e26e7c0c858 None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:42:10.495537 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77766775-37ea-4af5-afb1-1e26e7c0c858 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:42:10.496127 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77766775-37ea-4af5-afb1-1e26e7c0c858 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:42:10.517976 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-77766775-37ea-4af5-afb1-1e26e7c0c858 None None] MFA Rules not processed for user `44883b22532e44049d846938dc2cf423`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:42:10.519398 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-77766775-37ea-4af5-afb1-1e26e7c0c858 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:42:10.590085 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1204/2445] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 10 05:42:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 05:42:10.598182 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda32bb8-9a46-411d-b048-2c076994e3eb None None] REQUEST_METHOD: `POST` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:42:10.598426 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda32bb8-9a46-411d-b048-2c076994e3eb None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:42:10.598706 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda32bb8-9a46-411d-b048-2c076994e3eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:42:10.617938 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.auth.core [None req-cda32bb8-9a46-411d-b048-2c076994e3eb None None] MFA Rules not processed for user `44883b22532e44049d846938dc2cf423`. Rule list: `[]` (Enabled: `True`). {{(pid=79879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:42:10.619439 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-cda32bb8-9a46-411d-b048-2c076994e3eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:42:10.628722 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1242/2446] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 10 05:42:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 05:42:10.637912 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77766775-37ea-4af5-afb1-1e26e7c0c858 None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:42:10.642933 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77766775-37ea-4af5-afb1-1e26e7c0c858 None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:42:10.647774 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54eda1d3-68bb-48b5-9bc5-1c6d43dda568 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:42:10.648513 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54eda1d3-68bb-48b5-9bc5-1c6d43dda568 admin admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:42:10.648893 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54eda1d3-68bb-48b5-9bc5-1c6d43dda568 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:42:10.649232 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54eda1d3-68bb-48b5-9bc5-1c6d43dda568 admin admin] PATH_INFO: `/v3/domains` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:42:10.650061 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54eda1d3-68bb-48b5-9bc5-1c6d43dda568 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:42:10.650431 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54eda1d3-68bb-48b5-9bc5-1c6d43dda568 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:42:10.652131 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54eda1d3-68bb-48b5-9bc5-1c6d43dda568 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:42:10.667207 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1205/2447] 10.222.0.23 () {58 vars in 1152 bytes} [Tue May 10 05:42:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:42:10.668293 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda32bb8-9a46-411d-b048-2c076994e3eb None None] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:42:10.677420 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda32bb8-9a46-411d-b048-2c076994e3eb None None] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:42:10.682162 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f2f06a-c7b1-4bdf-a7bc-efb15a32d07d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:42:10.682848 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f2f06a-c7b1-4bdf-a7bc-efb15a32d07d admin admin] REQUEST_METHOD: `POST` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:42:10.683126 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f2f06a-c7b1-4bdf-a7bc-efb15a32d07d admin admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:42:10.683393 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f2f06a-c7b1-4bdf-a7bc-efb15a32d07d admin admin] PATH_INFO: `/v3/projects` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:42:10.684129 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f2f06a-c7b1-4bdf-a7bc-efb15a32d07d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:42:10.686062 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f2f06a-c7b1-4bdf-a7bc-efb15a32d07d admin admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:42:10.716323 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1243/2448] 10.222.0.23 () {60 vars in 1152 bytes} [Tue May 10 05:42:10 2022] POST /identity/v3/projects => generated 373 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 05:42:10.720093 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54eda1d3-68bb-48b5-9bc5-1c6d43dda568 admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:42:10.730040 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54eda1d3-68bb-48b5-9bc5-1c6d43dda568 admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:42:10.786711 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102c457a-20f3-4296-b970-9850e3f04423 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:42:10.787377 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102c457a-20f3-4296-b970-9850e3f04423 admin admin] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:42:10.787715 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102c457a-20f3-4296-b970-9850e3f04423 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:42:10.787987 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102c457a-20f3-4296-b970-9850e3f04423 admin admin] PATH_INFO: `/v3/users` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:42:10.788684 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102c457a-20f3-4296-b970-9850e3f04423 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:42:10.790628 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102c457a-20f3-4296-b970-9850e3f04423 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:42:10.810853 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1206/2449] 10.222.0.23 () {60 vars in 1143 bytes} [Tue May 10 05:42:10 2022] POST /identity/v3/users => generated 287 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 05:42:10.815100 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f2f06a-c7b1-4bdf-a7bc-efb15a32d07d admin admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:42:10.826030 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f2f06a-c7b1-4bdf-a7bc-efb15a32d07d admin admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:42:10.831478 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bec235d-67fc-4d54-8abd-e6ea956ae5c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:42:10.832288 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bec235d-67fc-4d54-8abd-e6ea956ae5c2 admin admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:42:10.832571 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bec235d-67fc-4d54-8abd-e6ea956ae5c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:42:10.832844 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bec235d-67fc-4d54-8abd-e6ea956ae5c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:42:10.833631 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bec235d-67fc-4d54-8abd-e6ea956ae5c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:42:10.835301 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bec235d-67fc-4d54-8abd-e6ea956ae5c2 admin admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:42:10.846290 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1244/2450] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 10 05:42:10 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 05:42:10.850355 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102c457a-20f3-4296-b970-9850e3f04423 admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:42:10.860821 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102c457a-20f3-4296-b970-9850e3f04423 admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:42:10.866233 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b29c7e2-3ec2-43ce-b69e-bdcabbde9f7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:42:10.866899 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b29c7e2-3ec2-43ce-b69e-bdcabbde9f7f admin admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:42:10.867177 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b29c7e2-3ec2-43ce-b69e-bdcabbde9f7f admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:42:10.867450 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b29c7e2-3ec2-43ce-b69e-bdcabbde9f7f admin admin] PATH_INFO: `/v3/roles` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:42:10.868222 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b29c7e2-3ec2-43ce-b69e-bdcabbde9f7f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:42:10.869865 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b29c7e2-3ec2-43ce-b69e-bdcabbde9f7f admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:42:10.880723 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1207/2451] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 10 05:42:10 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 05:42:10.884826 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bec235d-67fc-4d54-8abd-e6ea956ae5c2 admin admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:42:10.896267 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bec235d-67fc-4d54-8abd-e6ea956ae5c2 admin admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:42:10.901645 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b5f07d-9735-40b0-8a73-b6fb8a30e76a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:42:10.902478 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b5f07d-9735-40b0-8a73-b6fb8a30e76a admin admin] REQUEST_METHOD: `PUT` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:42:10.902903 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b5f07d-9735-40b0-8a73-b6fb8a30e76a admin admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:42:10.903183 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b5f07d-9735-40b0-8a73-b6fb8a30e76a admin admin] PATH_INFO: `/v3/projects/6e91386cfb5e4b5ca883e93359ae039b/users/eeaaa5754ec34f0c9ccde9492df07283/roles/382636e67fc142a2b2f486340d959e11` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:42:10.918111 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b5f07d-9735-40b0-8a73-b6fb8a30e76a admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e91386cfb5e4b5ca883e93359ae039b, user_id=eeaaa5754ec34f0c9ccde9492df07283, role_id=382636e67fc142a2b2f486340d959e11)` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:42:10.920887 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b5f07d-9735-40b0-8a73-b6fb8a30e76a admin admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:42:10.935266 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1245/2452] 10.222.0.23 () {60 vars in 1482 bytes} [Tue May 10 05:42:10 2022] PUT /identity/v3/projects/6e91386cfb5e4b5ca883e93359ae039b/users/eeaaa5754ec34f0c9ccde9492df07283/roles/382636e67fc142a2b2f486340d959e11 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 05:42:10.945656 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2daf2f-8dba-497f-b59f-a34d5699906b None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:42:10.945948 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2daf2f-8dba-497f-b59f-a34d5699906b None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:42:10.946224 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2daf2f-8dba-497f-b59f-a34d5699906b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:42:10.974512 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-7a2daf2f-8dba-497f-b59f-a34d5699906b None None] MFA Rules not processed for user `eeaaa5754ec34f0c9ccde9492df07283`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:42:10.975818 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-7a2daf2f-8dba-497f-b59f-a34d5699906b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:42:11.044352 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1208/2453] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 10 05:42:10 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 05:42:11.048827 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b5f07d-9735-40b0-8a73-b6fb8a30e76a admin admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:42:11.111460 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b5f07d-9735-40b0-8a73-b6fb8a30e76a admin admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:42:11.116113 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65af81b-1d1b-4f5d-9394-c064aaca104c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:42:11.116775 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65af81b-1d1b-4f5d-9394-c064aaca104c admin admin] REQUEST_METHOD: `POST` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:42:11.117055 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65af81b-1d1b-4f5d-9394-c064aaca104c admin admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:42:11.117326 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65af81b-1d1b-4f5d-9394-c064aaca104c admin admin] PATH_INFO: `/v3/projects` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:42:11.118043 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65af81b-1d1b-4f5d-9394-c064aaca104c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:42:11.120046 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65af81b-1d1b-4f5d-9394-c064aaca104c admin admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:42:11.146104 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1246/2454] 10.222.0.23 () {60 vars in 1152 bytes} [Tue May 10 05:42:11 2022] POST /identity/v3/projects => generated 373 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 05:42:11.150292 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2daf2f-8dba-497f-b59f-a34d5699906b None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:42:11.160809 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2daf2f-8dba-497f-b59f-a34d5699906b None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:42:11.216380 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576f28d5-5cf0-499f-bf3a-ae745657b9bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:42:11.217134 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576f28d5-5cf0-499f-bf3a-ae745657b9bb admin admin] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:42:11.217398 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576f28d5-5cf0-499f-bf3a-ae745657b9bb admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:42:11.217678 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576f28d5-5cf0-499f-bf3a-ae745657b9bb admin admin] PATH_INFO: `/v3/users` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:42:11.218398 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576f28d5-5cf0-499f-bf3a-ae745657b9bb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:42:11.220361 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576f28d5-5cf0-499f-bf3a-ae745657b9bb admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:42:11.244209 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1209/2455] 10.222.0.23 () {60 vars in 1143 bytes} [Tue May 10 05:42:11 2022] POST /identity/v3/users => generated 293 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 05:42:11.245084 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65af81b-1d1b-4f5d-9394-c064aaca104c admin admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:42:11.255842 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65af81b-1d1b-4f5d-9394-c064aaca104c admin admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:42:11.260534 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e83bd2a-e4ff-4851-b791-2636d782c854 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:42:11.261195 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e83bd2a-e4ff-4851-b791-2636d782c854 admin admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:42:11.261477 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e83bd2a-e4ff-4851-b791-2636d782c854 admin admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:42:11.261757 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e83bd2a-e4ff-4851-b791-2636d782c854 admin admin] PATH_INFO: `/v3/roles` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:42:11.262486 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e83bd2a-e4ff-4851-b791-2636d782c854 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:42:11.264257 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e83bd2a-e4ff-4851-b791-2636d782c854 admin admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:42:11.274477 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1247/2456] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 10 05:42:11 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 05:42:11.278500 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576f28d5-5cf0-499f-bf3a-ae745657b9bb admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:42:11.288270 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576f28d5-5cf0-499f-bf3a-ae745657b9bb admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:42:11.293297 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fae4556-74e1-488c-a288-619abdf11a06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:42:11.294163 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fae4556-74e1-488c-a288-619abdf11a06 admin admin] REQUEST_METHOD: `PUT` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:42:11.294455 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fae4556-74e1-488c-a288-619abdf11a06 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:42:11.294714 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fae4556-74e1-488c-a288-619abdf11a06 admin admin] PATH_INFO: `/v3/projects/f28626b684df4053a80f7b7f6413668e/users/e3b68a5248b14a92a65ff10cbf2f6115/roles/199ac1dd842441d7913c6ee89d8fbecc` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:42:11.310171 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fae4556-74e1-488c-a288-619abdf11a06 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f28626b684df4053a80f7b7f6413668e, user_id=e3b68a5248b14a92a65ff10cbf2f6115, role_id=199ac1dd842441d7913c6ee89d8fbecc)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:42:11.312892 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fae4556-74e1-488c-a288-619abdf11a06 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:42:11.326896 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1210/2457] 10.222.0.23 () {60 vars in 1482 bytes} [Tue May 10 05:42:11 2022] PUT /identity/v3/projects/f28626b684df4053a80f7b7f6413668e/users/e3b68a5248b14a92a65ff10cbf2f6115/roles/199ac1dd842441d7913c6ee89d8fbecc => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 05:42:11.330827 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e83bd2a-e4ff-4851-b791-2636d782c854 admin admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:42:11.341440 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e83bd2a-e4ff-4851-b791-2636d782c854 admin admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:42:11.403258 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce69da9b-9c6d-4129-84ad-00bf30cd02bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:42:11.403951 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce69da9b-9c6d-4129-84ad-00bf30cd02bf admin admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:42:11.404233 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce69da9b-9c6d-4129-84ad-00bf30cd02bf admin admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:42:11.404502 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce69da9b-9c6d-4129-84ad-00bf30cd02bf admin admin] PATH_INFO: `/v3/roles` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:42:11.405227 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce69da9b-9c6d-4129-84ad-00bf30cd02bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:42:11.406842 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce69da9b-9c6d-4129-84ad-00bf30cd02bf admin admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:42:11.418098 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1248/2458] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 10 05:42:11 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 05:42:11.422446 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fae4556-74e1-488c-a288-619abdf11a06 admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:42:11.433444 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fae4556-74e1-488c-a288-619abdf11a06 admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:42:11.438789 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ab1170-d85f-4310-bcb7-4e16b1f10dd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:42:11.439703 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ab1170-d85f-4310-bcb7-4e16b1f10dd0 admin admin] REQUEST_METHOD: `PUT` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:42:11.439989 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ab1170-d85f-4310-bcb7-4e16b1f10dd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:42:11.440264 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ab1170-d85f-4310-bcb7-4e16b1f10dd0 admin admin] PATH_INFO: `/v3/projects/f28626b684df4053a80f7b7f6413668e/users/e3b68a5248b14a92a65ff10cbf2f6115/roles/199ac1dd842441d7913c6ee89d8fbecc` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:42:11.442402 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ab1170-d85f-4310-bcb7-4e16b1f10dd0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f28626b684df4053a80f7b7f6413668e, user_id=e3b68a5248b14a92a65ff10cbf2f6115, role_id=199ac1dd842441d7913c6ee89d8fbecc)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:42:11.445136 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ab1170-d85f-4310-bcb7-4e16b1f10dd0 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:42:11.455904 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1211/2459] 10.222.0.23 () {60 vars in 1482 bytes} [Tue May 10 05:42:11 2022] PUT /identity/v3/projects/f28626b684df4053a80f7b7f6413668e/users/e3b68a5248b14a92a65ff10cbf2f6115/roles/199ac1dd842441d7913c6ee89d8fbecc => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 05:42:11.468848 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a747bd05-87e8-48d6-864f-6fc8029cd6fe None None] REQUEST_METHOD: `POST` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:42:11.469153 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a747bd05-87e8-48d6-864f-6fc8029cd6fe None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:42:11.469433 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a747bd05-87e8-48d6-864f-6fc8029cd6fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:42:11.497369 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.auth.core [None req-a747bd05-87e8-48d6-864f-6fc8029cd6fe None None] MFA Rules not processed for user `e3b68a5248b14a92a65ff10cbf2f6115`. Rule list: `[]` (Enabled: `True`). {{(pid=79879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:42:11.498746 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-a747bd05-87e8-48d6-864f-6fc8029cd6fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:42:11.570435 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1249/2460] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 10 05:42:11 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 05:42:11.582111 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ab1170-d85f-4310-bcb7-4e16b1f10dd0 admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:42:11.584097 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-60ab1170-d85f-4310-bcb7-4e16b1f10dd0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:42:11.639928 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ab1170-d85f-4310-bcb7-4e16b1f10dd0 admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:42:11.644105 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a96794-5dce-4389-a427-0ccd68da3853 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355be413675540a39ccb00e1a0722316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f23435f783540199d6dcfd0417c090e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:42:11.644732 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a96794-5dce-4389-a427-0ccd68da3853 service cinder] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:42:11.645010 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a96794-5dce-4389-a427-0ccd68da3853 service cinder] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:42:11.645279 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a96794-5dce-4389-a427-0ccd68da3853 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:42:11.655004 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a96794-5dce-4389-a427-0ccd68da3853 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:42:11.656462 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a96794-5dce-4389-a427-0ccd68da3853 service cinder] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:42:11.665916 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1212/2461] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 10 05:42:11 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 05:42:11.740989 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a747bd05-87e8-48d6-864f-6fc8029cd6fe None None] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:42:11.750851 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a747bd05-87e8-48d6-864f-6fc8029cd6fe None None] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:42:11.755281 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9817ab98-7a73-4af0-9dce-b2c059c3183b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355be413675540a39ccb00e1a0722316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f23435f783540199d6dcfd0417c090e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:42:11.755951 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9817ab98-7a73-4af0-9dce-b2c059c3183b service cinder] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:42:11.756230 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9817ab98-7a73-4af0-9dce-b2c059c3183b service cinder] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:42:11.756502 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9817ab98-7a73-4af0-9dce-b2c059c3183b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:42:11.811854 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9817ab98-7a73-4af0-9dce-b2c059c3183b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:42:11.813296 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9817ab98-7a73-4af0-9dce-b2c059c3183b service cinder] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:42:11.822480 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1250/2462] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 10 05:42:11 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 05:42:12.601721 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a96794-5dce-4389-a427-0ccd68da3853 service cinder] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:42:12.603278 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-81a96794-5dce-4389-a427-0ccd68da3853 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:42:12.660811 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a96794-5dce-4389-a427-0ccd68da3853 service cinder] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:42:12.664710 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e4aabc-d62d-4813-b7c8-3ed6dba83d1f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c8461cfdd9648b8abcaf8d34b7a102a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f23435f783540199d6dcfd0417c090e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:42:12.665340 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e4aabc-d62d-4813-b7c8-3ed6dba83d1f service neutron] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:42:12.665618 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e4aabc-d62d-4813-b7c8-3ed6dba83d1f service neutron] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:42:12.665887 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e4aabc-d62d-4813-b7c8-3ed6dba83d1f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:42:12.667742 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-46e4aabc-d62d-4813-b7c8-3ed6dba83d1f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:42:12.733320 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e4aabc-d62d-4813-b7c8-3ed6dba83d1f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:42:12.734762 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e4aabc-d62d-4813-b7c8-3ed6dba83d1f service neutron] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:42:12.745080 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1213/2463] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 10 05:42:12 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 05:42:20.224984 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9817ab98-7a73-4af0-9dce-b2c059c3183b service cinder] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:42:20.226388 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-9817ab98-7a73-4af0-9dce-b2c059c3183b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:42:20.238223 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9817ab98-7a73-4af0-9dce-b2c059c3183b service cinder] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:42:20.241760 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052f46fb-4704-4082-92b6-154fcb3fca3b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c8461cfdd9648b8abcaf8d34b7a102a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f23435f783540199d6dcfd0417c090e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:42:20.242393 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052f46fb-4704-4082-92b6-154fcb3fca3b service neutron] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:42:20.242670 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052f46fb-4704-4082-92b6-154fcb3fca3b service neutron] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:42:20.242945 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052f46fb-4704-4082-92b6-154fcb3fca3b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:42:20.244805 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-052f46fb-4704-4082-92b6-154fcb3fca3b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:42:20.314071 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052f46fb-4704-4082-92b6-154fcb3fca3b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:42:20.315530 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052f46fb-4704-4082-92b6-154fcb3fca3b service neutron] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:42:20.325283 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1251/2464] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 10 05:42:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 05:42:24.892881 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e4aabc-d62d-4813-b7c8-3ed6dba83d1f service neutron] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:42:24.895045 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-46e4aabc-d62d-4813-b7c8-3ed6dba83d1f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:42:25.000573 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e4aabc-d62d-4813-b7c8-3ed6dba83d1f service neutron] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:42:25.010517 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c689c2-47dd-422b-b6fe-4ef5b9c36f0f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f50f224ca944983aecfde86375473da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f23435f783540199d6dcfd0417c090e', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:42:25.011404 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c689c2-47dd-422b-b6fe-4ef5b9c36f0f service nova] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:42:25.011825 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c689c2-47dd-422b-b6fe-4ef5b9c36f0f service nova] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:42:25.012170 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c689c2-47dd-422b-b6fe-4ef5b9c36f0f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:42:25.014401 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-c6c689c2-47dd-422b-b6fe-4ef5b9c36f0f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:42:25.105130 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c689c2-47dd-422b-b6fe-4ef5b9c36f0f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:42:25.107096 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c689c2-47dd-422b-b6fe-4ef5b9c36f0f service nova] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:42:25.117373 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1214/2465] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 10 05:42:24 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 05:42:28.674722 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052f46fb-4704-4082-92b6-154fcb3fca3b service neutron] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:42:28.676277 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-052f46fb-4704-4082-92b6-154fcb3fca3b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:42:28.694510 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052f46fb-4704-4082-92b6-154fcb3fca3b service neutron] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:42:28.699378 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e241deaf-ff4a-4aa5-ba3b-0e8f81cf24c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:42:28.700293 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e241deaf-ff4a-4aa5-ba3b-0e8f81cf24c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:42:28.700576 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e241deaf-ff4a-4aa5-ba3b-0e8f81cf24c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:42:28.700854 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e241deaf-ff4a-4aa5-ba3b-0e8f81cf24c3 admin admin] PATH_INFO: `/v3/users/8e8273af61e041cbac9974ece62c86ad` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:42:28.702206 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e241deaf-ff4a-4aa5-ba3b-0e8f81cf24c3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8e8273af61e041cbac9974ece62c86ad)` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:42:28.705460 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e241deaf-ff4a-4aa5-ba3b-0e8f81cf24c3 admin admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:42:28.759373 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-e241deaf-ff4a-4aa5-ba3b-0e8f81cf24c3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8e8273af61e041cbac9974ece62c86ad'} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:42:28.767995 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-e241deaf-ff4a-4aa5-ba3b-0e8f81cf24c3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8e8273af61e041cbac9974ece62c86ad'} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:42:28.768554 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-e241deaf-ff4a-4aa5-ba3b-0e8f81cf24c3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8e8273af61e041cbac9974ece62c86ad'} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:42:28.780698 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-e241deaf-ff4a-4aa5-ba3b-0e8f81cf24c3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8e8273af61e041cbac9974ece62c86ad'} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:42:28.787325 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-e241deaf-ff4a-4aa5-ba3b-0e8f81cf24c3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8e8273af61e041cbac9974ece62c86ad'} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:42:28.793443 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1252/2466] 10.222.0.23 () {58 vars in 1223 bytes} [Tue May 10 05:42:28 2022] DELETE /identity/v3/users/8e8273af61e041cbac9974ece62c86ad => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 05:42:28.937544 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c689c2-47dd-422b-b6fe-4ef5b9c36f0f service nova] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:42:28.948301 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c689c2-47dd-422b-b6fe-4ef5b9c36f0f service nova] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:42:29.001984 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e241deaf-ff4a-4aa5-ba3b-0e8f81cf24c3 admin admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:42:29.003520 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0eb99a-51d4-4acc-bc35-db7df6735fe2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c8461cfdd9648b8abcaf8d34b7a102a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f23435f783540199d6dcfd0417c090e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:42:29.003778 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-e241deaf-ff4a-4aa5-ba3b-0e8f81cf24c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:42:29.004890 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0eb99a-51d4-4acc-bc35-db7df6735fe2 service neutron] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:42:29.005177 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0eb99a-51d4-4acc-bc35-db7df6735fe2 service neutron] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:42:29.005619 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0eb99a-51d4-4acc-bc35-db7df6735fe2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:42:29.007397 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-cd0eb99a-51d4-4acc-bc35-db7df6735fe2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:42:29.070543 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e241deaf-ff4a-4aa5-ba3b-0e8f81cf24c3 admin admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:42:29.075013 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e46dc60-b4c5-488b-9d8c-bff0b34c98dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:42:29.075247 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0eb99a-51d4-4acc-bc35-db7df6735fe2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:42:29.075889 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e46dc60-b4c5-488b-9d8c-bff0b34c98dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:42:29.076192 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e46dc60-b4c5-488b-9d8c-bff0b34c98dd admin admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:42:29.076467 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e46dc60-b4c5-488b-9d8c-bff0b34c98dd admin admin] PATH_INFO: `/v3/projects/9870e28919e340ad9cda63cbbdea4e35` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:42:29.076776 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0eb99a-51d4-4acc-bc35-db7df6735fe2 service neutron] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:42:29.077628 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e46dc60-b4c5-488b-9d8c-bff0b34c98dd admin admin] RBAC: Authorizing `identity:delete_project(project_id=9870e28919e340ad9cda63cbbdea4e35)` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:42:29.079535 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e46dc60-b4c5-488b-9d8c-bff0b34c98dd admin admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:42:29.086494 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1215/2467] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 10 05:42:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 05:42:29.127194 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-7e46dc60-b4c5-488b-9d8c-bff0b34c98dd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9870e28919e340ad9cda63cbbdea4e35', 'request_id': 'req-7e46dc60-b4c5-488b-9d8c-bff0b34c98dd'} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:42:29.133719 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-7e46dc60-b4c5-488b-9d8c-bff0b34c98dd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9870e28919e340ad9cda63cbbdea4e35', 'request_id': 'req-7e46dc60-b4c5-488b-9d8c-bff0b34c98dd'} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:42:29.142200 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-7e46dc60-b4c5-488b-9d8c-bff0b34c98dd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9870e28919e340ad9cda63cbbdea4e35', 'request_id': 'req-7e46dc60-b4c5-488b-9d8c-bff0b34c98dd'} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:42:29.153453 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-7e46dc60-b4c5-488b-9d8c-bff0b34c98dd admin admin] The token cache is being invalidate because project 9870e28919e340ad9cda63cbbdea4e35 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79879) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 05:42:29.153782 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-7e46dc60-b4c5-488b-9d8c-bff0b34c98dd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:42:29.154562 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-7e46dc60-b4c5-488b-9d8c-bff0b34c98dd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:42:29.156490 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1253/2468] 10.222.0.23 () {58 vars in 1232 bytes} [Tue May 10 05:42:29 2022] DELETE /identity/v3/projects/9870e28919e340ad9cda63cbbdea4e35 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 05:42:29.160410 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0eb99a-51d4-4acc-bc35-db7df6735fe2 service neutron] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:42:29.171111 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0eb99a-51d4-4acc-bc35-db7df6735fe2 service neutron] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:42:29.228464 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61584e7-43b9-44cf-bf8a-b0868588a085 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:42:29.229897 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61584e7-43b9-44cf-bf8a-b0868588a085 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:42:29.230370 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61584e7-43b9-44cf-bf8a-b0868588a085 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:42:29.230799 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61584e7-43b9-44cf-bf8a-b0868588a085 admin admin] PATH_INFO: `/v3/users/c9faf8a8f8e747239a0e062471f4a1ca` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:42:29.232300 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61584e7-43b9-44cf-bf8a-b0868588a085 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c9faf8a8f8e747239a0e062471f4a1ca)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:42:29.234391 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61584e7-43b9-44cf-bf8a-b0868588a085 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:42:29.297106 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-d61584e7-43b9-44cf-bf8a-b0868588a085 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c9faf8a8f8e747239a0e062471f4a1ca'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:42:29.308570 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-d61584e7-43b9-44cf-bf8a-b0868588a085 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c9faf8a8f8e747239a0e062471f4a1ca'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:42:29.309274 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-d61584e7-43b9-44cf-bf8a-b0868588a085 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c9faf8a8f8e747239a0e062471f4a1ca'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:42:29.315842 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-d61584e7-43b9-44cf-bf8a-b0868588a085 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c9faf8a8f8e747239a0e062471f4a1ca'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:42:29.316492 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-d61584e7-43b9-44cf-bf8a-b0868588a085 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c9faf8a8f8e747239a0e062471f4a1ca'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:42:29.331389 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1216/2469] 10.222.0.23 () {58 vars in 1223 bytes} [Tue May 10 05:42:29 2022] DELETE /identity/v3/users/c9faf8a8f8e747239a0e062471f4a1ca => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 05:42:29.727848 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e46dc60-b4c5-488b-9d8c-bff0b34c98dd admin admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:42:29.729394 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-7e46dc60-b4c5-488b-9d8c-bff0b34c98dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:42:29.746092 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e46dc60-b4c5-488b-9d8c-bff0b34c98dd admin admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:42:29.804714 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf930a1-f775-473e-8736-2e85134a9fba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:42:29.805579 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf930a1-f775-473e-8736-2e85134a9fba admin admin] REQUEST_METHOD: `DELETE` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:42:29.805868 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf930a1-f775-473e-8736-2e85134a9fba admin admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:42:29.806128 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf930a1-f775-473e-8736-2e85134a9fba admin admin] PATH_INFO: `/v3/projects/96f5fbc03aab48ed80b52ac8bb30d9b4` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:42:29.807312 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf930a1-f775-473e-8736-2e85134a9fba admin admin] RBAC: Authorizing `identity:delete_project(project_id=96f5fbc03aab48ed80b52ac8bb30d9b4)` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:42:29.809294 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf930a1-f775-473e-8736-2e85134a9fba admin admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:42:29.854991 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-fcf930a1-f775-473e-8736-2e85134a9fba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '96f5fbc03aab48ed80b52ac8bb30d9b4', 'request_id': 'req-fcf930a1-f775-473e-8736-2e85134a9fba'} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:42:29.861389 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-fcf930a1-f775-473e-8736-2e85134a9fba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '96f5fbc03aab48ed80b52ac8bb30d9b4', 'request_id': 'req-fcf930a1-f775-473e-8736-2e85134a9fba'} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:42:29.868864 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-fcf930a1-f775-473e-8736-2e85134a9fba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '96f5fbc03aab48ed80b52ac8bb30d9b4', 'request_id': 'req-fcf930a1-f775-473e-8736-2e85134a9fba'} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:42:29.879372 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-fcf930a1-f775-473e-8736-2e85134a9fba admin admin] The token cache is being invalidate because project 96f5fbc03aab48ed80b52ac8bb30d9b4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79879) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 05:42:29.879651 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-fcf930a1-f775-473e-8736-2e85134a9fba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:42:29.880356 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-fcf930a1-f775-473e-8736-2e85134a9fba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:42:29.882552 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1254/2470] 10.222.0.23 () {58 vars in 1232 bytes} [Tue May 10 05:42:29 2022] DELETE /identity/v3/projects/96f5fbc03aab48ed80b52ac8bb30d9b4 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 05:42:29.887990 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802f5c03-89cc-4191-b978-f3f5fe199a0a None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:42:29.888388 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802f5c03-89cc-4191-b978-f3f5fe199a0a None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:42:29.888736 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802f5c03-89cc-4191-b978-f3f5fe199a0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:42:29.910342 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-802f5c03-89cc-4191-b978-f3f5fe199a0a None None] MFA Rules not processed for user `44883b22532e44049d846938dc2cf423`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:42:29.911545 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-802f5c03-89cc-4191-b978-f3f5fe199a0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:42:29.975149 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1217/2471] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 10 05:42:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 05:42:29.983306 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0cafc0-df98-49de-a87f-dffa5bcb278f None None] REQUEST_METHOD: `POST` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:42:29.983622 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0cafc0-df98-49de-a87f-dffa5bcb278f None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:42:29.983904 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0cafc0-df98-49de-a87f-dffa5bcb278f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:42:30.003267 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.auth.core [None req-5e0cafc0-df98-49de-a87f-dffa5bcb278f None None] MFA Rules not processed for user `44883b22532e44049d846938dc2cf423`. Rule list: `[]` (Enabled: `True`). {{(pid=79879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:42:30.004710 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-5e0cafc0-df98-49de-a87f-dffa5bcb278f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:42:30.017770 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1255/2472] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 10 05:42:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 05:42:30.019255 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802f5c03-89cc-4191-b978-f3f5fe199a0a None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:42:30.029503 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802f5c03-89cc-4191-b978-f3f5fe199a0a None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:42:30.034875 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1d1847-c4df-4ec4-a1f0-4484db589447 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:42:30.035541 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1d1847-c4df-4ec4-a1f0-4484db589447 admin admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:42:30.035868 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1d1847-c4df-4ec4-a1f0-4484db589447 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:42:30.036140 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1d1847-c4df-4ec4-a1f0-4484db589447 admin admin] PATH_INFO: `/v3/domains` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:42:30.037083 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1d1847-c4df-4ec4-a1f0-4484db589447 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:42:30.037544 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1d1847-c4df-4ec4-a1f0-4484db589447 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:42:30.039208 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1d1847-c4df-4ec4-a1f0-4484db589447 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:42:30.055772 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1218/2473] 10.222.0.23 () {58 vars in 1152 bytes} [Tue May 10 05:42:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:42:30.057178 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0cafc0-df98-49de-a87f-dffa5bcb278f None None] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:42:30.068089 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0cafc0-df98-49de-a87f-dffa5bcb278f None None] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:42:30.076078 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb12032a-b010-4536-9137-9d93e519e917 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:42:30.076857 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb12032a-b010-4536-9137-9d93e519e917 admin admin] REQUEST_METHOD: `POST` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:42:30.077141 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb12032a-b010-4536-9137-9d93e519e917 admin admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:42:30.077471 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb12032a-b010-4536-9137-9d93e519e917 admin admin] PATH_INFO: `/v3/projects` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:42:30.078571 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb12032a-b010-4536-9137-9d93e519e917 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:42:30.080865 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb12032a-b010-4536-9137-9d93e519e917 admin admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:42:30.112022 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1256/2474] 10.222.0.23 () {60 vars in 1152 bytes} [Tue May 10 05:42:30 2022] POST /identity/v3/projects => generated 379 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 05:42:30.116305 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1d1847-c4df-4ec4-a1f0-4484db589447 admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:42:30.126310 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1d1847-c4df-4ec4-a1f0-4484db589447 admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:42:30.188153 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b04626-afca-4915-ac5c-3eda3112b28d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:42:30.189224 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b04626-afca-4915-ac5c-3eda3112b28d admin admin] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:42:30.189511 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b04626-afca-4915-ac5c-3eda3112b28d admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:42:30.191049 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b04626-afca-4915-ac5c-3eda3112b28d admin admin] PATH_INFO: `/v3/users` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:42:30.191049 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b04626-afca-4915-ac5c-3eda3112b28d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:42:30.193021 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b04626-afca-4915-ac5c-3eda3112b28d admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:42:30.214882 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1219/2475] 10.222.0.23 () {60 vars in 1143 bytes} [Tue May 10 05:42:30 2022] POST /identity/v3/users => generated 290 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 05:42:30.218776 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb12032a-b010-4536-9137-9d93e519e917 admin admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:42:30.230350 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb12032a-b010-4536-9137-9d93e519e917 admin admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:42:30.235642 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fec17e6-5f1c-4bb4-90a5-99a53de69920 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:42:30.236357 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fec17e6-5f1c-4bb4-90a5-99a53de69920 admin admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:42:30.236837 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fec17e6-5f1c-4bb4-90a5-99a53de69920 admin admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:42:30.236996 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fec17e6-5f1c-4bb4-90a5-99a53de69920 admin admin] PATH_INFO: `/v3/roles` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:42:30.237820 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fec17e6-5f1c-4bb4-90a5-99a53de69920 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:42:30.239438 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fec17e6-5f1c-4bb4-90a5-99a53de69920 admin admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:42:30.250786 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1257/2476] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 10 05:42:30 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 05:42:30.255957 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b04626-afca-4915-ac5c-3eda3112b28d admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:42:30.270060 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b04626-afca-4915-ac5c-3eda3112b28d admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:42:30.275809 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c1c563-a06d-4d10-8642-09d49e0bf5de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:42:30.276492 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c1c563-a06d-4d10-8642-09d49e0bf5de admin admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:42:30.276776 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c1c563-a06d-4d10-8642-09d49e0bf5de admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:42:30.277054 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c1c563-a06d-4d10-8642-09d49e0bf5de admin admin] PATH_INFO: `/v3/roles` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:42:30.277797 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c1c563-a06d-4d10-8642-09d49e0bf5de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:42:30.279783 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c1c563-a06d-4d10-8642-09d49e0bf5de admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:42:30.299133 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fec17e6-5f1c-4bb4-90a5-99a53de69920 admin admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:42:30.303747 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1220/2477] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 10 05:42:30 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 05:42:30.311933 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fec17e6-5f1c-4bb4-90a5-99a53de69920 admin admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:42:30.317024 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61399c99-1d71-4d26-b4ec-3ed586e99ff8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:42:30.317980 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61399c99-1d71-4d26-b4ec-3ed586e99ff8 admin admin] REQUEST_METHOD: `PUT` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:42:30.318264 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61399c99-1d71-4d26-b4ec-3ed586e99ff8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:42:30.318539 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61399c99-1d71-4d26-b4ec-3ed586e99ff8 admin admin] PATH_INFO: `/v3/projects/73bfe2432e5a41d8b8611b54849c575f/users/44ea420780af4d95aa7f2ae86ca31ef1/roles/382636e67fc142a2b2f486340d959e11` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:42:30.335929 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61399c99-1d71-4d26-b4ec-3ed586e99ff8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=73bfe2432e5a41d8b8611b54849c575f, user_id=44ea420780af4d95aa7f2ae86ca31ef1, role_id=382636e67fc142a2b2f486340d959e11)` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:42:30.338585 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61399c99-1d71-4d26-b4ec-3ed586e99ff8 admin admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:42:30.352797 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1258/2478] 10.222.0.23 () {60 vars in 1482 bytes} [Tue May 10 05:42:30 2022] PUT /identity/v3/projects/73bfe2432e5a41d8b8611b54849c575f/users/44ea420780af4d95aa7f2ae86ca31ef1/roles/382636e67fc142a2b2f486340d959e11 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 05:42:30.358198 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5b9656-02a9-498a-8cf3-1d563a84c1b8 None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:42:30.358496 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5b9656-02a9-498a-8cf3-1d563a84c1b8 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:42:30.358815 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5b9656-02a9-498a-8cf3-1d563a84c1b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:42:30.376865 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-3c5b9656-02a9-498a-8cf3-1d563a84c1b8 None None] MFA Rules not processed for user `44883b22532e44049d846938dc2cf423`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:42:30.378012 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-3c5b9656-02a9-498a-8cf3-1d563a84c1b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:42:30.438518 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1221/2479] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 10 05:42:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 05:42:30.448717 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61399c99-1d71-4d26-b4ec-3ed586e99ff8 admin admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:42:30.450570 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-61399c99-1d71-4d26-b4ec-3ed586e99ff8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:42:30.511637 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61399c99-1d71-4d26-b4ec-3ed586e99ff8 admin admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:42:30.515455 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494ad76d-264b-4e79-a95e-5e222ea184f7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c8461cfdd9648b8abcaf8d34b7a102a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f23435f783540199d6dcfd0417c090e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:42:30.516147 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494ad76d-264b-4e79-a95e-5e222ea184f7 service neutron] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:42:30.516431 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494ad76d-264b-4e79-a95e-5e222ea184f7 service neutron] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:42:30.516706 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494ad76d-264b-4e79-a95e-5e222ea184f7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:42:30.526649 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494ad76d-264b-4e79-a95e-5e222ea184f7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:42:30.528173 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494ad76d-264b-4e79-a95e-5e222ea184f7 service neutron] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:42:30.538822 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1259/2480] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 10 05:42:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 05:42:33.122267 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5b9656-02a9-498a-8cf3-1d563a84c1b8 None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:42:33.124173 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-3c5b9656-02a9-498a-8cf3-1d563a84c1b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:42:33.144689 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5b9656-02a9-498a-8cf3-1d563a84c1b8 None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:42:33.150758 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb623f4-60fb-4159-b19d-1d8af6c69454 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:42:33.152091 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb623f4-60fb-4159-b19d-1d8af6c69454 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:42:33.152445 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb623f4-60fb-4159-b19d-1d8af6c69454 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:42:33.152798 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb623f4-60fb-4159-b19d-1d8af6c69454 admin admin] PATH_INFO: `/v3/users/5fd529982ab24820826d466e4d13a07d` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:42:33.154296 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb623f4-60fb-4159-b19d-1d8af6c69454 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5fd529982ab24820826d466e4d13a07d)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:42:33.156594 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb623f4-60fb-4159-b19d-1d8af6c69454 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:42:33.207660 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-6eb623f4-60fb-4159-b19d-1d8af6c69454 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5fd529982ab24820826d466e4d13a07d'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:42:33.220595 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-6eb623f4-60fb-4159-b19d-1d8af6c69454 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5fd529982ab24820826d466e4d13a07d'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:42:33.221447 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-6eb623f4-60fb-4159-b19d-1d8af6c69454 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5fd529982ab24820826d466e4d13a07d'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:42:33.230431 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-6eb623f4-60fb-4159-b19d-1d8af6c69454 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5fd529982ab24820826d466e4d13a07d'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:42:33.231321 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-6eb623f4-60fb-4159-b19d-1d8af6c69454 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5fd529982ab24820826d466e4d13a07d'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:42:33.253787 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1222/2481] 10.222.0.23 () {58 vars in 1223 bytes} [Tue May 10 05:42:33 2022] DELETE /identity/v3/users/5fd529982ab24820826d466e4d13a07d => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 05:42:33.498360 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494ad76d-264b-4e79-a95e-5e222ea184f7 service neutron] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:42:33.515618 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494ad76d-264b-4e79-a95e-5e222ea184f7 service neutron] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:42:33.664435 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e379177-63bc-4a75-aa20-090a003c2b3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:42:33.667837 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e379177-63bc-4a75-aa20-090a003c2b3e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:42:33.671430 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e379177-63bc-4a75-aa20-090a003c2b3e admin admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:42:33.671916 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e379177-63bc-4a75-aa20-090a003c2b3e admin admin] PATH_INFO: `/v3/projects/946af2825477481298bcaa8f04b345d2` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:42:33.673734 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e379177-63bc-4a75-aa20-090a003c2b3e admin admin] RBAC: Authorizing `identity:delete_project(project_id=946af2825477481298bcaa8f04b345d2)` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:42:33.676054 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e379177-63bc-4a75-aa20-090a003c2b3e admin admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:42:33.750339 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-6e379177-63bc-4a75-aa20-090a003c2b3e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '946af2825477481298bcaa8f04b345d2', 'request_id': 'req-6e379177-63bc-4a75-aa20-090a003c2b3e'} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:42:33.761831 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-6e379177-63bc-4a75-aa20-090a003c2b3e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '946af2825477481298bcaa8f04b345d2', 'request_id': 'req-6e379177-63bc-4a75-aa20-090a003c2b3e'} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:42:33.781019 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-6e379177-63bc-4a75-aa20-090a003c2b3e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '946af2825477481298bcaa8f04b345d2', 'request_id': 'req-6e379177-63bc-4a75-aa20-090a003c2b3e'} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:42:33.804746 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-6e379177-63bc-4a75-aa20-090a003c2b3e admin admin] The token cache is being invalidate because project 946af2825477481298bcaa8f04b345d2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79879) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 05:42:33.805462 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-6e379177-63bc-4a75-aa20-090a003c2b3e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:42:33.808234 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-6e379177-63bc-4a75-aa20-090a003c2b3e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:42:33.810321 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1260/2482] 10.222.0.23 () {58 vars in 1232 bytes} [Tue May 10 05:42:33 2022] DELETE /identity/v3/projects/946af2825477481298bcaa8f04b345d2 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 05:42:33.816441 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1feb12-8ad6-49c5-af89-2c7c344e2ebf None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:42:33.817002 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1feb12-8ad6-49c5-af89-2c7c344e2ebf None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:42:33.817701 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1feb12-8ad6-49c5-af89-2c7c344e2ebf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:42:33.847637 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-5e1feb12-8ad6-49c5-af89-2c7c344e2ebf None None] MFA Rules not processed for user `44883b22532e44049d846938dc2cf423`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:42:33.860346 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-5e1feb12-8ad6-49c5-af89-2c7c344e2ebf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:42:33.997939 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1223/2483] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 10 05:42:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 05:42:34.006636 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa57606-1ad3-467f-8278-26835464c033 None None] REQUEST_METHOD: `POST` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:42:34.006898 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa57606-1ad3-467f-8278-26835464c033 None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:42:34.007406 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa57606-1ad3-467f-8278-26835464c033 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:42:34.044907 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.auth.core [None req-eaa57606-1ad3-467f-8278-26835464c033 None None] MFA Rules not processed for user `44883b22532e44049d846938dc2cf423`. Rule list: `[]` (Enabled: `True`). {{(pid=79879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:42:34.046162 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-eaa57606-1ad3-467f-8278-26835464c033 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:42:34.081537 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1261/2484] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 10 05:42:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 05:42:34.085751 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1feb12-8ad6-49c5-af89-2c7c344e2ebf None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:42:34.095802 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1feb12-8ad6-49c5-af89-2c7c344e2ebf None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:42:34.122910 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04646ddc-8d4b-4efd-95dd-9a2468a06d70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:42:34.123704 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04646ddc-8d4b-4efd-95dd-9a2468a06d70 admin admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:42:34.123995 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04646ddc-8d4b-4efd-95dd-9a2468a06d70 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:42:34.124269 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04646ddc-8d4b-4efd-95dd-9a2468a06d70 admin admin] PATH_INFO: `/v3/domains` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:42:34.129691 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04646ddc-8d4b-4efd-95dd-9a2468a06d70 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:42:34.130176 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04646ddc-8d4b-4efd-95dd-9a2468a06d70 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:42:34.135152 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04646ddc-8d4b-4efd-95dd-9a2468a06d70 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:42:34.165907 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa57606-1ad3-467f-8278-26835464c033 None None] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:42:34.172633 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1224/2485] 10.222.0.23 () {58 vars in 1152 bytes} [Tue May 10 05:42:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:42:34.176726 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa57606-1ad3-467f-8278-26835464c033 None None] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:42:34.193160 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e678ca43-5958-4176-9b0a-8cb731124ce8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:42:34.193934 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e678ca43-5958-4176-9b0a-8cb731124ce8 admin admin] REQUEST_METHOD: `POST` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:42:34.194289 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e678ca43-5958-4176-9b0a-8cb731124ce8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:42:34.194642 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e678ca43-5958-4176-9b0a-8cb731124ce8 admin admin] PATH_INFO: `/v3/projects` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:42:34.195425 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e678ca43-5958-4176-9b0a-8cb731124ce8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:42:34.197472 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e678ca43-5958-4176-9b0a-8cb731124ce8 admin admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:42:34.251796 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1262/2486] 10.222.0.23 () {60 vars in 1152 bytes} [Tue May 10 05:42:34 2022] POST /identity/v3/projects => generated 367 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 05:42:34.256669 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04646ddc-8d4b-4efd-95dd-9a2468a06d70 admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:42:34.266696 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04646ddc-8d4b-4efd-95dd-9a2468a06d70 admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:42:34.402387 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475772f2-2666-4669-a3b8-43fa790a9bc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:42:34.403090 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475772f2-2666-4669-a3b8-43fa790a9bc5 admin admin] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:42:34.403375 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475772f2-2666-4669-a3b8-43fa790a9bc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:42:34.403670 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475772f2-2666-4669-a3b8-43fa790a9bc5 admin admin] PATH_INFO: `/v3/users` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:42:34.405383 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475772f2-2666-4669-a3b8-43fa790a9bc5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:42:34.411241 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475772f2-2666-4669-a3b8-43fa790a9bc5 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:42:34.463144 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1225/2487] 10.222.0.23 () {60 vars in 1143 bytes} [Tue May 10 05:42:34 2022] POST /identity/v3/users => generated 284 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 05:42:34.466413 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e678ca43-5958-4176-9b0a-8cb731124ce8 admin admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:42:34.483311 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e678ca43-5958-4176-9b0a-8cb731124ce8 admin admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:42:34.497168 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d9de02-657b-4740-9c67-54e94485ad73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:42:34.498163 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d9de02-657b-4740-9c67-54e94485ad73 admin admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:42:34.498971 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d9de02-657b-4740-9c67-54e94485ad73 admin admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:42:34.502783 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d9de02-657b-4740-9c67-54e94485ad73 admin admin] PATH_INFO: `/v3/roles` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:42:34.504237 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d9de02-657b-4740-9c67-54e94485ad73 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:42:34.507388 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d9de02-657b-4740-9c67-54e94485ad73 admin admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:42:34.522447 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1263/2488] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 10 05:42:34 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 05:42:34.526558 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475772f2-2666-4669-a3b8-43fa790a9bc5 admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:42:34.544156 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475772f2-2666-4669-a3b8-43fa790a9bc5 admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:42:34.559438 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984fe868-0dc4-4779-a4c7-0372ab5e41c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:42:34.560226 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984fe868-0dc4-4779-a4c7-0372ab5e41c4 admin admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:42:34.560733 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984fe868-0dc4-4779-a4c7-0372ab5e41c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:42:34.561550 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984fe868-0dc4-4779-a4c7-0372ab5e41c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:42:34.562298 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984fe868-0dc4-4779-a4c7-0372ab5e41c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:42:34.564356 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984fe868-0dc4-4779-a4c7-0372ab5e41c4 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:42:34.589977 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1226/2489] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 10 05:42:34 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 05:42:34.594996 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d9de02-657b-4740-9c67-54e94485ad73 admin admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:42:34.607337 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d9de02-657b-4740-9c67-54e94485ad73 admin admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:42:34.613794 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b115e0-d962-42ec-9a8d-533b7aa2c10c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:42:34.614813 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b115e0-d962-42ec-9a8d-533b7aa2c10c admin admin] REQUEST_METHOD: `PUT` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:42:34.615180 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b115e0-d962-42ec-9a8d-533b7aa2c10c admin admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:42:34.615531 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b115e0-d962-42ec-9a8d-533b7aa2c10c admin admin] PATH_INFO: `/v3/projects/e60c4c95849d41bc879e475e9536f081/users/0ddfda994ce343718b8aa6f2ddeb8b13/roles/382636e67fc142a2b2f486340d959e11` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:42:34.634477 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b115e0-d962-42ec-9a8d-533b7aa2c10c admin admin] RBAC: Authorizing `identity:create_grant(project_id=e60c4c95849d41bc879e475e9536f081, user_id=0ddfda994ce343718b8aa6f2ddeb8b13, role_id=382636e67fc142a2b2f486340d959e11)` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:42:34.637571 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b115e0-d962-42ec-9a8d-533b7aa2c10c admin admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:42:34.661518 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1264/2490] 10.222.0.23 () {60 vars in 1482 bytes} [Tue May 10 05:42:34 2022] PUT /identity/v3/projects/e60c4c95849d41bc879e475e9536f081/users/0ddfda994ce343718b8aa6f2ddeb8b13/roles/382636e67fc142a2b2f486340d959e11 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 05:42:34.672237 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b540a6-2a30-4930-9080-89b92eb20133 None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:42:34.672779 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b540a6-2a30-4930-9080-89b92eb20133 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:42:34.673232 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b540a6-2a30-4930-9080-89b92eb20133 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:42:34.717855 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-a6b540a6-2a30-4930-9080-89b92eb20133 None None] MFA Rules not processed for user `0ddfda994ce343718b8aa6f2ddeb8b13`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:42:34.719565 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-a6b540a6-2a30-4930-9080-89b92eb20133 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:42:34.797382 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1227/2491] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 10 05:42:34 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 05:42:34.809402 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b115e0-d962-42ec-9a8d-533b7aa2c10c admin admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:42:34.811236 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-21b115e0-d962-42ec-9a8d-533b7aa2c10c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:42:34.872588 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b115e0-d962-42ec-9a8d-533b7aa2c10c admin admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:42:34.877873 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdfcd52-2774-4d91-95fb-d16a5c266153 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355be413675540a39ccb00e1a0722316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f23435f783540199d6dcfd0417c090e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:42:34.878519 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdfcd52-2774-4d91-95fb-d16a5c266153 service cinder] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:42:34.878789 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdfcd52-2774-4d91-95fb-d16a5c266153 service cinder] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:42:34.879232 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdfcd52-2774-4d91-95fb-d16a5c266153 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:42:34.888347 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfdfcd52-2774-4d91-95fb-d16a5c266153 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:42:34.890046 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfdfcd52-2774-4d91-95fb-d16a5c266153 service cinder] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:42:34.901491 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1265/2492] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 10 05:42:34 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 05:42:36.360925 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5247ce-ae77-4620-be69-dce70679ff3e None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:42:36.360925 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5247ce-ae77-4620-be69-dce70679ff3e None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:42:36.360925 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5247ce-ae77-4620-be69-dce70679ff3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:42:36.383292 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-7d5247ce-ae77-4620-be69-dce70679ff3e None None] MFA Rules not processed for user `44ea420780af4d95aa7f2ae86ca31ef1`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:42:36.384485 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-7d5247ce-ae77-4620-be69-dce70679ff3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:42:36.448464 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1228/2493] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 10 05:42:36 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 05:42:36.453118 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdfcd52-2774-4d91-95fb-d16a5c266153 service cinder] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:42:36.454551 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-bfdfcd52-2774-4d91-95fb-d16a5c266153 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:42:36.528703 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdfcd52-2774-4d91-95fb-d16a5c266153 service cinder] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:42:36.533461 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0d5c53-832c-4b8e-b4ff-6afd33490a07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:42:36.534119 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0d5c53-832c-4b8e-b4ff-6afd33490a07 admin admin] REQUEST_METHOD: `POST` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:42:36.534425 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0d5c53-832c-4b8e-b4ff-6afd33490a07 admin admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:42:36.534696 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0d5c53-832c-4b8e-b4ff-6afd33490a07 admin admin] PATH_INFO: `/v3/projects` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:42:36.535447 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0d5c53-832c-4b8e-b4ff-6afd33490a07 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:42:36.537388 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0d5c53-832c-4b8e-b4ff-6afd33490a07 admin admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:42:36.562745 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1266/2494] 10.222.0.23 () {60 vars in 1152 bytes} [Tue May 10 05:42:36 2022] POST /identity/v3/projects => generated 377 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 05:42:36.567521 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5247ce-ae77-4620-be69-dce70679ff3e None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:42:36.580198 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5247ce-ae77-4620-be69-dce70679ff3e None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:42:36.639413 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619ebd76-79e7-4e35-8c2d-769e5ed09476 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:42:36.640256 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619ebd76-79e7-4e35-8c2d-769e5ed09476 admin admin] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:42:36.640542 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619ebd76-79e7-4e35-8c2d-769e5ed09476 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:42:36.640794 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619ebd76-79e7-4e35-8c2d-769e5ed09476 admin admin] PATH_INFO: `/v3/users` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:42:36.641465 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619ebd76-79e7-4e35-8c2d-769e5ed09476 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:42:36.643394 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619ebd76-79e7-4e35-8c2d-769e5ed09476 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:42:36.668678 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1229/2495] 10.222.0.23 () {60 vars in 1143 bytes} [Tue May 10 05:42:36 2022] POST /identity/v3/users => generated 295 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 05:42:36.670053 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0d5c53-832c-4b8e-b4ff-6afd33490a07 admin admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:42:36.690378 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0d5c53-832c-4b8e-b4ff-6afd33490a07 admin admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:42:36.703545 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a889617-144d-437c-a598-5082716e330d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:42:36.703545 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a889617-144d-437c-a598-5082716e330d admin admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:42:36.703545 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a889617-144d-437c-a598-5082716e330d admin admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:42:36.703545 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a889617-144d-437c-a598-5082716e330d admin admin] PATH_INFO: `/v3/roles` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:42:36.703959 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a889617-144d-437c-a598-5082716e330d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:42:36.705468 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a889617-144d-437c-a598-5082716e330d admin admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:42:36.717243 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1267/2496] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 10 05:42:36 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 05:42:36.722735 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619ebd76-79e7-4e35-8c2d-769e5ed09476 admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:42:36.732743 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619ebd76-79e7-4e35-8c2d-769e5ed09476 admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:42:36.739667 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50b8f1c-6bca-44fa-a307-ba155bdb7a5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:42:36.741078 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50b8f1c-6bca-44fa-a307-ba155bdb7a5c admin admin] REQUEST_METHOD: `PUT` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:42:36.741584 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50b8f1c-6bca-44fa-a307-ba155bdb7a5c admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:42:36.742050 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50b8f1c-6bca-44fa-a307-ba155bdb7a5c admin admin] PATH_INFO: `/v3/projects/2bde4e3eceeb417ba375708268136c7e/users/84af0b03184944118da5b40bd6d43043/roles/199ac1dd842441d7913c6ee89d8fbecc` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:42:36.766397 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50b8f1c-6bca-44fa-a307-ba155bdb7a5c admin admin] RBAC: Authorizing `identity:create_grant(project_id=2bde4e3eceeb417ba375708268136c7e, user_id=84af0b03184944118da5b40bd6d43043, role_id=199ac1dd842441d7913c6ee89d8fbecc)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:42:36.769265 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50b8f1c-6bca-44fa-a307-ba155bdb7a5c admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:42:36.784263 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1230/2497] 10.222.0.23 () {60 vars in 1482 bytes} [Tue May 10 05:42:36 2022] PUT /identity/v3/projects/2bde4e3eceeb417ba375708268136c7e/users/84af0b03184944118da5b40bd6d43043/roles/199ac1dd842441d7913c6ee89d8fbecc => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 05:42:36.788439 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a889617-144d-437c-a598-5082716e330d admin admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:42:36.799386 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a889617-144d-437c-a598-5082716e330d admin admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:42:36.859225 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94cea45-99f1-4bae-9889-cfaa99572047 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:42:36.859933 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94cea45-99f1-4bae-9889-cfaa99572047 admin admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:42:36.860233 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94cea45-99f1-4bae-9889-cfaa99572047 admin admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:42:36.860495 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94cea45-99f1-4bae-9889-cfaa99572047 admin admin] PATH_INFO: `/v3/roles` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:42:36.861230 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94cea45-99f1-4bae-9889-cfaa99572047 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:42:36.862921 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94cea45-99f1-4bae-9889-cfaa99572047 admin admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:42:36.874529 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1268/2498] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 10 05:42:36 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 05:42:36.879366 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50b8f1c-6bca-44fa-a307-ba155bdb7a5c admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:42:36.890134 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50b8f1c-6bca-44fa-a307-ba155bdb7a5c admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:42:36.894818 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8d3cb5-4d14-4e3f-8ff7-ee93c4e78f68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:42:36.895967 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8d3cb5-4d14-4e3f-8ff7-ee93c4e78f68 admin admin] REQUEST_METHOD: `PUT` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:42:36.896198 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8d3cb5-4d14-4e3f-8ff7-ee93c4e78f68 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:42:36.896308 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8d3cb5-4d14-4e3f-8ff7-ee93c4e78f68 admin admin] PATH_INFO: `/v3/projects/2bde4e3eceeb417ba375708268136c7e/users/84af0b03184944118da5b40bd6d43043/roles/199ac1dd842441d7913c6ee89d8fbecc` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:42:36.898342 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8d3cb5-4d14-4e3f-8ff7-ee93c4e78f68 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2bde4e3eceeb417ba375708268136c7e, user_id=84af0b03184944118da5b40bd6d43043, role_id=199ac1dd842441d7913c6ee89d8fbecc)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:42:36.901042 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8d3cb5-4d14-4e3f-8ff7-ee93c4e78f68 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:42:36.912002 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1231/2499] 10.222.0.23 () {60 vars in 1482 bytes} [Tue May 10 05:42:36 2022] PUT /identity/v3/projects/2bde4e3eceeb417ba375708268136c7e/users/84af0b03184944118da5b40bd6d43043/roles/199ac1dd842441d7913c6ee89d8fbecc => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 05:42:42.230551 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c2791a-97c0-4f59-a0c2-e0fd1152e1a6 None None] REQUEST_METHOD: `POST` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:42:42.231261 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c2791a-97c0-4f59-a0c2-e0fd1152e1a6 None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:42:42.231261 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c2791a-97c0-4f59-a0c2-e0fd1152e1a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:42:42.261758 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.auth.core [None req-47c2791a-97c0-4f59-a0c2-e0fd1152e1a6 None None] MFA Rules not processed for user `84af0b03184944118da5b40bd6d43043`. Rule list: `[]` (Enabled: `True`). {{(pid=79879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:42:42.263059 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-47c2791a-97c0-4f59-a0c2-e0fd1152e1a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:42:42.343043 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1269/2500] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 10 05:42:42 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 05:42:42.357818 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8d3cb5-4d14-4e3f-8ff7-ee93c4e78f68 admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:42:42.363375 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-2c8d3cb5-4d14-4e3f-8ff7-ee93c4e78f68 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:42:42.443326 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8d3cb5-4d14-4e3f-8ff7-ee93c4e78f68 admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:42:42.450222 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87995d7a-3c09-4adb-a953-dcfb608d4de6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f50f224ca944983aecfde86375473da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f23435f783540199d6dcfd0417c090e', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:42:42.450886 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87995d7a-3c09-4adb-a953-dcfb608d4de6 service nova] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:42:42.451230 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87995d7a-3c09-4adb-a953-dcfb608d4de6 service nova] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:42:42.452362 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87995d7a-3c09-4adb-a953-dcfb608d4de6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:42:42.518528 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87995d7a-3c09-4adb-a953-dcfb608d4de6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:42:42.520044 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87995d7a-3c09-4adb-a953-dcfb608d4de6 service nova] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:42:42.529986 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1232/2501] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 10 05:42:42 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 05:42:47.838009 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c2791a-97c0-4f59-a0c2-e0fd1152e1a6 None None] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:42:47.906930 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c2791a-97c0-4f59-a0c2-e0fd1152e1a6 None None] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:42:47.912920 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c4e8bb-cf8b-4668-a5d7-a887dcef86ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:42:47.914194 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c4e8bb-cf8b-4668-a5d7-a887dcef86ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:42:47.914654 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c4e8bb-cf8b-4668-a5d7-a887dcef86ad admin admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:42:47.915088 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c4e8bb-cf8b-4668-a5d7-a887dcef86ad admin admin] PATH_INFO: `/v3/users/0ddfda994ce343718b8aa6f2ddeb8b13` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:42:47.916395 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c4e8bb-cf8b-4668-a5d7-a887dcef86ad admin admin] RBAC: Authorizing `identity:delete_user(user_id=0ddfda994ce343718b8aa6f2ddeb8b13)` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:42:47.918428 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c4e8bb-cf8b-4668-a5d7-a887dcef86ad admin admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:42:47.977906 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-d9c4e8bb-cf8b-4668-a5d7-a887dcef86ad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0ddfda994ce343718b8aa6f2ddeb8b13'} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:42:47.986243 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-d9c4e8bb-cf8b-4668-a5d7-a887dcef86ad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0ddfda994ce343718b8aa6f2ddeb8b13'} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:42:47.987025 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-d9c4e8bb-cf8b-4668-a5d7-a887dcef86ad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0ddfda994ce343718b8aa6f2ddeb8b13'} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:42:47.998728 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-d9c4e8bb-cf8b-4668-a5d7-a887dcef86ad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0ddfda994ce343718b8aa6f2ddeb8b13'} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:42:48.005489 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-d9c4e8bb-cf8b-4668-a5d7-a887dcef86ad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0ddfda994ce343718b8aa6f2ddeb8b13'} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:42:48.011348 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1270/2502] 10.222.0.23 () {58 vars in 1223 bytes} [Tue May 10 05:42:47 2022] DELETE /identity/v3/users/0ddfda994ce343718b8aa6f2ddeb8b13 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 05:42:48.015973 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc68431f-aa6f-45a3-96f7-b4e99262918e None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:42:48.016441 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc68431f-aa6f-45a3-96f7-b4e99262918e None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:42:48.016555 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc68431f-aa6f-45a3-96f7-b4e99262918e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:42:48.032785 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-bc68431f-aa6f-45a3-96f7-b4e99262918e None None] MFA Rules not processed for user `44883b22532e44049d846938dc2cf423`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:42:48.033961 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-bc68431f-aa6f-45a3-96f7-b4e99262918e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:42:48.097901 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1233/2503] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 10 05:42:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 05:42:48.107411 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c4e8bb-cf8b-4668-a5d7-a887dcef86ad admin admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:42:48.109019 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-d9c4e8bb-cf8b-4668-a5d7-a887dcef86ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:42:48.168774 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c4e8bb-cf8b-4668-a5d7-a887dcef86ad admin admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:42:48.172913 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428ee529-1fb9-4e80-808d-824ec346114a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c8461cfdd9648b8abcaf8d34b7a102a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f23435f783540199d6dcfd0417c090e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:42:48.173565 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428ee529-1fb9-4e80-808d-824ec346114a service neutron] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:42:48.173854 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428ee529-1fb9-4e80-808d-824ec346114a service neutron] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:42:48.174116 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428ee529-1fb9-4e80-808d-824ec346114a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:42:48.183980 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428ee529-1fb9-4e80-808d-824ec346114a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:42:48.185426 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428ee529-1fb9-4e80-808d-824ec346114a service neutron] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:42:48.195136 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1271/2504] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 10 05:42:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 05:42:48.475776 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc68431f-aa6f-45a3-96f7-b4e99262918e None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:42:48.477386 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-bc68431f-aa6f-45a3-96f7-b4e99262918e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:42:48.489609 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc68431f-aa6f-45a3-96f7-b4e99262918e None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:42:48.494957 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394e4890-0344-41e4-93de-95fb3b9610a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:42:48.495875 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394e4890-0344-41e4-93de-95fb3b9610a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:42:48.496157 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394e4890-0344-41e4-93de-95fb3b9610a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:42:48.496461 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394e4890-0344-41e4-93de-95fb3b9610a9 admin admin] PATH_INFO: `/v3/projects/e60c4c95849d41bc879e475e9536f081` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:42:48.497736 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394e4890-0344-41e4-93de-95fb3b9610a9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e60c4c95849d41bc879e475e9536f081)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:42:48.499793 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394e4890-0344-41e4-93de-95fb3b9610a9 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:42:48.548098 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-394e4890-0344-41e4-93de-95fb3b9610a9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e60c4c95849d41bc879e475e9536f081', 'request_id': 'req-394e4890-0344-41e4-93de-95fb3b9610a9'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:42:48.554449 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-394e4890-0344-41e4-93de-95fb3b9610a9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e60c4c95849d41bc879e475e9536f081', 'request_id': 'req-394e4890-0344-41e4-93de-95fb3b9610a9'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:42:48.564384 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-394e4890-0344-41e4-93de-95fb3b9610a9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e60c4c95849d41bc879e475e9536f081', 'request_id': 'req-394e4890-0344-41e4-93de-95fb3b9610a9'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:42:48.574833 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-394e4890-0344-41e4-93de-95fb3b9610a9 admin admin] The token cache is being invalidate because project e60c4c95849d41bc879e475e9536f081 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79880) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 05:42:48.575119 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-394e4890-0344-41e4-93de-95fb3b9610a9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:42:48.575824 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-394e4890-0344-41e4-93de-95fb3b9610a9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:42:48.577437 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1234/2505] 10.222.0.23 () {58 vars in 1232 bytes} [Tue May 10 05:42:48 2022] DELETE /identity/v3/projects/e60c4c95849d41bc879e475e9536f081 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 05:42:48.584395 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e395036-9229-428a-ac98-e30de05b8974 None None] REQUEST_METHOD: `POST` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:42:48.584740 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e395036-9229-428a-ac98-e30de05b8974 None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:42:48.585028 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e395036-9229-428a-ac98-e30de05b8974 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:42:48.606027 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.auth.core [None req-5e395036-9229-428a-ac98-e30de05b8974 None None] MFA Rules not processed for user `44883b22532e44049d846938dc2cf423`. Rule list: `[]` (Enabled: `True`). {{(pid=79879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:42:48.607136 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-5e395036-9229-428a-ac98-e30de05b8974 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:42:48.669415 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1272/2506] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 10 05:42:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 05:42:48.678510 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db834159-b15d-4ac8-9042-cb775dee7fa6 None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:42:48.678910 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db834159-b15d-4ac8-9042-cb775dee7fa6 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:42:48.679292 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db834159-b15d-4ac8-9042-cb775dee7fa6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:42:48.700042 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-db834159-b15d-4ac8-9042-cb775dee7fa6 None None] MFA Rules not processed for user `44883b22532e44049d846938dc2cf423`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:42:48.701241 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-db834159-b15d-4ac8-9042-cb775dee7fa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:42:48.710320 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1235/2507] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 10 05:42:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 05:42:48.714406 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e395036-9229-428a-ac98-e30de05b8974 None None] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:42:48.724066 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e395036-9229-428a-ac98-e30de05b8974 None None] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:42:48.728543 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2563793-fe25-4f67-bb89-737316bf096a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:42:48.729191 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2563793-fe25-4f67-bb89-737316bf096a admin admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:42:48.729465 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2563793-fe25-4f67-bb89-737316bf096a admin admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:42:48.729732 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2563793-fe25-4f67-bb89-737316bf096a admin admin] PATH_INFO: `/v3/domains` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:42:48.730448 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2563793-fe25-4f67-bb89-737316bf096a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:42:48.730748 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2563793-fe25-4f67-bb89-737316bf096a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:42:48.732484 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2563793-fe25-4f67-bb89-737316bf096a admin admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:42:48.744069 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1273/2508] 10.222.0.23 () {58 vars in 1152 bytes} [Tue May 10 05:42:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 05:42:48.748951 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db834159-b15d-4ac8-9042-cb775dee7fa6 None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:42:48.764013 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db834159-b15d-4ac8-9042-cb775dee7fa6 None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:42:48.770202 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8426f1eb-3226-4aa6-b2db-5925bd5c9aaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:42:48.770855 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8426f1eb-3226-4aa6-b2db-5925bd5c9aaa admin admin] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:42:48.771144 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8426f1eb-3226-4aa6-b2db-5925bd5c9aaa admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:42:48.771405 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8426f1eb-3226-4aa6-b2db-5925bd5c9aaa admin admin] PATH_INFO: `/v3/projects` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:42:48.772145 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8426f1eb-3226-4aa6-b2db-5925bd5c9aaa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:42:48.774050 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8426f1eb-3226-4aa6-b2db-5925bd5c9aaa admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:42:48.807070 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1236/2509] 10.222.0.23 () {60 vars in 1152 bytes} [Tue May 10 05:42:48 2022] POST /identity/v3/projects => generated 365 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 05:42:48.808582 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2563793-fe25-4f67-bb89-737316bf096a admin admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:42:48.818985 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2563793-fe25-4f67-bb89-737316bf096a admin admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:42:48.877539 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35c88b4-0929-4adc-8228-d086514a3c2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:42:48.877539 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35c88b4-0929-4adc-8228-d086514a3c2a admin admin] REQUEST_METHOD: `POST` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:42:48.877539 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35c88b4-0929-4adc-8228-d086514a3c2a admin admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:42:48.877539 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35c88b4-0929-4adc-8228-d086514a3c2a admin admin] PATH_INFO: `/v3/users` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:42:48.878627 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35c88b4-0929-4adc-8228-d086514a3c2a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:42:48.879130 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35c88b4-0929-4adc-8228-d086514a3c2a admin admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:42:48.900738 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1274/2510] 10.222.0.23 () {60 vars in 1143 bytes} [Tue May 10 05:42:48 2022] POST /identity/v3/users => generated 283 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 05:42:48.905163 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8426f1eb-3226-4aa6-b2db-5925bd5c9aaa admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:42:48.916672 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8426f1eb-3226-4aa6-b2db-5925bd5c9aaa admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:42:48.921975 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cdac11-682c-4fc0-915e-d071f0d593aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:42:48.922642 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cdac11-682c-4fc0-915e-d071f0d593aa admin admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:42:48.922925 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cdac11-682c-4fc0-915e-d071f0d593aa admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:42:48.923199 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cdac11-682c-4fc0-915e-d071f0d593aa admin admin] PATH_INFO: `/v3/roles` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:42:48.923990 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5cdac11-682c-4fc0-915e-d071f0d593aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:42:48.925595 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5cdac11-682c-4fc0-915e-d071f0d593aa admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:42:48.936356 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1237/2511] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 10 05:42:48 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 05:42:48.940686 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35c88b4-0929-4adc-8228-d086514a3c2a admin admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:42:48.953816 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35c88b4-0929-4adc-8228-d086514a3c2a admin admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:42:48.962649 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46186d86-bc0b-487e-9fc8-9ce2b3534434 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:42:48.963651 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46186d86-bc0b-487e-9fc8-9ce2b3534434 admin admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:42:48.964131 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46186d86-bc0b-487e-9fc8-9ce2b3534434 admin admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:42:48.964563 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46186d86-bc0b-487e-9fc8-9ce2b3534434 admin admin] PATH_INFO: `/v3/roles` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:42:48.965722 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46186d86-bc0b-487e-9fc8-9ce2b3534434 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:42:48.968316 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46186d86-bc0b-487e-9fc8-9ce2b3534434 admin admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:42:48.983841 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1275/2512] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 10 05:42:48 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 05:42:48.988128 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cdac11-682c-4fc0-915e-d071f0d593aa admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:42:48.998262 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cdac11-682c-4fc0-915e-d071f0d593aa admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:42:49.003535 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e56b1d0-039f-41e0-aa79-47bd4fc68f7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:42:49.004467 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e56b1d0-039f-41e0-aa79-47bd4fc68f7c admin admin] REQUEST_METHOD: `PUT` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:42:49.004721 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e56b1d0-039f-41e0-aa79-47bd4fc68f7c admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:42:49.005087 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e56b1d0-039f-41e0-aa79-47bd4fc68f7c admin admin] PATH_INFO: `/v3/projects/4f20d38487f2434eb50ad7e164aa1c7a/users/0c9fc32152884d42965e72da13b4e9c2/roles/382636e67fc142a2b2f486340d959e11` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:42:49.020673 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e56b1d0-039f-41e0-aa79-47bd4fc68f7c admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f20d38487f2434eb50ad7e164aa1c7a, user_id=0c9fc32152884d42965e72da13b4e9c2, role_id=382636e67fc142a2b2f486340d959e11)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:42:49.023411 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e56b1d0-039f-41e0-aa79-47bd4fc68f7c admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:42:49.039079 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1238/2513] 10.222.0.23 () {60 vars in 1482 bytes} [Tue May 10 05:42:48 2022] PUT /identity/v3/projects/4f20d38487f2434eb50ad7e164aa1c7a/users/0c9fc32152884d42965e72da13b4e9c2/roles/382636e67fc142a2b2f486340d959e11 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 05:42:49.051215 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bcab2d-2700-45f1-95db-325209bb9842 None None] REQUEST_METHOD: `POST` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:42:49.051552 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bcab2d-2700-45f1-95db-325209bb9842 None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:42:49.051863 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bcab2d-2700-45f1-95db-325209bb9842 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:42:49.081056 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.auth.core [None req-09bcab2d-2700-45f1-95db-325209bb9842 None None] MFA Rules not processed for user `0c9fc32152884d42965e72da13b4e9c2`. Rule list: `[]` (Enabled: `True`). {{(pid=79879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:42:49.082314 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-09bcab2d-2700-45f1-95db-325209bb9842 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:42:49.149092 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1276/2514] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 10 05:42:49 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 05:42:49.156723 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e56b1d0-039f-41e0-aa79-47bd4fc68f7c admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:42:49.218744 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e56b1d0-039f-41e0-aa79-47bd4fc68f7c admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:42:49.223877 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825d01aa-b255-4994-9bdb-d983bddcd646 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:42:49.224535 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825d01aa-b255-4994-9bdb-d983bddcd646 admin admin] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:42:49.224814 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825d01aa-b255-4994-9bdb-d983bddcd646 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:42:49.225079 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825d01aa-b255-4994-9bdb-d983bddcd646 admin admin] PATH_INFO: `/v3/projects` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:42:49.225765 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825d01aa-b255-4994-9bdb-d983bddcd646 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:42:49.227673 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825d01aa-b255-4994-9bdb-d983bddcd646 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:42:49.258177 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1239/2515] 10.222.0.23 () {60 vars in 1152 bytes} [Tue May 10 05:42:49 2022] POST /identity/v3/projects => generated 365 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 05:42:49.262395 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bcab2d-2700-45f1-95db-325209bb9842 None None] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:42:49.273871 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bcab2d-2700-45f1-95db-325209bb9842 None None] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:42:49.333254 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98cb074-3e6e-4927-bcf4-bc6c27c3d274 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:42:49.333921 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98cb074-3e6e-4927-bcf4-bc6c27c3d274 admin admin] REQUEST_METHOD: `POST` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:42:49.334212 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98cb074-3e6e-4927-bcf4-bc6c27c3d274 admin admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:42:49.334488 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98cb074-3e6e-4927-bcf4-bc6c27c3d274 admin admin] PATH_INFO: `/v3/users` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:42:49.335175 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98cb074-3e6e-4927-bcf4-bc6c27c3d274 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:42:49.337148 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98cb074-3e6e-4927-bcf4-bc6c27c3d274 admin admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:42:49.366334 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1277/2516] 10.222.0.23 () {60 vars in 1143 bytes} [Tue May 10 05:42:49 2022] POST /identity/v3/users => generated 289 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 05:42:49.371607 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825d01aa-b255-4994-9bdb-d983bddcd646 admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:42:49.382462 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825d01aa-b255-4994-9bdb-d983bddcd646 admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:42:49.387111 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08eacf43-775e-47b7-8d55-5b16b7b6031f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:42:49.387783 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08eacf43-775e-47b7-8d55-5b16b7b6031f admin admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:42:49.388060 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08eacf43-775e-47b7-8d55-5b16b7b6031f admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:42:49.388338 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08eacf43-775e-47b7-8d55-5b16b7b6031f admin admin] PATH_INFO: `/v3/roles` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:42:49.389088 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08eacf43-775e-47b7-8d55-5b16b7b6031f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:42:49.390690 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08eacf43-775e-47b7-8d55-5b16b7b6031f admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:42:49.401951 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1240/2517] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 10 05:42:49 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 05:42:49.406479 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98cb074-3e6e-4927-bcf4-bc6c27c3d274 admin admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:42:49.416831 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98cb074-3e6e-4927-bcf4-bc6c27c3d274 admin admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:42:49.421970 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad9a8a8-ef94-49eb-a93b-4ae01b694dbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:42:49.422847 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad9a8a8-ef94-49eb-a93b-4ae01b694dbb admin admin] REQUEST_METHOD: `PUT` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:42:49.423127 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad9a8a8-ef94-49eb-a93b-4ae01b694dbb admin admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:42:49.423403 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad9a8a8-ef94-49eb-a93b-4ae01b694dbb admin admin] PATH_INFO: `/v3/projects/c9c21f05594b40ccaca78058060b00e0/users/de382987ba4f4e06a5e6fb6d97f4cedf/roles/199ac1dd842441d7913c6ee89d8fbecc` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:42:49.439185 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad9a8a8-ef94-49eb-a93b-4ae01b694dbb admin admin] RBAC: Authorizing `identity:create_grant(project_id=c9c21f05594b40ccaca78058060b00e0, user_id=de382987ba4f4e06a5e6fb6d97f4cedf, role_id=199ac1dd842441d7913c6ee89d8fbecc)` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:42:49.441866 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad9a8a8-ef94-49eb-a93b-4ae01b694dbb admin admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:42:49.462462 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1278/2518] 10.222.0.23 () {60 vars in 1482 bytes} [Tue May 10 05:42:49 2022] PUT /identity/v3/projects/c9c21f05594b40ccaca78058060b00e0/users/de382987ba4f4e06a5e6fb6d97f4cedf/roles/199ac1dd842441d7913c6ee89d8fbecc => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 05:42:49.466883 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08eacf43-775e-47b7-8d55-5b16b7b6031f admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:42:49.479219 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08eacf43-775e-47b7-8d55-5b16b7b6031f admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:42:49.541595 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ec56ae-9ef5-4a71-93b1-e9dd8d84acea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:42:49.542263 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ec56ae-9ef5-4a71-93b1-e9dd8d84acea admin admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:42:49.542539 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ec56ae-9ef5-4a71-93b1-e9dd8d84acea admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:42:49.542815 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ec56ae-9ef5-4a71-93b1-e9dd8d84acea admin admin] PATH_INFO: `/v3/roles` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:42:49.543541 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ec56ae-9ef5-4a71-93b1-e9dd8d84acea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:42:49.545280 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ec56ae-9ef5-4a71-93b1-e9dd8d84acea admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:42:49.555390 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1241/2519] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 10 05:42:49 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 05:42:49.560498 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad9a8a8-ef94-49eb-a93b-4ae01b694dbb admin admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:42:49.571291 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad9a8a8-ef94-49eb-a93b-4ae01b694dbb admin admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:42:49.576642 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71207e2-ba6b-4746-8ddc-e925b3024c78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:42:49.577534 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71207e2-ba6b-4746-8ddc-e925b3024c78 admin admin] REQUEST_METHOD: `PUT` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:42:49.577838 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71207e2-ba6b-4746-8ddc-e925b3024c78 admin admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:42:49.578111 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71207e2-ba6b-4746-8ddc-e925b3024c78 admin admin] PATH_INFO: `/v3/projects/c9c21f05594b40ccaca78058060b00e0/users/de382987ba4f4e06a5e6fb6d97f4cedf/roles/199ac1dd842441d7913c6ee89d8fbecc` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:42:49.580235 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71207e2-ba6b-4746-8ddc-e925b3024c78 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c9c21f05594b40ccaca78058060b00e0, user_id=de382987ba4f4e06a5e6fb6d97f4cedf, role_id=199ac1dd842441d7913c6ee89d8fbecc)` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:42:49.582882 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71207e2-ba6b-4746-8ddc-e925b3024c78 admin admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:42:49.593341 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1279/2520] 10.222.0.23 () {60 vars in 1482 bytes} [Tue May 10 05:42:49 2022] PUT /identity/v3/projects/c9c21f05594b40ccaca78058060b00e0/users/de382987ba4f4e06a5e6fb6d97f4cedf/roles/199ac1dd842441d7913c6ee89d8fbecc => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 05:42:49.603916 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f73463-4aee-48f4-bef3-4a41904175ff None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:42:49.604202 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f73463-4aee-48f4-bef3-4a41904175ff None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:42:49.604477 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f73463-4aee-48f4-bef3-4a41904175ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:42:49.635399 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-a5f73463-4aee-48f4-bef3-4a41904175ff None None] MFA Rules not processed for user `de382987ba4f4e06a5e6fb6d97f4cedf`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:42:49.636551 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-a5f73463-4aee-48f4-bef3-4a41904175ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:42:49.715803 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1242/2521] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 10 05:42:49 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 05:42:49.729437 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71207e2-ba6b-4746-8ddc-e925b3024c78 admin admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:42:49.731484 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-c71207e2-ba6b-4746-8ddc-e925b3024c78 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:42:49.802052 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71207e2-ba6b-4746-8ddc-e925b3024c78 admin admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:42:49.807136 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf970b2-d940-4304-a788-eb83e80a768c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355be413675540a39ccb00e1a0722316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f23435f783540199d6dcfd0417c090e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:42:49.807823 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf970b2-d940-4304-a788-eb83e80a768c service cinder] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:42:49.808104 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf970b2-d940-4304-a788-eb83e80a768c service cinder] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:42:49.808374 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf970b2-d940-4304-a788-eb83e80a768c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:42:49.828456 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf970b2-d940-4304-a788-eb83e80a768c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:42:49.829917 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf970b2-d940-4304-a788-eb83e80a768c service cinder] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:42:49.840121 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1280/2522] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 10 05:42:49 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 05:42:50.264848 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f73463-4aee-48f4-bef3-4a41904175ff None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:42:50.325703 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f73463-4aee-48f4-bef3-4a41904175ff None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:42:50.331133 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384136f4-ff4b-4f5f-89c8-ab5c7df7d88e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:42:50.332065 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384136f4-ff4b-4f5f-89c8-ab5c7df7d88e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:42:50.332354 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384136f4-ff4b-4f5f-89c8-ab5c7df7d88e admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:42:50.332631 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384136f4-ff4b-4f5f-89c8-ab5c7df7d88e admin admin] PATH_INFO: `/v3/users/0c9fc32152884d42965e72da13b4e9c2` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:42:50.333953 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384136f4-ff4b-4f5f-89c8-ab5c7df7d88e admin admin] RBAC: Authorizing `identity:delete_user(user_id=0c9fc32152884d42965e72da13b4e9c2)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:42:50.336161 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384136f4-ff4b-4f5f-89c8-ab5c7df7d88e admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:42:50.392661 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-384136f4-ff4b-4f5f-89c8-ab5c7df7d88e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0c9fc32152884d42965e72da13b4e9c2'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:42:50.405071 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-384136f4-ff4b-4f5f-89c8-ab5c7df7d88e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0c9fc32152884d42965e72da13b4e9c2'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:42:50.405680 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-384136f4-ff4b-4f5f-89c8-ab5c7df7d88e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0c9fc32152884d42965e72da13b4e9c2'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:42:50.412478 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-384136f4-ff4b-4f5f-89c8-ab5c7df7d88e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0c9fc32152884d42965e72da13b4e9c2'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:42:50.413271 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-384136f4-ff4b-4f5f-89c8-ab5c7df7d88e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0c9fc32152884d42965e72da13b4e9c2'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:42:50.428631 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1243/2523] 10.222.0.23 () {58 vars in 1223 bytes} [Tue May 10 05:42:50 2022] DELETE /identity/v3/users/0c9fc32152884d42965e72da13b4e9c2 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 05:42:50.433645 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d61b876-c47a-4943-937e-566112e65743 None None] REQUEST_METHOD: `POST` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:42:50.434225 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d61b876-c47a-4943-937e-566112e65743 None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:42:50.434225 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d61b876-c47a-4943-937e-566112e65743 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:42:50.454390 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.auth.core [None req-3d61b876-c47a-4943-937e-566112e65743 None None] MFA Rules not processed for user `44883b22532e44049d846938dc2cf423`. Rule list: `[]` (Enabled: `True`). {{(pid=79879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:42:50.455642 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-3d61b876-c47a-4943-937e-566112e65743 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:42:50.521047 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1281/2524] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 10 05:42:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 05:42:50.531113 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384136f4-ff4b-4f5f-89c8-ab5c7df7d88e admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:42:50.532674 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-384136f4-ff4b-4f5f-89c8-ab5c7df7d88e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:42:50.589275 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384136f4-ff4b-4f5f-89c8-ab5c7df7d88e admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:42:50.593258 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2cac0f-c734-471c-9247-896931da330a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c8461cfdd9648b8abcaf8d34b7a102a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f23435f783540199d6dcfd0417c090e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:42:50.593873 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2cac0f-c734-471c-9247-896931da330a service neutron] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:42:50.594147 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2cac0f-c734-471c-9247-896931da330a service neutron] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:42:50.594421 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2cac0f-c734-471c-9247-896931da330a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:42:50.603730 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2cac0f-c734-471c-9247-896931da330a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:42:50.605157 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2cac0f-c734-471c-9247-896931da330a service neutron] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:42:50.615287 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1244/2525] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 10 05:42:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 05:42:50.927983 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d61b876-c47a-4943-937e-566112e65743 None None] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:42:50.929436 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-3d61b876-c47a-4943-937e-566112e65743 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:42:50.941655 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d61b876-c47a-4943-937e-566112e65743 None None] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:42:50.946755 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2eaa556-485e-4f06-a5fb-cc4d0b8afca0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:42:50.953829 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2eaa556-485e-4f06-a5fb-cc4d0b8afca0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:42:50.954157 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2eaa556-485e-4f06-a5fb-cc4d0b8afca0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:42:50.954384 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2eaa556-485e-4f06-a5fb-cc4d0b8afca0 admin admin] PATH_INFO: `/v3/projects/4f20d38487f2434eb50ad7e164aa1c7a` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:42:50.955889 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2eaa556-485e-4f06-a5fb-cc4d0b8afca0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4f20d38487f2434eb50ad7e164aa1c7a)` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:42:50.957806 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2eaa556-485e-4f06-a5fb-cc4d0b8afca0 admin admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:42:51.005304 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-e2eaa556-485e-4f06-a5fb-cc4d0b8afca0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4f20d38487f2434eb50ad7e164aa1c7a', 'request_id': 'req-e2eaa556-485e-4f06-a5fb-cc4d0b8afca0'} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:42:51.011257 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-e2eaa556-485e-4f06-a5fb-cc4d0b8afca0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4f20d38487f2434eb50ad7e164aa1c7a', 'request_id': 'req-e2eaa556-485e-4f06-a5fb-cc4d0b8afca0'} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:42:51.019817 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-e2eaa556-485e-4f06-a5fb-cc4d0b8afca0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4f20d38487f2434eb50ad7e164aa1c7a', 'request_id': 'req-e2eaa556-485e-4f06-a5fb-cc4d0b8afca0'} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:42:51.030714 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-e2eaa556-485e-4f06-a5fb-cc4d0b8afca0 admin admin] The token cache is being invalidate because project 4f20d38487f2434eb50ad7e164aa1c7a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79879) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 05:42:51.031001 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-e2eaa556-485e-4f06-a5fb-cc4d0b8afca0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:42:51.031872 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-e2eaa556-485e-4f06-a5fb-cc4d0b8afca0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:42:51.033685 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1282/2526] 10.222.0.23 () {58 vars in 1232 bytes} [Tue May 10 05:42:50 2022] DELETE /identity/v3/projects/4f20d38487f2434eb50ad7e164aa1c7a => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 05:42:51.037944 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2cac0f-c734-471c-9247-896931da330a service neutron] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:42:51.048115 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2cac0f-c734-471c-9247-896931da330a service neutron] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:42:51.111679 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda1f015-adcf-4147-9566-47df0c3ee6ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:42:51.112946 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda1f015-adcf-4147-9566-47df0c3ee6ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:42:51.113313 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda1f015-adcf-4147-9566-47df0c3ee6ae admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:42:51.113678 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda1f015-adcf-4147-9566-47df0c3ee6ae admin admin] PATH_INFO: `/v3/users/de382987ba4f4e06a5e6fb6d97f4cedf` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:42:51.115778 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda1f015-adcf-4147-9566-47df0c3ee6ae admin admin] RBAC: Authorizing `identity:delete_user(user_id=de382987ba4f4e06a5e6fb6d97f4cedf)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:42:51.118750 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda1f015-adcf-4147-9566-47df0c3ee6ae admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:42:51.175736 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-fda1f015-adcf-4147-9566-47df0c3ee6ae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'de382987ba4f4e06a5e6fb6d97f4cedf'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:42:51.188309 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-fda1f015-adcf-4147-9566-47df0c3ee6ae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'de382987ba4f4e06a5e6fb6d97f4cedf'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:42:51.192419 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-fda1f015-adcf-4147-9566-47df0c3ee6ae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'de382987ba4f4e06a5e6fb6d97f4cedf'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:42:51.200473 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-fda1f015-adcf-4147-9566-47df0c3ee6ae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'de382987ba4f4e06a5e6fb6d97f4cedf'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:42:51.201302 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-fda1f015-adcf-4147-9566-47df0c3ee6ae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'de382987ba4f4e06a5e6fb6d97f4cedf'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:42:51.215807 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1245/2527] 10.222.0.23 () {58 vars in 1223 bytes} [Tue May 10 05:42:51 2022] DELETE /identity/v3/users/de382987ba4f4e06a5e6fb6d97f4cedf => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 05:42:51.527824 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2eaa556-485e-4f06-a5fb-cc4d0b8afca0 admin admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:42:51.529452 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-e2eaa556-485e-4f06-a5fb-cc4d0b8afca0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:42:51.542295 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2eaa556-485e-4f06-a5fb-cc4d0b8afca0 admin admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:42:51.607410 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cfd4cb-e932-439d-a396-2b62349f73c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:42:51.608315 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cfd4cb-e932-439d-a396-2b62349f73c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:42:51.608598 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cfd4cb-e932-439d-a396-2b62349f73c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:42:51.608877 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cfd4cb-e932-439d-a396-2b62349f73c2 admin admin] PATH_INFO: `/v3/projects/c9c21f05594b40ccaca78058060b00e0` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:42:51.610144 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54cfd4cb-e932-439d-a396-2b62349f73c2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c9c21f05594b40ccaca78058060b00e0)` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:42:51.612097 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54cfd4cb-e932-439d-a396-2b62349f73c2 admin admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:42:51.660444 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-54cfd4cb-e932-439d-a396-2b62349f73c2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c9c21f05594b40ccaca78058060b00e0', 'request_id': 'req-54cfd4cb-e932-439d-a396-2b62349f73c2'} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:42:51.666318 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-54cfd4cb-e932-439d-a396-2b62349f73c2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c9c21f05594b40ccaca78058060b00e0', 'request_id': 'req-54cfd4cb-e932-439d-a396-2b62349f73c2'} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:42:51.674502 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-54cfd4cb-e932-439d-a396-2b62349f73c2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c9c21f05594b40ccaca78058060b00e0', 'request_id': 'req-54cfd4cb-e932-439d-a396-2b62349f73c2'} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:42:51.684556 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-54cfd4cb-e932-439d-a396-2b62349f73c2 admin admin] The token cache is being invalidate because project c9c21f05594b40ccaca78058060b00e0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79879) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 05:42:51.684842 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-54cfd4cb-e932-439d-a396-2b62349f73c2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:42:51.685601 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-54cfd4cb-e932-439d-a396-2b62349f73c2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:42:51.687228 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1283/2528] 10.222.0.23 () {58 vars in 1232 bytes} [Tue May 10 05:42:51 2022] DELETE /identity/v3/projects/c9c21f05594b40ccaca78058060b00e0 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 05:42:51.693171 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678ef580-ae24-4eac-8e90-fdf965bb7252 None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:42:51.693648 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678ef580-ae24-4eac-8e90-fdf965bb7252 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:42:51.693745 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678ef580-ae24-4eac-8e90-fdf965bb7252 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:42:51.711333 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-678ef580-ae24-4eac-8e90-fdf965bb7252 None None] MFA Rules not processed for user `44883b22532e44049d846938dc2cf423`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:42:51.712533 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-678ef580-ae24-4eac-8e90-fdf965bb7252 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:42:51.772447 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1246/2529] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 10 05:42:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 05:42:51.783726 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4711e34-4406-42e6-82d3-314f773f71a0 None None] REQUEST_METHOD: `POST` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:42:51.784015 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4711e34-4406-42e6-82d3-314f773f71a0 None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:42:51.784290 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4711e34-4406-42e6-82d3-314f773f71a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:42:51.806088 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.auth.core [None req-d4711e34-4406-42e6-82d3-314f773f71a0 None None] MFA Rules not processed for user `44883b22532e44049d846938dc2cf423`. Rule list: `[]` (Enabled: `True`). {{(pid=79879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:42:51.807464 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-d4711e34-4406-42e6-82d3-314f773f71a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:42:51.821543 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1284/2530] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 10 05:42:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 05:42:51.827340 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678ef580-ae24-4eac-8e90-fdf965bb7252 None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:42:51.837252 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678ef580-ae24-4eac-8e90-fdf965bb7252 None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:42:51.842299 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2e97e6-2055-4cb9-b9a7-54a29471dcd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:42:51.842953 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2e97e6-2055-4cb9-b9a7-54a29471dcd8 admin admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:42:51.843342 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2e97e6-2055-4cb9-b9a7-54a29471dcd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:42:51.843601 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2e97e6-2055-4cb9-b9a7-54a29471dcd8 admin admin] PATH_INFO: `/v3/domains` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:42:51.844350 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2e97e6-2055-4cb9-b9a7-54a29471dcd8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:42:51.844654 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2e97e6-2055-4cb9-b9a7-54a29471dcd8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:42:51.846250 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2e97e6-2055-4cb9-b9a7-54a29471dcd8 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:42:51.860095 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1247/2531] 10.222.0.23 () {58 vars in 1152 bytes} [Tue May 10 05:42:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 05:42:51.864925 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4711e34-4406-42e6-82d3-314f773f71a0 None None] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:42:51.879474 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4711e34-4406-42e6-82d3-314f773f71a0 None None] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:42:51.886302 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab1f514-9d84-45fc-9bf4-d06fbda2c936 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:42:51.886962 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab1f514-9d84-45fc-9bf4-d06fbda2c936 admin admin] REQUEST_METHOD: `POST` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:42:51.887242 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab1f514-9d84-45fc-9bf4-d06fbda2c936 admin admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:42:51.887519 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab1f514-9d84-45fc-9bf4-d06fbda2c936 admin admin] PATH_INFO: `/v3/projects` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:42:51.888290 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab1f514-9d84-45fc-9bf4-d06fbda2c936 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:42:51.890273 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab1f514-9d84-45fc-9bf4-d06fbda2c936 admin admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:42:51.919741 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1285/2532] 10.222.0.23 () {60 vars in 1152 bytes} [Tue May 10 05:42:51 2022] POST /identity/v3/projects => generated 387 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 05:42:51.925663 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2e97e6-2055-4cb9-b9a7-54a29471dcd8 admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:42:51.937056 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2e97e6-2055-4cb9-b9a7-54a29471dcd8 admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:42:51.993537 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c1c1d8-9efa-46f1-8e1b-878fc0d51b34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:42:51.994203 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c1c1d8-9efa-46f1-8e1b-878fc0d51b34 admin admin] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:42:51.994481 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c1c1d8-9efa-46f1-8e1b-878fc0d51b34 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:42:51.994748 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c1c1d8-9efa-46f1-8e1b-878fc0d51b34 admin admin] PATH_INFO: `/v3/users` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:42:51.995431 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c1c1d8-9efa-46f1-8e1b-878fc0d51b34 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:42:51.997333 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c1c1d8-9efa-46f1-8e1b-878fc0d51b34 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:42:52.022670 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1248/2533] 10.222.0.23 () {60 vars in 1143 bytes} [Tue May 10 05:42:51 2022] POST /identity/v3/users => generated 294 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 05:42:52.023847 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab1f514-9d84-45fc-9bf4-d06fbda2c936 admin admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:42:52.034015 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab1f514-9d84-45fc-9bf4-d06fbda2c936 admin admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:42:52.039067 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbe6504-a901-481b-bb19-7ef4b7bbaa71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:42:52.039773 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbe6504-a901-481b-bb19-7ef4b7bbaa71 admin admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:42:52.040056 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbe6504-a901-481b-bb19-7ef4b7bbaa71 admin admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:42:52.040357 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbe6504-a901-481b-bb19-7ef4b7bbaa71 admin admin] PATH_INFO: `/v3/roles` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:42:52.041097 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbe6504-a901-481b-bb19-7ef4b7bbaa71 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:42:52.042705 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbe6504-a901-481b-bb19-7ef4b7bbaa71 admin admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:42:52.053245 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1286/2534] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 10 05:42:52 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 05:42:52.057118 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c1c1d8-9efa-46f1-8e1b-878fc0d51b34 admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:42:52.067293 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c1c1d8-9efa-46f1-8e1b-878fc0d51b34 admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:42:52.072747 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c64de1-9966-431a-b96d-e14fd96a660b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:42:52.073475 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c64de1-9966-431a-b96d-e14fd96a660b admin admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:42:52.073819 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c64de1-9966-431a-b96d-e14fd96a660b admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:42:52.074154 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c64de1-9966-431a-b96d-e14fd96a660b admin admin] PATH_INFO: `/v3/roles` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:42:52.074879 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c64de1-9966-431a-b96d-e14fd96a660b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:42:52.076717 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c64de1-9966-431a-b96d-e14fd96a660b admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:42:52.088504 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1249/2535] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 10 05:42:52 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 05:42:52.092884 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbe6504-a901-481b-bb19-7ef4b7bbaa71 admin admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:42:52.103217 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbe6504-a901-481b-bb19-7ef4b7bbaa71 admin admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:42:52.108819 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdcba84-8dc3-4037-9cf7-898b7cca968c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:42:52.109707 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdcba84-8dc3-4037-9cf7-898b7cca968c admin admin] REQUEST_METHOD: `PUT` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:42:52.110017 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdcba84-8dc3-4037-9cf7-898b7cca968c admin admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:42:52.110243 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdcba84-8dc3-4037-9cf7-898b7cca968c admin admin] PATH_INFO: `/v3/projects/093363141dc5437db5f67d25663d1cf4/users/814f9d10200d463c80b45efbc6503e94/roles/382636e67fc142a2b2f486340d959e11` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:42:52.126005 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cdcba84-8dc3-4037-9cf7-898b7cca968c admin admin] RBAC: Authorizing `identity:create_grant(project_id=093363141dc5437db5f67d25663d1cf4, user_id=814f9d10200d463c80b45efbc6503e94, role_id=382636e67fc142a2b2f486340d959e11)` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:42:52.129052 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cdcba84-8dc3-4037-9cf7-898b7cca968c admin admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:42:52.143001 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1287/2536] 10.222.0.23 () {60 vars in 1482 bytes} [Tue May 10 05:42:52 2022] PUT /identity/v3/projects/093363141dc5437db5f67d25663d1cf4/users/814f9d10200d463c80b45efbc6503e94/roles/382636e67fc142a2b2f486340d959e11 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 05:42:52.154699 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b390e9-1214-4a6b-bdcf-740b1e988f67 None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:42:52.154989 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b390e9-1214-4a6b-bdcf-740b1e988f67 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:42:52.155269 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b390e9-1214-4a6b-bdcf-740b1e988f67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:42:52.183463 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-92b390e9-1214-4a6b-bdcf-740b1e988f67 None None] MFA Rules not processed for user `814f9d10200d463c80b45efbc6503e94`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:42:52.184693 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-92b390e9-1214-4a6b-bdcf-740b1e988f67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:42:52.260970 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1250/2537] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 10 05:42:52 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 05:42:52.265753 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdcba84-8dc3-4037-9cf7-898b7cca968c admin admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:42:52.330926 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdcba84-8dc3-4037-9cf7-898b7cca968c admin admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:42:52.336036 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8950761-dedf-407a-8448-0f25fd02b163 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:42:52.336778 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8950761-dedf-407a-8448-0f25fd02b163 admin admin] REQUEST_METHOD: `POST` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:42:52.337106 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8950761-dedf-407a-8448-0f25fd02b163 admin admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:42:52.337401 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8950761-dedf-407a-8448-0f25fd02b163 admin admin] PATH_INFO: `/v3/projects` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:42:52.338130 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8950761-dedf-407a-8448-0f25fd02b163 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:42:52.340092 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8950761-dedf-407a-8448-0f25fd02b163 admin admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:42:52.377829 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1288/2538] 10.222.0.23 () {60 vars in 1152 bytes} [Tue May 10 05:42:52 2022] POST /identity/v3/projects => generated 385 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 05:42:52.379062 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b390e9-1214-4a6b-bdcf-740b1e988f67 None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:42:52.389735 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b390e9-1214-4a6b-bdcf-740b1e988f67 None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:42:52.450824 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687272b9-279a-42b0-94a1-65b7eedb4a2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:42:52.451504 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687272b9-279a-42b0-94a1-65b7eedb4a2f admin admin] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:42:52.451827 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687272b9-279a-42b0-94a1-65b7eedb4a2f admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:42:52.452086 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687272b9-279a-42b0-94a1-65b7eedb4a2f admin admin] PATH_INFO: `/v3/users` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:42:52.452787 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687272b9-279a-42b0-94a1-65b7eedb4a2f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:42:52.454725 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687272b9-279a-42b0-94a1-65b7eedb4a2f admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:42:52.481666 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1251/2539] 10.222.0.23 () {60 vars in 1143 bytes} [Tue May 10 05:42:52 2022] POST /identity/v3/users => generated 299 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 05:42:52.485791 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8950761-dedf-407a-8448-0f25fd02b163 admin admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:42:52.495968 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8950761-dedf-407a-8448-0f25fd02b163 admin admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:42:52.500693 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c093e882-5c20-4b0e-819c-6dc1b6ca0a09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:42:52.501350 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c093e882-5c20-4b0e-819c-6dc1b6ca0a09 admin admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:42:52.501639 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c093e882-5c20-4b0e-819c-6dc1b6ca0a09 admin admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:42:52.502228 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c093e882-5c20-4b0e-819c-6dc1b6ca0a09 admin admin] PATH_INFO: `/v3/roles` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:42:52.502960 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c093e882-5c20-4b0e-819c-6dc1b6ca0a09 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:42:52.504584 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c093e882-5c20-4b0e-819c-6dc1b6ca0a09 admin admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:42:52.514782 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1289/2540] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 10 05:42:52 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 05:42:52.518924 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687272b9-279a-42b0-94a1-65b7eedb4a2f admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:42:52.531226 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687272b9-279a-42b0-94a1-65b7eedb4a2f admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:42:52.536627 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2732ee-faa5-477e-9b3e-caa1ca9906e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:42:52.537530 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2732ee-faa5-477e-9b3e-caa1ca9906e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:42:52.537810 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2732ee-faa5-477e-9b3e-caa1ca9906e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:42:52.538135 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2732ee-faa5-477e-9b3e-caa1ca9906e0 admin admin] PATH_INFO: `/v3/projects/5702a6b541ed41f98d5256c84c0f47f8/users/b9a734da2f3b40aba781432f0eb79d8d/roles/199ac1dd842441d7913c6ee89d8fbecc` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:42:52.555082 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2732ee-faa5-477e-9b3e-caa1ca9906e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5702a6b541ed41f98d5256c84c0f47f8, user_id=b9a734da2f3b40aba781432f0eb79d8d, role_id=199ac1dd842441d7913c6ee89d8fbecc)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:42:52.557767 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2732ee-faa5-477e-9b3e-caa1ca9906e0 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:42:52.572219 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1252/2541] 10.222.0.23 () {60 vars in 1482 bytes} [Tue May 10 05:42:52 2022] PUT /identity/v3/projects/5702a6b541ed41f98d5256c84c0f47f8/users/b9a734da2f3b40aba781432f0eb79d8d/roles/199ac1dd842441d7913c6ee89d8fbecc => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 05:42:52.576386 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c093e882-5c20-4b0e-819c-6dc1b6ca0a09 admin admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:42:52.587285 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c093e882-5c20-4b0e-819c-6dc1b6ca0a09 admin admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:42:52.645296 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa460743-25e9-4798-b9e0-cae1683a7c3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:42:52.646048 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa460743-25e9-4798-b9e0-cae1683a7c3a admin admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:42:52.646336 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa460743-25e9-4798-b9e0-cae1683a7c3a admin admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:42:52.646660 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa460743-25e9-4798-b9e0-cae1683a7c3a admin admin] PATH_INFO: `/v3/roles` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:42:52.647418 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa460743-25e9-4798-b9e0-cae1683a7c3a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:42:52.649118 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa460743-25e9-4798-b9e0-cae1683a7c3a admin admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:42:52.660148 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1290/2542] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 10 05:42:52 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 05:42:52.664660 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2732ee-faa5-477e-9b3e-caa1ca9906e0 admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:42:52.675930 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2732ee-faa5-477e-9b3e-caa1ca9906e0 admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:42:52.681008 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5343787-0f63-4a19-8f29-567d5ac5d069 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:42:52.681891 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5343787-0f63-4a19-8f29-567d5ac5d069 admin admin] REQUEST_METHOD: `PUT` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:42:52.682205 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5343787-0f63-4a19-8f29-567d5ac5d069 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:42:52.682481 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5343787-0f63-4a19-8f29-567d5ac5d069 admin admin] PATH_INFO: `/v3/projects/5702a6b541ed41f98d5256c84c0f47f8/users/b9a734da2f3b40aba781432f0eb79d8d/roles/199ac1dd842441d7913c6ee89d8fbecc` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:42:52.684535 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5343787-0f63-4a19-8f29-567d5ac5d069 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5702a6b541ed41f98d5256c84c0f47f8, user_id=b9a734da2f3b40aba781432f0eb79d8d, role_id=199ac1dd842441d7913c6ee89d8fbecc)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:42:52.687163 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5343787-0f63-4a19-8f29-567d5ac5d069 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:42:52.697492 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1253/2543] 10.222.0.23 () {60 vars in 1482 bytes} [Tue May 10 05:42:52 2022] PUT /identity/v3/projects/5702a6b541ed41f98d5256c84c0f47f8/users/b9a734da2f3b40aba781432f0eb79d8d/roles/199ac1dd842441d7913c6ee89d8fbecc => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 05:42:52.708222 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece6bd9b-4d16-4333-9cfa-3dc98477c00f None None] REQUEST_METHOD: `POST` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:42:52.708476 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece6bd9b-4d16-4333-9cfa-3dc98477c00f None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:42:52.708776 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece6bd9b-4d16-4333-9cfa-3dc98477c00f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:42:52.737359 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.auth.core [None req-ece6bd9b-4d16-4333-9cfa-3dc98477c00f None None] MFA Rules not processed for user `b9a734da2f3b40aba781432f0eb79d8d`. Rule list: `[]` (Enabled: `True`). {{(pid=79879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:42:52.738549 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-ece6bd9b-4d16-4333-9cfa-3dc98477c00f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:42:52.810188 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1291/2544] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 10 05:42:52 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 05:42:52.823308 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5343787-0f63-4a19-8f29-567d5ac5d069 admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:42:52.825332 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-d5343787-0f63-4a19-8f29-567d5ac5d069 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:42:52.895116 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5343787-0f63-4a19-8f29-567d5ac5d069 admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:42:52.901379 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f70c30e-50e1-4550-9537-6659a5be44fa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355be413675540a39ccb00e1a0722316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f23435f783540199d6dcfd0417c090e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:42:52.902430 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f70c30e-50e1-4550-9537-6659a5be44fa service cinder] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:42:52.902791 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f70c30e-50e1-4550-9537-6659a5be44fa service cinder] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:42:52.903176 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f70c30e-50e1-4550-9537-6659a5be44fa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:42:52.914269 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f70c30e-50e1-4550-9537-6659a5be44fa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:42:52.915756 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f70c30e-50e1-4550-9537-6659a5be44fa service cinder] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:42:52.925410 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1254/2545] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 10 05:42:52 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 05:42:53.495151 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece6bd9b-4d16-4333-9cfa-3dc98477c00f None None] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:42:53.567265 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece6bd9b-4d16-4333-9cfa-3dc98477c00f None None] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:42:53.573343 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0819bd86-52f1-4cb6-966e-ca184dd56482 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:42:53.574229 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0819bd86-52f1-4cb6-966e-ca184dd56482 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:42:53.574519 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0819bd86-52f1-4cb6-966e-ca184dd56482 admin admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:42:53.574791 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0819bd86-52f1-4cb6-966e-ca184dd56482 admin admin] PATH_INFO: `/v3/users/814f9d10200d463c80b45efbc6503e94` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:42:53.576178 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0819bd86-52f1-4cb6-966e-ca184dd56482 admin admin] RBAC: Authorizing `identity:delete_user(user_id=814f9d10200d463c80b45efbc6503e94)` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:42:53.581011 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0819bd86-52f1-4cb6-966e-ca184dd56482 admin admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:42:53.625411 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-0819bd86-52f1-4cb6-966e-ca184dd56482 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '814f9d10200d463c80b45efbc6503e94'} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:42:53.633260 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-0819bd86-52f1-4cb6-966e-ca184dd56482 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '814f9d10200d463c80b45efbc6503e94'} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:42:53.633966 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-0819bd86-52f1-4cb6-966e-ca184dd56482 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '814f9d10200d463c80b45efbc6503e94'} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:42:53.646794 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-0819bd86-52f1-4cb6-966e-ca184dd56482 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '814f9d10200d463c80b45efbc6503e94'} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:42:53.654465 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-0819bd86-52f1-4cb6-966e-ca184dd56482 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '814f9d10200d463c80b45efbc6503e94'} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:42:53.661007 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1292/2546] 10.222.0.23 () {58 vars in 1223 bytes} [Tue May 10 05:42:53 2022] DELETE /identity/v3/users/814f9d10200d463c80b45efbc6503e94 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 05:42:53.665961 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cc7a99-8ebf-4b2c-a398-95f51c482a79 None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:42:53.666256 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cc7a99-8ebf-4b2c-a398-95f51c482a79 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:42:53.666591 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cc7a99-8ebf-4b2c-a398-95f51c482a79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:42:53.691949 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-12cc7a99-8ebf-4b2c-a398-95f51c482a79 None None] MFA Rules not processed for user `44883b22532e44049d846938dc2cf423`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:42:53.693332 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-12cc7a99-8ebf-4b2c-a398-95f51c482a79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:42:53.760852 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1255/2547] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 10 05:42:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 05:42:53.771798 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0819bd86-52f1-4cb6-966e-ca184dd56482 admin admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:42:53.773663 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-0819bd86-52f1-4cb6-966e-ca184dd56482 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:42:53.832727 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0819bd86-52f1-4cb6-966e-ca184dd56482 admin admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:42:53.837439 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86edb0ac-a350-4586-8b64-21b308569502 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c8461cfdd9648b8abcaf8d34b7a102a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f23435f783540199d6dcfd0417c090e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:42:53.838157 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86edb0ac-a350-4586-8b64-21b308569502 service neutron] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:42:53.838425 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86edb0ac-a350-4586-8b64-21b308569502 service neutron] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:42:53.838728 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86edb0ac-a350-4586-8b64-21b308569502 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:42:53.849747 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86edb0ac-a350-4586-8b64-21b308569502 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:42:53.851188 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86edb0ac-a350-4586-8b64-21b308569502 service neutron] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:42:53.860702 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1293/2548] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 10 05:42:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 05:42:54.154442 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cc7a99-8ebf-4b2c-a398-95f51c482a79 None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:42:54.155918 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-12cc7a99-8ebf-4b2c-a398-95f51c482a79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:42:54.169789 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cc7a99-8ebf-4b2c-a398-95f51c482a79 None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:42:54.193565 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710013e6-841c-414f-82c1-a70d7e58ba70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:42:54.194534 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710013e6-841c-414f-82c1-a70d7e58ba70 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:42:54.194862 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710013e6-841c-414f-82c1-a70d7e58ba70 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:42:54.197270 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710013e6-841c-414f-82c1-a70d7e58ba70 admin admin] PATH_INFO: `/v3/projects/093363141dc5437db5f67d25663d1cf4` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:42:54.201095 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710013e6-841c-414f-82c1-a70d7e58ba70 admin admin] RBAC: Authorizing `identity:delete_project(project_id=093363141dc5437db5f67d25663d1cf4)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:42:54.204316 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710013e6-841c-414f-82c1-a70d7e58ba70 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:42:54.262920 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-710013e6-841c-414f-82c1-a70d7e58ba70 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '093363141dc5437db5f67d25663d1cf4', 'request_id': 'req-710013e6-841c-414f-82c1-a70d7e58ba70'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:42:54.270016 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-710013e6-841c-414f-82c1-a70d7e58ba70 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '093363141dc5437db5f67d25663d1cf4', 'request_id': 'req-710013e6-841c-414f-82c1-a70d7e58ba70'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:42:54.278709 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-710013e6-841c-414f-82c1-a70d7e58ba70 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '093363141dc5437db5f67d25663d1cf4', 'request_id': 'req-710013e6-841c-414f-82c1-a70d7e58ba70'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:42:54.291387 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-710013e6-841c-414f-82c1-a70d7e58ba70 admin admin] The token cache is being invalidate because project 093363141dc5437db5f67d25663d1cf4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79880) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 05:42:54.291923 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-710013e6-841c-414f-82c1-a70d7e58ba70 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:42:54.293170 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-710013e6-841c-414f-82c1-a70d7e58ba70 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:42:54.295126 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1256/2549] 10.222.0.23 () {58 vars in 1232 bytes} [Tue May 10 05:42:54 2022] DELETE /identity/v3/projects/093363141dc5437db5f67d25663d1cf4 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 05:42:54.299419 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86edb0ac-a350-4586-8b64-21b308569502 service neutron] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:42:54.310152 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86edb0ac-a350-4586-8b64-21b308569502 service neutron] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:42:54.379292 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d61bb42-44fc-4059-8d6c-2765ccb25c9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:42:54.380257 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d61bb42-44fc-4059-8d6c-2765ccb25c9f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:42:54.380636 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d61bb42-44fc-4059-8d6c-2765ccb25c9f admin admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:42:54.380940 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d61bb42-44fc-4059-8d6c-2765ccb25c9f admin admin] PATH_INFO: `/v3/users/b9a734da2f3b40aba781432f0eb79d8d` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:42:54.382302 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d61bb42-44fc-4059-8d6c-2765ccb25c9f admin admin] RBAC: Authorizing `identity:delete_user(user_id=b9a734da2f3b40aba781432f0eb79d8d)` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:42:54.384608 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d61bb42-44fc-4059-8d6c-2765ccb25c9f admin admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:42:54.432636 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-7d61bb42-44fc-4059-8d6c-2765ccb25c9f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b9a734da2f3b40aba781432f0eb79d8d'} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:42:54.441919 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-7d61bb42-44fc-4059-8d6c-2765ccb25c9f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b9a734da2f3b40aba781432f0eb79d8d'} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:42:54.442757 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-7d61bb42-44fc-4059-8d6c-2765ccb25c9f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b9a734da2f3b40aba781432f0eb79d8d'} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:42:54.454798 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-7d61bb42-44fc-4059-8d6c-2765ccb25c9f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b9a734da2f3b40aba781432f0eb79d8d'} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:42:54.461919 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-7d61bb42-44fc-4059-8d6c-2765ccb25c9f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b9a734da2f3b40aba781432f0eb79d8d'} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:42:54.468273 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1294/2550] 10.222.0.23 () {58 vars in 1223 bytes} [Tue May 10 05:42:54 2022] DELETE /identity/v3/users/b9a734da2f3b40aba781432f0eb79d8d => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 05:42:54.744038 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710013e6-841c-414f-82c1-a70d7e58ba70 admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:42:54.751119 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-710013e6-841c-414f-82c1-a70d7e58ba70 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:42:54.766310 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710013e6-841c-414f-82c1-a70d7e58ba70 admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:42:54.831004 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c03c3d-5c57-406e-b879-807f00e37a14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:42:54.832229 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c03c3d-5c57-406e-b879-807f00e37a14 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:42:54.832636 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c03c3d-5c57-406e-b879-807f00e37a14 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:42:54.832963 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c03c3d-5c57-406e-b879-807f00e37a14 admin admin] PATH_INFO: `/v3/projects/5702a6b541ed41f98d5256c84c0f47f8` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:42:54.834421 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c03c3d-5c57-406e-b879-807f00e37a14 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5702a6b541ed41f98d5256c84c0f47f8)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:42:54.836607 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c03c3d-5c57-406e-b879-807f00e37a14 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:42:54.884376 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-f0c03c3d-5c57-406e-b879-807f00e37a14 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5702a6b541ed41f98d5256c84c0f47f8', 'request_id': 'req-f0c03c3d-5c57-406e-b879-807f00e37a14'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:42:54.890717 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-f0c03c3d-5c57-406e-b879-807f00e37a14 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5702a6b541ed41f98d5256c84c0f47f8', 'request_id': 'req-f0c03c3d-5c57-406e-b879-807f00e37a14'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:42:54.899172 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-f0c03c3d-5c57-406e-b879-807f00e37a14 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5702a6b541ed41f98d5256c84c0f47f8', 'request_id': 'req-f0c03c3d-5c57-406e-b879-807f00e37a14'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:42:54.912197 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-f0c03c3d-5c57-406e-b879-807f00e37a14 admin admin] The token cache is being invalidate because project 5702a6b541ed41f98d5256c84c0f47f8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79880) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 05:42:54.912488 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-f0c03c3d-5c57-406e-b879-807f00e37a14 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:42:54.913119 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-f0c03c3d-5c57-406e-b879-807f00e37a14 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:42:54.914788 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1257/2551] 10.222.0.23 () {58 vars in 1232 bytes} [Tue May 10 05:42:54 2022] DELETE /identity/v3/projects/5702a6b541ed41f98d5256c84c0f47f8 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 05:42:54.919699 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd3dd15-ed48-4e0e-aaf9-68cf4f180024 None None] REQUEST_METHOD: `POST` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:42:54.920247 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd3dd15-ed48-4e0e-aaf9-68cf4f180024 None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:42:54.920397 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd3dd15-ed48-4e0e-aaf9-68cf4f180024 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:42:54.942738 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.auth.core [None req-bbd3dd15-ed48-4e0e-aaf9-68cf4f180024 None None] MFA Rules not processed for user `44883b22532e44049d846938dc2cf423`. Rule list: `[]` (Enabled: `True`). {{(pid=79879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:42:54.943991 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-bbd3dd15-ed48-4e0e-aaf9-68cf4f180024 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:42:55.005760 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1295/2552] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 10 05:42:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 05:42:55.013804 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339a6c1b-4576-4f35-8edc-45ae4f35ef66 None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:42:55.014092 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339a6c1b-4576-4f35-8edc-45ae4f35ef66 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:42:55.014341 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339a6c1b-4576-4f35-8edc-45ae4f35ef66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:42:55.032436 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-339a6c1b-4576-4f35-8edc-45ae4f35ef66 None None] MFA Rules not processed for user `44883b22532e44049d846938dc2cf423`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:42:55.033623 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-339a6c1b-4576-4f35-8edc-45ae4f35ef66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:42:55.043523 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1258/2553] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 10 05:42:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 05:42:55.047912 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd3dd15-ed48-4e0e-aaf9-68cf4f180024 None None] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:42:55.058132 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd3dd15-ed48-4e0e-aaf9-68cf4f180024 None None] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:42:55.063601 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abea1671-af13-47bd-8403-2ed38ba31c63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:42:55.064281 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abea1671-af13-47bd-8403-2ed38ba31c63 admin admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:42:55.064566 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abea1671-af13-47bd-8403-2ed38ba31c63 admin admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:42:55.064869 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abea1671-af13-47bd-8403-2ed38ba31c63 admin admin] PATH_INFO: `/v3/domains` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:42:55.065581 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abea1671-af13-47bd-8403-2ed38ba31c63 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:42:55.065885 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abea1671-af13-47bd-8403-2ed38ba31c63 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:42:55.067500 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abea1671-af13-47bd-8403-2ed38ba31c63 admin admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:42:55.079360 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1296/2554] 10.222.0.23 () {58 vars in 1152 bytes} [Tue May 10 05:42:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:42:55.083860 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339a6c1b-4576-4f35-8edc-45ae4f35ef66 None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:42:55.093597 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339a6c1b-4576-4f35-8edc-45ae4f35ef66 None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:42:55.098663 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e5b65c-9356-4e6e-b658-6a6a1c5ff4d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:42:55.099365 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e5b65c-9356-4e6e-b658-6a6a1c5ff4d2 admin admin] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:42:55.099689 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e5b65c-9356-4e6e-b658-6a6a1c5ff4d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:42:55.099978 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e5b65c-9356-4e6e-b658-6a6a1c5ff4d2 admin admin] PATH_INFO: `/v3/projects` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:42:55.100775 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e5b65c-9356-4e6e-b658-6a6a1c5ff4d2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:42:55.102698 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e5b65c-9356-4e6e-b658-6a6a1c5ff4d2 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:42:55.131680 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1259/2555] 10.222.0.23 () {60 vars in 1152 bytes} [Tue May 10 05:42:55 2022] POST /identity/v3/projects => generated 361 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 05:42:55.136208 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abea1671-af13-47bd-8403-2ed38ba31c63 admin admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:42:55.146850 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abea1671-af13-47bd-8403-2ed38ba31c63 admin admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:42:55.213184 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2c5c1d-f426-4c72-ab3b-5324cc06075e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:42:55.214270 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2c5c1d-f426-4c72-ab3b-5324cc06075e admin admin] REQUEST_METHOD: `POST` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:42:55.214736 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2c5c1d-f426-4c72-ab3b-5324cc06075e admin admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:42:55.215188 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2c5c1d-f426-4c72-ab3b-5324cc06075e admin admin] PATH_INFO: `/v3/users` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:42:55.216380 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2c5c1d-f426-4c72-ab3b-5324cc06075e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:42:55.218608 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2c5c1d-f426-4c72-ab3b-5324cc06075e admin admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:42:55.242073 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1297/2556] 10.222.0.23 () {60 vars in 1143 bytes} [Tue May 10 05:42:55 2022] POST /identity/v3/users => generated 281 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 05:42:55.250500 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e5b65c-9356-4e6e-b658-6a6a1c5ff4d2 admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:42:55.262256 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e5b65c-9356-4e6e-b658-6a6a1c5ff4d2 admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:42:55.267379 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbd76f9-83ac-40b9-a702-708d1d3c3f34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:42:55.268070 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbd76f9-83ac-40b9-a702-708d1d3c3f34 admin admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:42:55.268352 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbd76f9-83ac-40b9-a702-708d1d3c3f34 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:42:55.268598 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbd76f9-83ac-40b9-a702-708d1d3c3f34 admin admin] PATH_INFO: `/v3/roles` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:42:55.269354 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fbd76f9-83ac-40b9-a702-708d1d3c3f34 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:42:55.270960 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fbd76f9-83ac-40b9-a702-708d1d3c3f34 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:42:55.281614 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1260/2557] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 10 05:42:55 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 05:42:55.285644 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2c5c1d-f426-4c72-ab3b-5324cc06075e admin admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:42:55.295814 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2c5c1d-f426-4c72-ab3b-5324cc06075e admin admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:42:55.302908 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c3fb6e-4bf1-4c86-a8f8-8844ba356ece admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:42:55.303982 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c3fb6e-4bf1-4c86-a8f8-8844ba356ece admin admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:42:55.304346 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c3fb6e-4bf1-4c86-a8f8-8844ba356ece admin admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:42:55.304624 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c3fb6e-4bf1-4c86-a8f8-8844ba356ece admin admin] PATH_INFO: `/v3/roles` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:42:55.305586 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c3fb6e-4bf1-4c86-a8f8-8844ba356ece admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:42:55.307245 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c3fb6e-4bf1-4c86-a8f8-8844ba356ece admin admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:42:55.318095 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1298/2558] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 10 05:42:55 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 05:42:55.322749 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbd76f9-83ac-40b9-a702-708d1d3c3f34 admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:42:55.333033 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbd76f9-83ac-40b9-a702-708d1d3c3f34 admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:42:55.337886 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0c5fb1-5017-4e4f-93ca-60aaca955d81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:42:55.338803 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0c5fb1-5017-4e4f-93ca-60aaca955d81 admin admin] REQUEST_METHOD: `PUT` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:42:55.339083 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0c5fb1-5017-4e4f-93ca-60aaca955d81 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:42:55.339337 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0c5fb1-5017-4e4f-93ca-60aaca955d81 admin admin] PATH_INFO: `/v3/projects/bbf5001cfb8540ddb9b7092532703dea/users/9542e964437e4235875b7e59c491940e/roles/382636e67fc142a2b2f486340d959e11` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:42:55.354991 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0c5fb1-5017-4e4f-93ca-60aaca955d81 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bbf5001cfb8540ddb9b7092532703dea, user_id=9542e964437e4235875b7e59c491940e, role_id=382636e67fc142a2b2f486340d959e11)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:42:55.358949 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0c5fb1-5017-4e4f-93ca-60aaca955d81 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:42:55.379239 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1261/2559] 10.222.0.23 () {60 vars in 1482 bytes} [Tue May 10 05:42:55 2022] PUT /identity/v3/projects/bbf5001cfb8540ddb9b7092532703dea/users/9542e964437e4235875b7e59c491940e/roles/382636e67fc142a2b2f486340d959e11 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 05:42:55.390960 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4018fb4-e8a4-45ac-9251-339a4908361f None None] REQUEST_METHOD: `POST` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:42:55.391611 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4018fb4-e8a4-45ac-9251-339a4908361f None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:42:55.391919 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4018fb4-e8a4-45ac-9251-339a4908361f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:42:55.424332 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.auth.core [None req-c4018fb4-e8a4-45ac-9251-339a4908361f None None] MFA Rules not processed for user `9542e964437e4235875b7e59c491940e`. Rule list: `[]` (Enabled: `True`). {{(pid=79879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:42:55.425863 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-c4018fb4-e8a4-45ac-9251-339a4908361f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:42:55.461639 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0c5fb1-5017-4e4f-93ca-60aaca955d81 admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:42:55.463382 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-2b0c5fb1-5017-4e4f-93ca-60aaca955d81 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:42:55.498335 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1299/2560] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 10 05:42:55 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 05:42:55.532939 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4018fb4-e8a4-45ac-9251-339a4908361f None None] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:42:55.534713 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-c4018fb4-e8a4-45ac-9251-339a4908361f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:42:55.543309 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0c5fb1-5017-4e4f-93ca-60aaca955d81 admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:42:55.546996 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4838eec0-bf11-4942-b42c-d6e9746e535d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c8461cfdd9648b8abcaf8d34b7a102a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f23435f783540199d6dcfd0417c090e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:42:55.547677 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4838eec0-bf11-4942-b42c-d6e9746e535d service neutron] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:42:55.547959 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4838eec0-bf11-4942-b42c-d6e9746e535d service neutron] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:42:55.548231 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4838eec0-bf11-4942-b42c-d6e9746e535d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:42:55.549972 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-4838eec0-bf11-4942-b42c-d6e9746e535d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:42:55.600416 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4018fb4-e8a4-45ac-9251-339a4908361f None None] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:42:55.604052 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0f7093-9fca-47d3-896b-12f9869088ab service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355be413675540a39ccb00e1a0722316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f23435f783540199d6dcfd0417c090e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:42:55.604706 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0f7093-9fca-47d3-896b-12f9869088ab service cinder] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:42:55.604987 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0f7093-9fca-47d3-896b-12f9869088ab service cinder] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:42:55.605261 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0f7093-9fca-47d3-896b-12f9869088ab service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:42:55.615194 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0f7093-9fca-47d3-896b-12f9869088ab service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:42:55.616682 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0f7093-9fca-47d3-896b-12f9869088ab service cinder] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:42:55.622993 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4838eec0-bf11-4942-b42c-d6e9746e535d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:42:55.625382 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4838eec0-bf11-4942-b42c-d6e9746e535d service neutron] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:42:55.626661 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1300/2561] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 10 05:42:55 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 05:42:55.634645 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1262/2562] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 10 05:42:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 05:42:55.641252 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0f7093-9fca-47d3-896b-12f9869088ab service cinder] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:42:55.657343 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0f7093-9fca-47d3-896b-12f9869088ab service cinder] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:42:55.661948 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad63a0a-fe83-45df-947a-ce3819e2477f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:42:55.662826 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad63a0a-fe83-45df-947a-ce3819e2477f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:42:55.663106 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad63a0a-fe83-45df-947a-ce3819e2477f admin admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:42:55.663437 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad63a0a-fe83-45df-947a-ce3819e2477f admin admin] PATH_INFO: `/v3/users/9542e964437e4235875b7e59c491940e` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:42:55.664607 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad63a0a-fe83-45df-947a-ce3819e2477f admin admin] RBAC: Authorizing `identity:delete_user(user_id=9542e964437e4235875b7e59c491940e)` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:42:55.666532 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad63a0a-fe83-45df-947a-ce3819e2477f admin admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:42:55.722083 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-9ad63a0a-fe83-45df-947a-ce3819e2477f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9542e964437e4235875b7e59c491940e'} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:42:55.731010 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-9ad63a0a-fe83-45df-947a-ce3819e2477f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9542e964437e4235875b7e59c491940e'} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:42:55.731680 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-9ad63a0a-fe83-45df-947a-ce3819e2477f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9542e964437e4235875b7e59c491940e'} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:42:55.744055 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-9ad63a0a-fe83-45df-947a-ce3819e2477f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9542e964437e4235875b7e59c491940e'} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:42:55.751155 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-9ad63a0a-fe83-45df-947a-ce3819e2477f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9542e964437e4235875b7e59c491940e'} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:42:55.757705 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1301/2563] 10.222.0.23 () {58 vars in 1223 bytes} [Tue May 10 05:42:55 2022] DELETE /identity/v3/users/9542e964437e4235875b7e59c491940e => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 05:42:55.762918 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e2e780-4ad0-4f02-ace4-17468d3a2bc1 None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:42:55.763204 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e2e780-4ad0-4f02-ace4-17468d3a2bc1 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:42:55.763698 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e2e780-4ad0-4f02-ace4-17468d3a2bc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:42:55.781098 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-71e2e780-4ad0-4f02-ace4-17468d3a2bc1 None None] MFA Rules not processed for user `44883b22532e44049d846938dc2cf423`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:42:55.782999 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-71e2e780-4ad0-4f02-ace4-17468d3a2bc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:42:55.845413 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1263/2564] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 10 05:42:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 05:42:55.856045 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad63a0a-fe83-45df-947a-ce3819e2477f admin admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:42:55.857700 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-9ad63a0a-fe83-45df-947a-ce3819e2477f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:42:55.934460 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad63a0a-fe83-45df-947a-ce3819e2477f admin admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:42:55.939526 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ae4f85-f38a-49ca-9494-bea8b1413f53 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c8461cfdd9648b8abcaf8d34b7a102a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f23435f783540199d6dcfd0417c090e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:42:55.940410 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ae4f85-f38a-49ca-9494-bea8b1413f53 service neutron] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:42:55.940793 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ae4f85-f38a-49ca-9494-bea8b1413f53 service neutron] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:42:55.941168 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ae4f85-f38a-49ca-9494-bea8b1413f53 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:42:55.952887 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ae4f85-f38a-49ca-9494-bea8b1413f53 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:42:55.954427 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ae4f85-f38a-49ca-9494-bea8b1413f53 service neutron] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:42:55.967201 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1302/2565] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 10 05:42:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 05:42:56.396706 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e2e780-4ad0-4f02-ace4-17468d3a2bc1 None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:42:56.398160 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-71e2e780-4ad0-4f02-ace4-17468d3a2bc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:42:56.412194 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e2e780-4ad0-4f02-ace4-17468d3a2bc1 None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:42:56.417360 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc20d3b-6ba7-4632-a49a-e3a435f96219 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:42:56.422379 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc20d3b-6ba7-4632-a49a-e3a435f96219 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:42:56.422379 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc20d3b-6ba7-4632-a49a-e3a435f96219 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:42:56.422379 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc20d3b-6ba7-4632-a49a-e3a435f96219 admin admin] PATH_INFO: `/v3/projects/bbf5001cfb8540ddb9b7092532703dea` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:42:56.422379 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc20d3b-6ba7-4632-a49a-e3a435f96219 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bbf5001cfb8540ddb9b7092532703dea)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:42:56.438181 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc20d3b-6ba7-4632-a49a-e3a435f96219 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:42:56.496909 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-9bc20d3b-6ba7-4632-a49a-e3a435f96219 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bbf5001cfb8540ddb9b7092532703dea', 'request_id': 'req-9bc20d3b-6ba7-4632-a49a-e3a435f96219'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:42:56.503774 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-9bc20d3b-6ba7-4632-a49a-e3a435f96219 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bbf5001cfb8540ddb9b7092532703dea', 'request_id': 'req-9bc20d3b-6ba7-4632-a49a-e3a435f96219'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:42:56.513374 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-9bc20d3b-6ba7-4632-a49a-e3a435f96219 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bbf5001cfb8540ddb9b7092532703dea', 'request_id': 'req-9bc20d3b-6ba7-4632-a49a-e3a435f96219'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:42:56.524403 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-9bc20d3b-6ba7-4632-a49a-e3a435f96219 admin admin] The token cache is being invalidate because project bbf5001cfb8540ddb9b7092532703dea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79880) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 05:42:56.524761 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-9bc20d3b-6ba7-4632-a49a-e3a435f96219 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:42:56.525628 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-9bc20d3b-6ba7-4632-a49a-e3a435f96219 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:42:56.527605 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1264/2566] 10.222.0.23 () {58 vars in 1232 bytes} [Tue May 10 05:42:56 2022] DELETE /identity/v3/projects/bbf5001cfb8540ddb9b7092532703dea => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 05:42:56.532367 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ccaf11-8189-4ebb-9ad2-82ff3cee4461 None None] REQUEST_METHOD: `POST` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:42:56.532655 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ccaf11-8189-4ebb-9ad2-82ff3cee4461 None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:42:56.532931 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ccaf11-8189-4ebb-9ad2-82ff3cee4461 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:42:56.563932 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.auth.core [None req-86ccaf11-8189-4ebb-9ad2-82ff3cee4461 None None] MFA Rules not processed for user `44883b22532e44049d846938dc2cf423`. Rule list: `[]` (Enabled: `True`). {{(pid=79879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:42:56.565144 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-86ccaf11-8189-4ebb-9ad2-82ff3cee4461 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:42:56.629591 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1303/2567] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 10 05:42:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 05:42:56.637444 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963d06c4-f309-472a-9889-16ba7cfd23c1 None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:42:56.637733 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963d06c4-f309-472a-9889-16ba7cfd23c1 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:42:56.638011 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963d06c4-f309-472a-9889-16ba7cfd23c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:42:56.659658 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-963d06c4-f309-472a-9889-16ba7cfd23c1 None None] MFA Rules not processed for user `44883b22532e44049d846938dc2cf423`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:42:56.659658 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-963d06c4-f309-472a-9889-16ba7cfd23c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:42:56.667516 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1265/2568] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 10 05:42:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 05:42:56.671922 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ccaf11-8189-4ebb-9ad2-82ff3cee4461 None None] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:42:56.681709 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ccaf11-8189-4ebb-9ad2-82ff3cee4461 None None] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:42:56.687398 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b37810-62ab-4407-9d52-70f143c1aeca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:42:56.688094 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b37810-62ab-4407-9d52-70f143c1aeca admin admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:42:56.688378 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b37810-62ab-4407-9d52-70f143c1aeca admin admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:42:56.688681 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b37810-62ab-4407-9d52-70f143c1aeca admin admin] PATH_INFO: `/v3/domains` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:42:56.689451 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b37810-62ab-4407-9d52-70f143c1aeca admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:42:56.689760 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b37810-62ab-4407-9d52-70f143c1aeca admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:42:56.691378 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b37810-62ab-4407-9d52-70f143c1aeca admin admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:42:56.705684 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1304/2569] 10.222.0.23 () {58 vars in 1152 bytes} [Tue May 10 05:42:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:42:56.710031 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963d06c4-f309-472a-9889-16ba7cfd23c1 None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:42:56.719531 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963d06c4-f309-472a-9889-16ba7cfd23c1 None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:42:56.724430 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517ed7ad-0132-4838-bba7-e8b2c4d4b6aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:42:56.725159 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517ed7ad-0132-4838-bba7-e8b2c4d4b6aa admin admin] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:42:56.725524 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517ed7ad-0132-4838-bba7-e8b2c4d4b6aa admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:42:56.725887 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517ed7ad-0132-4838-bba7-e8b2c4d4b6aa admin admin] PATH_INFO: `/v3/projects` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:42:56.726655 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517ed7ad-0132-4838-bba7-e8b2c4d4b6aa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:42:56.728654 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517ed7ad-0132-4838-bba7-e8b2c4d4b6aa admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:42:56.757108 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1266/2570] 10.222.0.23 () {60 vars in 1152 bytes} [Tue May 10 05:42:56 2022] POST /identity/v3/projects => generated 373 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 05:42:56.762611 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b37810-62ab-4407-9d52-70f143c1aeca admin admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:42:56.773884 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b37810-62ab-4407-9d52-70f143c1aeca admin admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:42:56.831610 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edcb55c-7a8f-4d0d-8396-4866bec85625 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:42:56.832518 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edcb55c-7a8f-4d0d-8396-4866bec85625 admin admin] REQUEST_METHOD: `POST` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:42:56.832795 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edcb55c-7a8f-4d0d-8396-4866bec85625 admin admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:42:56.833066 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edcb55c-7a8f-4d0d-8396-4866bec85625 admin admin] PATH_INFO: `/v3/users` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:42:56.833766 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4edcb55c-7a8f-4d0d-8396-4866bec85625 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:42:56.835730 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4edcb55c-7a8f-4d0d-8396-4866bec85625 admin admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:42:56.859667 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1305/2571] 10.222.0.23 () {60 vars in 1143 bytes} [Tue May 10 05:42:56 2022] POST /identity/v3/users => generated 287 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 05:42:56.863825 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517ed7ad-0132-4838-bba7-e8b2c4d4b6aa admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:42:56.875676 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517ed7ad-0132-4838-bba7-e8b2c4d4b6aa admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:42:56.882068 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e0a7bc-46af-4607-8b4f-3559f39a2c1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:42:56.883100 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e0a7bc-46af-4607-8b4f-3559f39a2c1d admin admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:42:56.883435 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e0a7bc-46af-4607-8b4f-3559f39a2c1d admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:42:56.883766 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e0a7bc-46af-4607-8b4f-3559f39a2c1d admin admin] PATH_INFO: `/v3/roles` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:42:56.884505 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e0a7bc-46af-4607-8b4f-3559f39a2c1d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:42:56.886152 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e0a7bc-46af-4607-8b4f-3559f39a2c1d admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:42:56.897263 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1267/2572] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 10 05:42:56 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 05:42:56.901917 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edcb55c-7a8f-4d0d-8396-4866bec85625 admin admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:42:56.914578 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edcb55c-7a8f-4d0d-8396-4866bec85625 admin admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:42:56.919300 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be89e22-bd9a-434a-9804-16dec5b677ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:42:56.920055 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be89e22-bd9a-434a-9804-16dec5b677ef admin admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:42:56.920335 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be89e22-bd9a-434a-9804-16dec5b677ef admin admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:42:56.920612 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be89e22-bd9a-434a-9804-16dec5b677ef admin admin] PATH_INFO: `/v3/roles` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:42:56.921348 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be89e22-bd9a-434a-9804-16dec5b677ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:42:56.922962 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be89e22-bd9a-434a-9804-16dec5b677ef admin admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:42:56.933521 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1306/2573] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 10 05:42:56 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 05:42:56.937710 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e0a7bc-46af-4607-8b4f-3559f39a2c1d admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:42:56.947890 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e0a7bc-46af-4607-8b4f-3559f39a2c1d admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:42:56.952636 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a61b2e7-f2c3-46c6-9f4f-c15497a25be9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:42:56.953640 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a61b2e7-f2c3-46c6-9f4f-c15497a25be9 admin admin] REQUEST_METHOD: `PUT` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:42:56.953918 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a61b2e7-f2c3-46c6-9f4f-c15497a25be9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:42:56.954198 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a61b2e7-f2c3-46c6-9f4f-c15497a25be9 admin admin] PATH_INFO: `/v3/projects/699b5cb28dd5440f8daf96b156413623/users/971cc0771bf5482095d77c0b471bfdb3/roles/382636e67fc142a2b2f486340d959e11` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:42:56.974080 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a61b2e7-f2c3-46c6-9f4f-c15497a25be9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=699b5cb28dd5440f8daf96b156413623, user_id=971cc0771bf5482095d77c0b471bfdb3, role_id=382636e67fc142a2b2f486340d959e11)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:42:56.977481 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a61b2e7-f2c3-46c6-9f4f-c15497a25be9 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:42:56.993783 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1268/2574] 10.222.0.23 () {60 vars in 1482 bytes} [Tue May 10 05:42:56 2022] PUT /identity/v3/projects/699b5cb28dd5440f8daf96b156413623/users/971cc0771bf5482095d77c0b471bfdb3/roles/382636e67fc142a2b2f486340d959e11 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 05:42:56.998679 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cec3d1-e7bd-49cc-96a1-69a88e6790bd None None] REQUEST_METHOD: `POST` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:42:56.999543 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cec3d1-e7bd-49cc-96a1-69a88e6790bd None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:42:57.001181 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cec3d1-e7bd-49cc-96a1-69a88e6790bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:42:57.028796 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.auth.core [None req-11cec3d1-e7bd-49cc-96a1-69a88e6790bd None None] MFA Rules not processed for user `44883b22532e44049d846938dc2cf423`. Rule list: `[]` (Enabled: `True`). {{(pid=79879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:42:57.030245 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-11cec3d1-e7bd-49cc-96a1-69a88e6790bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:42:57.099532 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1307/2575] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 10 05:42:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 05:42:57.110716 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a61b2e7-f2c3-46c6-9f4f-c15497a25be9 admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:42:57.112511 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-3a61b2e7-f2c3-46c6-9f4f-c15497a25be9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:42:57.180901 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a61b2e7-f2c3-46c6-9f4f-c15497a25be9 admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:42:57.188238 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f58259a-8414-4848-9f22-6179ebabfff2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c8461cfdd9648b8abcaf8d34b7a102a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f23435f783540199d6dcfd0417c090e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:42:57.189524 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f58259a-8414-4848-9f22-6179ebabfff2 service neutron] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:42:57.189803 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f58259a-8414-4848-9f22-6179ebabfff2 service neutron] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:42:57.190071 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f58259a-8414-4848-9f22-6179ebabfff2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:42:57.200307 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f58259a-8414-4848-9f22-6179ebabfff2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:42:57.201893 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f58259a-8414-4848-9f22-6179ebabfff2 service neutron] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:42:57.211552 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1269/2576] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 10 05:42:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 05:42:57.949888 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d304eb4-dcb1-411f-b854-2603776da37e None None] REQUEST_METHOD: `POST` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:42:57.950491 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d304eb4-dcb1-411f-b854-2603776da37e None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:42:57.951030 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d304eb4-dcb1-411f-b854-2603776da37e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:42:57.983015 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.auth.core [None req-8d304eb4-dcb1-411f-b854-2603776da37e None None] MFA Rules not processed for user `971cc0771bf5482095d77c0b471bfdb3`. Rule list: `[]` (Enabled: `True`). {{(pid=79879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:42:57.984628 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-8d304eb4-dcb1-411f-b854-2603776da37e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:42:58.080332 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1308/2577] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 10 05:42:57 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 05:42:58.093699 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f58259a-8414-4848-9f22-6179ebabfff2 service neutron] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:42:58.095724 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-8f58259a-8414-4848-9f22-6179ebabfff2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:42:58.217834 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f58259a-8414-4848-9f22-6179ebabfff2 service neutron] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:42:58.221804 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b521eec0-88e8-4a1f-995a-a1d033dc25fd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355be413675540a39ccb00e1a0722316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f23435f783540199d6dcfd0417c090e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:42:58.222463 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b521eec0-88e8-4a1f-995a-a1d033dc25fd service cinder] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:42:58.222746 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b521eec0-88e8-4a1f-995a-a1d033dc25fd service cinder] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:42:58.223134 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b521eec0-88e8-4a1f-995a-a1d033dc25fd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:42:58.237624 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b521eec0-88e8-4a1f-995a-a1d033dc25fd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:42:58.239333 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b521eec0-88e8-4a1f-995a-a1d033dc25fd service cinder] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:42:58.252433 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1270/2578] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 10 05:42:58 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 05:42:58.679781 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d304eb4-dcb1-411f-b854-2603776da37e None None] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:42:58.682069 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-8d304eb4-dcb1-411f-b854-2603776da37e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:42:58.712683 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d304eb4-dcb1-411f-b854-2603776da37e None None] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:42:58.723082 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f5480c-2b92-4879-b5bf-8caec2095ed9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:42:58.731203 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f5480c-2b92-4879-b5bf-8caec2095ed9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:42:58.731836 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f5480c-2b92-4879-b5bf-8caec2095ed9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:42:58.732531 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f5480c-2b92-4879-b5bf-8caec2095ed9 admin admin] PATH_INFO: `/v3/users/eeaaa5754ec34f0c9ccde9492df07283` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:42:58.734011 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f5480c-2b92-4879-b5bf-8caec2095ed9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eeaaa5754ec34f0c9ccde9492df07283)` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:42:58.736237 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f5480c-2b92-4879-b5bf-8caec2095ed9 admin admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:42:58.806325 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-37f5480c-2b92-4879-b5bf-8caec2095ed9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eeaaa5754ec34f0c9ccde9492df07283'} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:42:58.815074 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-37f5480c-2b92-4879-b5bf-8caec2095ed9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eeaaa5754ec34f0c9ccde9492df07283'} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:42:58.815698 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-37f5480c-2b92-4879-b5bf-8caec2095ed9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eeaaa5754ec34f0c9ccde9492df07283'} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:42:58.828201 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-37f5480c-2b92-4879-b5bf-8caec2095ed9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eeaaa5754ec34f0c9ccde9492df07283'} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:42:58.835010 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-37f5480c-2b92-4879-b5bf-8caec2095ed9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eeaaa5754ec34f0c9ccde9492df07283'} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:42:58.841669 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1309/2579] 10.222.0.23 () {58 vars in 1223 bytes} [Tue May 10 05:42:58 2022] DELETE /identity/v3/users/eeaaa5754ec34f0c9ccde9492df07283 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 05:42:58.846423 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d881309-a8be-4894-8e7d-3dcaf2541755 None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:42:58.846684 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d881309-a8be-4894-8e7d-3dcaf2541755 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:42:58.847016 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d881309-a8be-4894-8e7d-3dcaf2541755 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:42:58.865816 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-4d881309-a8be-4894-8e7d-3dcaf2541755 None None] MFA Rules not processed for user `44883b22532e44049d846938dc2cf423`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:42:58.867191 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-4d881309-a8be-4894-8e7d-3dcaf2541755 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:42:58.938744 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1271/2580] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 10 05:42:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 05:42:58.949135 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f5480c-2b92-4879-b5bf-8caec2095ed9 admin admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:42:58.950978 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-37f5480c-2b92-4879-b5bf-8caec2095ed9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:42:59.024542 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f5480c-2b92-4879-b5bf-8caec2095ed9 admin admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:42:59.029619 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4266b8a4-4be4-42f0-a975-8f8aeaab14f0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c8461cfdd9648b8abcaf8d34b7a102a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f23435f783540199d6dcfd0417c090e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:42:59.030292 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4266b8a4-4be4-42f0-a975-8f8aeaab14f0 service neutron] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:42:59.030552 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4266b8a4-4be4-42f0-a975-8f8aeaab14f0 service neutron] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:42:59.030833 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4266b8a4-4be4-42f0-a975-8f8aeaab14f0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:42:59.040636 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4266b8a4-4be4-42f0-a975-8f8aeaab14f0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:42:59.042114 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4266b8a4-4be4-42f0-a975-8f8aeaab14f0 service neutron] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:42:59.052931 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1310/2581] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 10 05:42:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 05:42:59.513096 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d881309-a8be-4894-8e7d-3dcaf2541755 None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:42:59.515420 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-4d881309-a8be-4894-8e7d-3dcaf2541755 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:42:59.529440 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d881309-a8be-4894-8e7d-3dcaf2541755 None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:42:59.534095 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39896666-707d-4c5f-99e2-cccb22993742 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:42:59.534966 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39896666-707d-4c5f-99e2-cccb22993742 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:42:59.535251 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39896666-707d-4c5f-99e2-cccb22993742 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:42:59.535523 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39896666-707d-4c5f-99e2-cccb22993742 admin admin] PATH_INFO: `/v3/projects/6e91386cfb5e4b5ca883e93359ae039b` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:42:59.536751 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39896666-707d-4c5f-99e2-cccb22993742 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6e91386cfb5e4b5ca883e93359ae039b)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:42:59.538743 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39896666-707d-4c5f-99e2-cccb22993742 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:42:59.598549 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4266b8a4-4be4-42f0-a975-8f8aeaab14f0 service neutron] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:42:59.599081 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-39896666-707d-4c5f-99e2-cccb22993742 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6e91386cfb5e4b5ca883e93359ae039b', 'request_id': 'req-39896666-707d-4c5f-99e2-cccb22993742'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:42:59.600138 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-4266b8a4-4be4-42f0-a975-8f8aeaab14f0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:42:59.605515 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-39896666-707d-4c5f-99e2-cccb22993742 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6e91386cfb5e4b5ca883e93359ae039b', 'request_id': 'req-39896666-707d-4c5f-99e2-cccb22993742'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:42:59.614635 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4266b8a4-4be4-42f0-a975-8f8aeaab14f0 service neutron] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:42:59.615092 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-39896666-707d-4c5f-99e2-cccb22993742 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6e91386cfb5e4b5ca883e93359ae039b', 'request_id': 'req-39896666-707d-4c5f-99e2-cccb22993742'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:42:59.627319 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-39896666-707d-4c5f-99e2-cccb22993742 admin admin] The token cache is being invalidate because project 6e91386cfb5e4b5ca883e93359ae039b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79880) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 05:42:59.627833 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-39896666-707d-4c5f-99e2-cccb22993742 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:42:59.628625 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-39896666-707d-4c5f-99e2-cccb22993742 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:42:59.630420 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1272/2582] 10.222.0.23 () {58 vars in 1232 bytes} [Tue May 10 05:42:59 2022] DELETE /identity/v3/projects/6e91386cfb5e4b5ca883e93359ae039b => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 05:42:59.634207 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39896666-707d-4c5f-99e2-cccb22993742 admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:42:59.635628 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-39896666-707d-4c5f-99e2-cccb22993742 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:42:59.672137 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b06f56d-7525-4d7e-942a-fd1909d2077d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:42:59.673034 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b06f56d-7525-4d7e-942a-fd1909d2077d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:42:59.673766 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b06f56d-7525-4d7e-942a-fd1909d2077d admin admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:42:59.673766 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b06f56d-7525-4d7e-942a-fd1909d2077d admin admin] PATH_INFO: `/v3/users/da9d43f65eca485b8b629a4c7a867b93` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:42:59.674976 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b06f56d-7525-4d7e-942a-fd1909d2077d admin admin] RBAC: Authorizing `identity:delete_user(user_id=da9d43f65eca485b8b629a4c7a867b93)` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:42:59.676993 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b06f56d-7525-4d7e-942a-fd1909d2077d admin admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:42:59.705627 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39896666-707d-4c5f-99e2-cccb22993742 admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:42:59.711782 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645c34bc-ae35-4410-9ab5-d4b02bdc3458 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:42:59.712765 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645c34bc-ae35-4410-9ab5-d4b02bdc3458 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:42:59.713073 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645c34bc-ae35-4410-9ab5-d4b02bdc3458 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:42:59.713336 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645c34bc-ae35-4410-9ab5-d4b02bdc3458 admin admin] PATH_INFO: `/v3/users/e3b68a5248b14a92a65ff10cbf2f6115` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:42:59.714706 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645c34bc-ae35-4410-9ab5-d4b02bdc3458 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e3b68a5248b14a92a65ff10cbf2f6115)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:42:59.716845 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645c34bc-ae35-4410-9ab5-d4b02bdc3458 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:42:59.744759 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-3b06f56d-7525-4d7e-942a-fd1909d2077d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'da9d43f65eca485b8b629a4c7a867b93'} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:42:59.755396 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-3b06f56d-7525-4d7e-942a-fd1909d2077d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'da9d43f65eca485b8b629a4c7a867b93'} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:42:59.756080 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-3b06f56d-7525-4d7e-942a-fd1909d2077d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'da9d43f65eca485b8b629a4c7a867b93'} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:42:59.768111 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-645c34bc-ae35-4410-9ab5-d4b02bdc3458 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e3b68a5248b14a92a65ff10cbf2f6115'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:42:59.769059 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-3b06f56d-7525-4d7e-942a-fd1909d2077d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'da9d43f65eca485b8b629a4c7a867b93'} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:42:59.776331 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-3b06f56d-7525-4d7e-942a-fd1909d2077d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'da9d43f65eca485b8b629a4c7a867b93'} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:42:59.780275 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-645c34bc-ae35-4410-9ab5-d4b02bdc3458 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e3b68a5248b14a92a65ff10cbf2f6115'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:42:59.784865 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-645c34bc-ae35-4410-9ab5-d4b02bdc3458 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e3b68a5248b14a92a65ff10cbf2f6115'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:42:59.790463 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1311/2583] 10.222.0.23 () {58 vars in 1223 bytes} [Tue May 10 05:42:59 2022] DELETE /identity/v3/users/da9d43f65eca485b8b629a4c7a867b93 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 05:42:59.791802 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-645c34bc-ae35-4410-9ab5-d4b02bdc3458 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e3b68a5248b14a92a65ff10cbf2f6115'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:42:59.791928 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5024d4c7-43c3-4f3d-ab55-fabe2885e16b None None] REQUEST_METHOD: `POST` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:42:59.792115 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5024d4c7-43c3-4f3d-ab55-fabe2885e16b None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:42:59.792392 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5024d4c7-43c3-4f3d-ab55-fabe2885e16b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:42:59.793877 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-645c34bc-ae35-4410-9ab5-d4b02bdc3458 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e3b68a5248b14a92a65ff10cbf2f6115'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:42:59.811030 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.auth.core [None req-5024d4c7-43c3-4f3d-ab55-fabe2885e16b None None] MFA Rules not processed for user `971cc0771bf5482095d77c0b471bfdb3`. Rule list: `[]` (Enabled: `True`). {{(pid=79879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:42:59.811909 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1273/2584] 10.222.0.23 () {58 vars in 1223 bytes} [Tue May 10 05:42:59 2022] DELETE /identity/v3/users/e3b68a5248b14a92a65ff10cbf2f6115 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 05:42:59.812742 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-5024d4c7-43c3-4f3d-ab55-fabe2885e16b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:42:59.887178 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1312/2585] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 10 05:42:59 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 05:43:00.028542 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645c34bc-ae35-4410-9ab5-d4b02bdc3458 admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:43:00.030106 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-645c34bc-ae35-4410-9ab5-d4b02bdc3458 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:43:00.113529 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645c34bc-ae35-4410-9ab5-d4b02bdc3458 admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:43:00.118164 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5024d4c7-43c3-4f3d-ab55-fabe2885e16b None None] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:43:00.119824 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-5024d4c7-43c3-4f3d-ab55-fabe2885e16b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:43:00.122573 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e2cae9-6474-4e52-b7af-f64d8a166c57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:43:00.124123 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e2cae9-6474-4e52-b7af-f64d8a166c57 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:43:00.124399 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e2cae9-6474-4e52-b7af-f64d8a166c57 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:43:00.124684 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e2cae9-6474-4e52-b7af-f64d8a166c57 admin admin] PATH_INFO: `/v3/projects/0623b145317e4164862cd8601813c000` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:43:00.131332 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e2cae9-6474-4e52-b7af-f64d8a166c57 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0623b145317e4164862cd8601813c000)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:43:00.134776 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e2cae9-6474-4e52-b7af-f64d8a166c57 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:43:00.138346 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5024d4c7-43c3-4f3d-ab55-fabe2885e16b None None] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:43:00.148083 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d10bf57-dfb5-49ba-b83c-c10053dec0b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:43:00.150341 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d10bf57-dfb5-49ba-b83c-c10053dec0b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:43:00.150798 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d10bf57-dfb5-49ba-b83c-c10053dec0b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:43:00.151231 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d10bf57-dfb5-49ba-b83c-c10053dec0b6 admin admin] PATH_INFO: `/v3/projects/f28626b684df4053a80f7b7f6413668e` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:43:00.152880 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d10bf57-dfb5-49ba-b83c-c10053dec0b6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f28626b684df4053a80f7b7f6413668e)` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:43:00.154956 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d10bf57-dfb5-49ba-b83c-c10053dec0b6 admin admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:43:00.198045 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-26e2cae9-6474-4e52-b7af-f64d8a166c57 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0623b145317e4164862cd8601813c000', 'request_id': 'req-26e2cae9-6474-4e52-b7af-f64d8a166c57'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:43:00.204586 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-26e2cae9-6474-4e52-b7af-f64d8a166c57 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0623b145317e4164862cd8601813c000', 'request_id': 'req-26e2cae9-6474-4e52-b7af-f64d8a166c57'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:43:00.205265 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-3d10bf57-dfb5-49ba-b83c-c10053dec0b6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f28626b684df4053a80f7b7f6413668e', 'request_id': 'req-3d10bf57-dfb5-49ba-b83c-c10053dec0b6'} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:43:00.212056 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-3d10bf57-dfb5-49ba-b83c-c10053dec0b6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f28626b684df4053a80f7b7f6413668e', 'request_id': 'req-3d10bf57-dfb5-49ba-b83c-c10053dec0b6'} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:43:00.214319 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-26e2cae9-6474-4e52-b7af-f64d8a166c57 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0623b145317e4164862cd8601813c000', 'request_id': 'req-26e2cae9-6474-4e52-b7af-f64d8a166c57'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:43:00.221387 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-3d10bf57-dfb5-49ba-b83c-c10053dec0b6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f28626b684df4053a80f7b7f6413668e', 'request_id': 'req-3d10bf57-dfb5-49ba-b83c-c10053dec0b6'} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:43:00.226453 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-26e2cae9-6474-4e52-b7af-f64d8a166c57 admin admin] The token cache is being invalidate because project 0623b145317e4164862cd8601813c000 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79880) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 05:43:00.226738 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-26e2cae9-6474-4e52-b7af-f64d8a166c57 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:43:00.227365 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-26e2cae9-6474-4e52-b7af-f64d8a166c57 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:43:00.229052 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1274/2586] 10.222.0.23 () {58 vars in 1232 bytes} [Tue May 10 05:43:00 2022] DELETE /identity/v3/projects/0623b145317e4164862cd8601813c000 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 05:43:00.233229 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-3d10bf57-dfb5-49ba-b83c-c10053dec0b6 admin admin] The token cache is being invalidate because project f28626b684df4053a80f7b7f6413668e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79879) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 05:43:00.233589 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-3d10bf57-dfb5-49ba-b83c-c10053dec0b6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:43:00.234286 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-3d10bf57-dfb5-49ba-b83c-c10053dec0b6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:43:00.234655 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caae7d04-eefe-419a-a979-80d30d703586 None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:43:00.234964 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caae7d04-eefe-419a-a979-80d30d703586 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:43:00.235337 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caae7d04-eefe-419a-a979-80d30d703586 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:43:00.236549 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1313/2587] 10.222.0.23 () {58 vars in 1232 bytes} [Tue May 10 05:43:00 2022] DELETE /identity/v3/projects/f28626b684df4053a80f7b7f6413668e => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 05:43:00.240753 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308114e7-c903-404e-aadb-0e073adddaff None None] REQUEST_METHOD: `POST` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:43:00.241040 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308114e7-c903-404e-aadb-0e073adddaff None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:43:00.241318 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308114e7-c903-404e-aadb-0e073adddaff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:43:00.254482 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-caae7d04-eefe-419a-a979-80d30d703586 None None] MFA Rules not processed for user `44883b22532e44049d846938dc2cf423`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:43:00.255828 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-caae7d04-eefe-419a-a979-80d30d703586 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:43:00.261253 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.auth.core [None req-308114e7-c903-404e-aadb-0e073adddaff None None] MFA Rules not processed for user `44883b22532e44049d846938dc2cf423`. Rule list: `[]` (Enabled: `True`). {{(pid=79879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:43:00.262428 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-308114e7-c903-404e-aadb-0e073adddaff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:43:00.316278 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1275/2588] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 10 05:43:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 05:43:00.323298 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1314/2589] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 10 05:43:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 05:43:00.328704 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5ecdbe-18ae-4b07-a75a-e82f6b12fdf7 None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:43:00.328912 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5ecdbe-18ae-4b07-a75a-e82f6b12fdf7 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:43:00.329184 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5ecdbe-18ae-4b07-a75a-e82f6b12fdf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:43:00.332064 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dce01bf-96a3-4fd8-9c7a-34c9f03f0b61 None None] REQUEST_METHOD: `POST` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:43:00.332362 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dce01bf-96a3-4fd8-9c7a-34c9f03f0b61 None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:43:00.332637 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dce01bf-96a3-4fd8-9c7a-34c9f03f0b61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:43:00.348112 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-4f5ecdbe-18ae-4b07-a75a-e82f6b12fdf7 None None] MFA Rules not processed for user `44883b22532e44049d846938dc2cf423`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:43:00.349364 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-4f5ecdbe-18ae-4b07-a75a-e82f6b12fdf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:43:00.350499 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.auth.core [None req-0dce01bf-96a3-4fd8-9c7a-34c9f03f0b61 None None] MFA Rules not processed for user `44883b22532e44049d846938dc2cf423`. Rule list: `[]` (Enabled: `True`). {{(pid=79879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:43:00.351393 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-0dce01bf-96a3-4fd8-9c7a-34c9f03f0b61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:43:00.358254 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1276/2590] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 10 05:43:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 05:43:00.362475 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5ecdbe-18ae-4b07-a75a-e82f6b12fdf7 None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:43:00.363710 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1315/2591] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 10 05:43:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 05:43:00.366883 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dce01bf-96a3-4fd8-9c7a-34c9f03f0b61 None None] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:43:00.371597 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5ecdbe-18ae-4b07-a75a-e82f6b12fdf7 None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:43:00.376299 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd2970a-2b7b-4823-a4b1-27375ee7e74e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:43:00.377091 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dce01bf-96a3-4fd8-9c7a-34c9f03f0b61 None None] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:43:00.377268 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd2970a-2b7b-4823-a4b1-27375ee7e74e admin admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:43:00.377548 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd2970a-2b7b-4823-a4b1-27375ee7e74e admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:43:00.377820 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd2970a-2b7b-4823-a4b1-27375ee7e74e admin admin] PATH_INFO: `/v3/domains` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:43:00.378673 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd2970a-2b7b-4823-a4b1-27375ee7e74e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:43:00.378993 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd2970a-2b7b-4823-a4b1-27375ee7e74e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:43:00.380831 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd2970a-2b7b-4823-a4b1-27375ee7e74e admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:43:00.381680 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073107b5-de54-4b95-85fc-0cac65a965aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:43:00.382332 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073107b5-de54-4b95-85fc-0cac65a965aa admin admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:43:00.382726 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073107b5-de54-4b95-85fc-0cac65a965aa admin admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:43:00.383012 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073107b5-de54-4b95-85fc-0cac65a965aa admin admin] PATH_INFO: `/v3/domains` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:43:00.383975 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073107b5-de54-4b95-85fc-0cac65a965aa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:43:00.384283 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073107b5-de54-4b95-85fc-0cac65a965aa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:43:00.385904 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073107b5-de54-4b95-85fc-0cac65a965aa admin admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:43:00.392297 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1277/2592] 10.222.0.23 () {58 vars in 1152 bytes} [Tue May 10 05:43:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 05:43:00.396770 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd2970a-2b7b-4823-a4b1-27375ee7e74e admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:43:00.400804 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1316/2593] 10.222.0.23 () {58 vars in 1152 bytes} [Tue May 10 05:43:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 05:43:00.401709 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073107b5-de54-4b95-85fc-0cac65a965aa admin admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:43:00.413492 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd2970a-2b7b-4823-a4b1-27375ee7e74e admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:43:00.417348 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073107b5-de54-4b95-85fc-0cac65a965aa admin admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:43:00.419075 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441c68fc-76da-4526-9d35-b66db1da3454 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:43:00.420071 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441c68fc-76da-4526-9d35-b66db1da3454 admin admin] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:43:00.420477 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441c68fc-76da-4526-9d35-b66db1da3454 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:43:00.420814 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441c68fc-76da-4526-9d35-b66db1da3454 admin admin] PATH_INFO: `/v3/projects` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:43:00.421583 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441c68fc-76da-4526-9d35-b66db1da3454 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:43:00.423739 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441c68fc-76da-4526-9d35-b66db1da3454 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:43:00.424177 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c237510a-9782-400a-b3b9-88b7322a97a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:43:00.424973 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c237510a-9782-400a-b3b9-88b7322a97a5 admin admin] REQUEST_METHOD: `POST` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:43:00.425353 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c237510a-9782-400a-b3b9-88b7322a97a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:43:00.425648 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c237510a-9782-400a-b3b9-88b7322a97a5 admin admin] PATH_INFO: `/v3/projects` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:43:00.426424 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c237510a-9782-400a-b3b9-88b7322a97a5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:43:00.428501 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c237510a-9782-400a-b3b9-88b7322a97a5 admin admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:43:00.462403 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1278/2594] 10.222.0.23 () {60 vars in 1152 bytes} [Tue May 10 05:43:00 2022] POST /identity/v3/projects => generated 381 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 05:43:00.462566 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1317/2595] 10.222.0.23 () {60 vars in 1152 bytes} [Tue May 10 05:43:00 2022] POST /identity/v3/projects => generated 387 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 05:43:00.464707 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441c68fc-76da-4526-9d35-b66db1da3454 admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:43:00.465889 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c237510a-9782-400a-b3b9-88b7322a97a5 admin admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:43:00.533195 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c237510a-9782-400a-b3b9-88b7322a97a5 admin admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:43:00.537800 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efcfcdf-874c-4db2-8572-397b718f48a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:43:00.538481 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efcfcdf-874c-4db2-8572-397b718f48a1 admin admin] REQUEST_METHOD: `POST` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:43:00.538761 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efcfcdf-874c-4db2-8572-397b718f48a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:43:00.539035 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efcfcdf-874c-4db2-8572-397b718f48a1 admin admin] PATH_INFO: `/v3/users` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:43:00.539759 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7efcfcdf-874c-4db2-8572-397b718f48a1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:43:00.541803 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7efcfcdf-874c-4db2-8572-397b718f48a1 admin admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:43:00.549893 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441c68fc-76da-4526-9d35-b66db1da3454 admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:43:00.555752 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd72d4d-63cc-4018-8cfb-b5585df0bc1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:43:00.556413 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd72d4d-63cc-4018-8cfb-b5585df0bc1a admin admin] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:43:00.556718 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd72d4d-63cc-4018-8cfb-b5585df0bc1a admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:43:00.557099 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd72d4d-63cc-4018-8cfb-b5585df0bc1a admin admin] PATH_INFO: `/v3/users` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:43:00.557694 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd72d4d-63cc-4018-8cfb-b5585df0bc1a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:43:00.559696 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd72d4d-63cc-4018-8cfb-b5585df0bc1a admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:43:00.565476 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1318/2596] 10.222.0.23 () {60 vars in 1143 bytes} [Tue May 10 05:43:00 2022] POST /identity/v3/users => generated 294 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 05:43:00.569450 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efcfcdf-874c-4db2-8572-397b718f48a1 admin admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:43:00.580939 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efcfcdf-874c-4db2-8572-397b718f48a1 admin admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:43:00.584917 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1279/2597] 10.222.0.23 () {60 vars in 1143 bytes} [Tue May 10 05:43:00 2022] POST /identity/v3/users => generated 291 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 05:43:00.586784 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a74353-3fde-462b-95f2-3e36143d7953 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:43:00.587771 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a74353-3fde-462b-95f2-3e36143d7953 admin admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:43:00.587946 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a74353-3fde-462b-95f2-3e36143d7953 admin admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:43:00.588202 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a74353-3fde-462b-95f2-3e36143d7953 admin admin] PATH_INFO: `/v3/roles` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:43:00.588967 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd72d4d-63cc-4018-8cfb-b5585df0bc1a admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:43:00.589259 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a74353-3fde-462b-95f2-3e36143d7953 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:43:00.591027 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a74353-3fde-462b-95f2-3e36143d7953 admin admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:43:00.599314 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd72d4d-63cc-4018-8cfb-b5585df0bc1a admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:43:00.605282 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1319/2598] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 10 05:43:00 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 05:43:00.606068 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a016389-6196-4dcd-b3d6-695e64256857 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:43:00.606068 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a016389-6196-4dcd-b3d6-695e64256857 admin admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:43:00.606068 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a016389-6196-4dcd-b3d6-695e64256857 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:43:00.606068 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a016389-6196-4dcd-b3d6-695e64256857 admin admin] PATH_INFO: `/v3/roles` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:43:00.606445 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a016389-6196-4dcd-b3d6-695e64256857 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:43:00.607082 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a74353-3fde-462b-95f2-3e36143d7953 admin admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:43:00.608445 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a016389-6196-4dcd-b3d6-695e64256857 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:43:00.619121 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1280/2599] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 10 05:43:00 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 05:43:00.620369 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a74353-3fde-462b-95f2-3e36143d7953 admin admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:43:00.623564 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a016389-6196-4dcd-b3d6-695e64256857 admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:43:00.626333 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da93de37-38d5-4706-a139-8c023ee22924 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:43:00.627634 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da93de37-38d5-4706-a139-8c023ee22924 admin admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:43:00.627917 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da93de37-38d5-4706-a139-8c023ee22924 admin admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:43:00.628213 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da93de37-38d5-4706-a139-8c023ee22924 admin admin] PATH_INFO: `/v3/roles` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:43:00.628939 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da93de37-38d5-4706-a139-8c023ee22924 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:43:00.630538 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da93de37-38d5-4706-a139-8c023ee22924 admin admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:43:00.636084 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a016389-6196-4dcd-b3d6-695e64256857 admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:43:00.641344 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915915fa-f9d8-4b07-8a59-b0e28e32e56d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:43:00.642167 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915915fa-f9d8-4b07-8a59-b0e28e32e56d admin admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:43:00.645728 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1320/2600] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 10 05:43:00 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 05:43:00.645866 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915915fa-f9d8-4b07-8a59-b0e28e32e56d admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:43:00.645866 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915915fa-f9d8-4b07-8a59-b0e28e32e56d admin admin] PATH_INFO: `/v3/roles` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:43:00.645866 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915915fa-f9d8-4b07-8a59-b0e28e32e56d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:43:00.645866 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915915fa-f9d8-4b07-8a59-b0e28e32e56d admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:43:00.646943 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da93de37-38d5-4706-a139-8c023ee22924 admin admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:43:00.657993 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da93de37-38d5-4706-a139-8c023ee22924 admin admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:43:00.658529 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1281/2601] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 10 05:43:00 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 05:43:00.663059 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915915fa-f9d8-4b07-8a59-b0e28e32e56d admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:43:00.667225 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7fad08-162e-4a93-9a2a-5c960d6be31a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:43:00.668323 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7fad08-162e-4a93-9a2a-5c960d6be31a admin admin] REQUEST_METHOD: `PUT` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:43:00.668672 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7fad08-162e-4a93-9a2a-5c960d6be31a admin admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:43:00.668991 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7fad08-162e-4a93-9a2a-5c960d6be31a admin admin] PATH_INFO: `/v3/projects/998793d838b64c7b988baedafa4301b8/users/1f095d6cc57b478e9e01830e27f8a38b/roles/382636e67fc142a2b2f486340d959e11` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:43:00.674102 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915915fa-f9d8-4b07-8a59-b0e28e32e56d admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:43:00.679616 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91387d97-a93f-4b69-ae22-aea5953023b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:43:00.680542 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91387d97-a93f-4b69-ae22-aea5953023b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:43:00.680879 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91387d97-a93f-4b69-ae22-aea5953023b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:43:00.681152 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91387d97-a93f-4b69-ae22-aea5953023b8 admin admin] PATH_INFO: `/v3/projects/cb1c9178f1e9469d9ac9ea1ffedc3d86/users/719be0a945844a43a5aad021a010e64a/roles/382636e67fc142a2b2f486340d959e11` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:43:00.687461 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7fad08-162e-4a93-9a2a-5c960d6be31a admin admin] RBAC: Authorizing `identity:create_grant(project_id=998793d838b64c7b988baedafa4301b8, user_id=1f095d6cc57b478e9e01830e27f8a38b, role_id=382636e67fc142a2b2f486340d959e11)` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:43:00.690143 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7fad08-162e-4a93-9a2a-5c960d6be31a admin admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:43:00.698990 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91387d97-a93f-4b69-ae22-aea5953023b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cb1c9178f1e9469d9ac9ea1ffedc3d86, user_id=719be0a945844a43a5aad021a010e64a, role_id=382636e67fc142a2b2f486340d959e11)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:43:00.701795 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91387d97-a93f-4b69-ae22-aea5953023b8 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:43:00.714114 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1321/2602] 10.222.0.23 () {60 vars in 1482 bytes} [Tue May 10 05:43:00 2022] PUT /identity/v3/projects/998793d838b64c7b988baedafa4301b8/users/1f095d6cc57b478e9e01830e27f8a38b/roles/382636e67fc142a2b2f486340d959e11 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 05:43:00.715903 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a502830-9246-47b6-84a9-8318e85332d8 None None] REQUEST_METHOD: `POST` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:43:00.716439 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a502830-9246-47b6-84a9-8318e85332d8 None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:43:00.716816 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a502830-9246-47b6-84a9-8318e85332d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:43:00.726310 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1282/2603] 10.222.0.23 () {60 vars in 1482 bytes} [Tue May 10 05:43:00 2022] PUT /identity/v3/projects/cb1c9178f1e9469d9ac9ea1ffedc3d86/users/719be0a945844a43a5aad021a010e64a/roles/382636e67fc142a2b2f486340d959e11 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 05:43:00.737362 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff6a70f-5c9e-4706-929a-40c698aabe31 None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:43:00.737651 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff6a70f-5c9e-4706-929a-40c698aabe31 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:43:00.737922 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff6a70f-5c9e-4706-929a-40c698aabe31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:43:00.749622 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.auth.core [None req-4a502830-9246-47b6-84a9-8318e85332d8 None None] MFA Rules not processed for user `1f095d6cc57b478e9e01830e27f8a38b`. Rule list: `[]` (Enabled: `True`). {{(pid=79879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:43:00.751293 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-4a502830-9246-47b6-84a9-8318e85332d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:43:00.768571 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-7ff6a70f-5c9e-4706-929a-40c698aabe31 None None] MFA Rules not processed for user `719be0a945844a43a5aad021a010e64a`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:43:00.770357 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-7ff6a70f-5c9e-4706-929a-40c698aabe31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:43:00.824203 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1322/2604] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 10 05:43:00 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 05:43:00.829220 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a502830-9246-47b6-84a9-8318e85332d8 None None] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:43:00.863881 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1283/2605] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 10 05:43:00 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 05:43:00.869110 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff6a70f-5c9e-4706-929a-40c698aabe31 None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:43:00.903157 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a502830-9246-47b6-84a9-8318e85332d8 None None] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:43:00.909370 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2ce0a9-8c52-49c8-8366-c35d0d0680d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:43:00.910130 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2ce0a9-8c52-49c8-8366-c35d0d0680d8 admin admin] REQUEST_METHOD: `POST` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:43:00.910420 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2ce0a9-8c52-49c8-8366-c35d0d0680d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:43:00.910786 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2ce0a9-8c52-49c8-8366-c35d0d0680d8 admin admin] PATH_INFO: `/v3/projects` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:43:00.912103 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2ce0a9-8c52-49c8-8366-c35d0d0680d8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:43:00.914096 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2ce0a9-8c52-49c8-8366-c35d0d0680d8 admin admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:43:00.931147 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff6a70f-5c9e-4706-929a-40c698aabe31 None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:43:00.935818 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b209f05a-2e79-478e-bc15-3780a3161e73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:43:00.936488 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b209f05a-2e79-478e-bc15-3780a3161e73 admin admin] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:43:00.936770 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b209f05a-2e79-478e-bc15-3780a3161e73 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:43:00.937046 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b209f05a-2e79-478e-bc15-3780a3161e73 admin admin] PATH_INFO: `/v3/projects` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:43:00.937739 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b209f05a-2e79-478e-bc15-3780a3161e73 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:43:00.942406 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1323/2606] 10.222.0.23 () {60 vars in 1152 bytes} [Tue May 10 05:43:00 2022] POST /identity/v3/projects => generated 387 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 05:43:00.942561 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b209f05a-2e79-478e-bc15-3780a3161e73 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:43:00.943389 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2ce0a9-8c52-49c8-8366-c35d0d0680d8 admin admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:43:00.968696 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1284/2607] 10.222.0.23 () {60 vars in 1152 bytes} [Tue May 10 05:43:00 2022] POST /identity/v3/projects => generated 379 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 05:43:00.970030 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b209f05a-2e79-478e-bc15-3780a3161e73 admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:43:01.005513 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2ce0a9-8c52-49c8-8366-c35d0d0680d8 admin admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:43:01.029863 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b209f05a-2e79-478e-bc15-3780a3161e73 admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:43:01.034822 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a687da-40e0-429e-ade2-897c95809fb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:43:01.035521 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a687da-40e0-429e-ade2-897c95809fb4 admin admin] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:43:01.035835 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a687da-40e0-429e-ade2-897c95809fb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:43:01.036102 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a687da-40e0-429e-ade2-897c95809fb4 admin admin] PATH_INFO: `/v3/users` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:43:01.036838 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a687da-40e0-429e-ade2-897c95809fb4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:43:01.038834 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a687da-40e0-429e-ade2-897c95809fb4 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:43:01.059606 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1285/2608] 10.222.0.23 () {60 vars in 1143 bytes} [Tue May 10 05:43:00 2022] POST /identity/v3/users => generated 296 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 05:43:01.063027 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a687da-40e0-429e-ade2-897c95809fb4 admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:43:01.064727 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75a8a7b-4c7e-40fd-8073-187f20135ee2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:43:01.065407 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75a8a7b-4c7e-40fd-8073-187f20135ee2 admin admin] REQUEST_METHOD: `POST` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:43:01.065686 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75a8a7b-4c7e-40fd-8073-187f20135ee2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:43:01.065954 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75a8a7b-4c7e-40fd-8073-187f20135ee2 admin admin] PATH_INFO: `/v3/users` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:43:01.066637 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75a8a7b-4c7e-40fd-8073-187f20135ee2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:43:01.068579 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75a8a7b-4c7e-40fd-8073-187f20135ee2 admin admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:43:01.073138 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a687da-40e0-429e-ade2-897c95809fb4 admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:43:01.077887 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d897a7-73ef-4df1-9452-3f35926b0b9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:43:01.078581 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d897a7-73ef-4df1-9452-3f35926b0b9d admin admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:43:01.078913 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d897a7-73ef-4df1-9452-3f35926b0b9d admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:43:01.079224 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d897a7-73ef-4df1-9452-3f35926b0b9d admin admin] PATH_INFO: `/v3/roles` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:43:01.080183 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d897a7-73ef-4df1-9452-3f35926b0b9d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:43:01.082003 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d897a7-73ef-4df1-9452-3f35926b0b9d admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:43:01.092317 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1324/2609] 10.222.0.23 () {60 vars in 1143 bytes} [Tue May 10 05:43:00 2022] POST /identity/v3/users => generated 300 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 05:43:01.092473 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1286/2610] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 10 05:43:01 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 05:43:01.093451 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75a8a7b-4c7e-40fd-8073-187f20135ee2 admin admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:43:01.096267 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d897a7-73ef-4df1-9452-3f35926b0b9d admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:43:01.102994 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75a8a7b-4c7e-40fd-8073-187f20135ee2 admin admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:43:01.105777 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d897a7-73ef-4df1-9452-3f35926b0b9d admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:43:01.107677 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42e1998-146c-4271-976f-e462ce2ca1cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:43:01.108323 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42e1998-146c-4271-976f-e462ce2ca1cf admin admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:43:01.108606 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42e1998-146c-4271-976f-e462ce2ca1cf admin admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:43:01.108882 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42e1998-146c-4271-976f-e462ce2ca1cf admin admin] PATH_INFO: `/v3/roles` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:43:01.109615 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42e1998-146c-4271-976f-e462ce2ca1cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:43:01.111199 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42e1998-146c-4271-976f-e462ce2ca1cf admin admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:43:01.111442 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2f6560-cbf5-4dc3-815f-d30e393fc499 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:43:01.112436 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2f6560-cbf5-4dc3-815f-d30e393fc499 admin admin] REQUEST_METHOD: `PUT` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:43:01.112789 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2f6560-cbf5-4dc3-815f-d30e393fc499 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:43:01.113142 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2f6560-cbf5-4dc3-815f-d30e393fc499 admin admin] PATH_INFO: `/v3/projects/1c6e4683051842798624a52e835b42ca/users/f5a4e03ce6fc4c5c905255375c4ef3e9/roles/199ac1dd842441d7913c6ee89d8fbecc` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:43:01.121117 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1325/2611] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 10 05:43:01 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 05:43:01.125261 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42e1998-146c-4271-976f-e462ce2ca1cf admin admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:43:01.130552 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2f6560-cbf5-4dc3-815f-d30e393fc499 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c6e4683051842798624a52e835b42ca, user_id=f5a4e03ce6fc4c5c905255375c4ef3e9, role_id=199ac1dd842441d7913c6ee89d8fbecc)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:43:01.133248 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2f6560-cbf5-4dc3-815f-d30e393fc499 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:43:01.134706 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42e1998-146c-4271-976f-e462ce2ca1cf admin admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:43:01.139760 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fd33d4-9c58-42df-ae5c-e26dd93bfa0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:43:01.140612 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fd33d4-9c58-42df-ae5c-e26dd93bfa0c admin admin] REQUEST_METHOD: `PUT` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:43:01.140882 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fd33d4-9c58-42df-ae5c-e26dd93bfa0c admin admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:43:01.141194 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fd33d4-9c58-42df-ae5c-e26dd93bfa0c admin admin] PATH_INFO: `/v3/projects/1c5e8c70c61d476789a1653d30611573/users/e4d1c9e066c1420181fc89a4a60e5624/roles/199ac1dd842441d7913c6ee89d8fbecc` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:43:01.146540 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1287/2612] 10.222.0.23 () {60 vars in 1482 bytes} [Tue May 10 05:43:01 2022] PUT /identity/v3/projects/1c6e4683051842798624a52e835b42ca/users/f5a4e03ce6fc4c5c905255375c4ef3e9/roles/199ac1dd842441d7913c6ee89d8fbecc => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 05:43:01.150225 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2f6560-cbf5-4dc3-815f-d30e393fc499 admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:43:01.157623 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90fd33d4-9c58-42df-ae5c-e26dd93bfa0c admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c5e8c70c61d476789a1653d30611573, user_id=e4d1c9e066c1420181fc89a4a60e5624, role_id=199ac1dd842441d7913c6ee89d8fbecc)` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:43:01.160372 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90fd33d4-9c58-42df-ae5c-e26dd93bfa0c admin admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:43:01.174552 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1326/2613] 10.222.0.23 () {60 vars in 1482 bytes} [Tue May 10 05:43:01 2022] PUT /identity/v3/projects/1c5e8c70c61d476789a1653d30611573/users/e4d1c9e066c1420181fc89a4a60e5624/roles/199ac1dd842441d7913c6ee89d8fbecc => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 05:43:01.178158 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fd33d4-9c58-42df-ae5c-e26dd93bfa0c admin admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:43:01.208737 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2f6560-cbf5-4dc3-815f-d30e393fc499 admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:43:01.235297 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fd33d4-9c58-42df-ae5c-e26dd93bfa0c admin admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:43:01.240000 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b92bb3-e4de-44fc-9262-04a3896d926c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:43:01.240663 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b92bb3-e4de-44fc-9262-04a3896d926c admin admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:43:01.240944 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b92bb3-e4de-44fc-9262-04a3896d926c admin admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:43:01.241217 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b92bb3-e4de-44fc-9262-04a3896d926c admin admin] PATH_INFO: `/v3/roles` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:43:01.241979 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b92bb3-e4de-44fc-9262-04a3896d926c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:43:01.243609 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b92bb3-e4de-44fc-9262-04a3896d926c admin admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:43:01.253656 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1327/2614] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 10 05:43:01 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 05:43:01.257932 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b92bb3-e4de-44fc-9262-04a3896d926c admin admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:43:01.261966 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b888d95-7652-4fc5-a6eb-f28a15c654df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:43:01.262638 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b888d95-7652-4fc5-a6eb-f28a15c654df admin admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:43:01.262922 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b888d95-7652-4fc5-a6eb-f28a15c654df admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:43:01.263200 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b888d95-7652-4fc5-a6eb-f28a15c654df admin admin] PATH_INFO: `/v3/roles` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:43:01.264026 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b888d95-7652-4fc5-a6eb-f28a15c654df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:43:01.265625 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b888d95-7652-4fc5-a6eb-f28a15c654df admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:43:01.267777 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b92bb3-e4de-44fc-9262-04a3896d926c admin admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:43:01.272532 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c1cb56-63d3-43fb-8bc2-e73ccb4fd2cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:43:01.273378 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c1cb56-63d3-43fb-8bc2-e73ccb4fd2cb admin admin] REQUEST_METHOD: `PUT` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:43:01.273655 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c1cb56-63d3-43fb-8bc2-e73ccb4fd2cb admin admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:43:01.273927 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c1cb56-63d3-43fb-8bc2-e73ccb4fd2cb admin admin] PATH_INFO: `/v3/projects/1c5e8c70c61d476789a1653d30611573/users/e4d1c9e066c1420181fc89a4a60e5624/roles/199ac1dd842441d7913c6ee89d8fbecc` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:43:01.275434 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1288/2615] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 10 05:43:01 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 05:43:01.275927 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c1cb56-63d3-43fb-8bc2-e73ccb4fd2cb admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c5e8c70c61d476789a1653d30611573, user_id=e4d1c9e066c1420181fc89a4a60e5624, role_id=199ac1dd842441d7913c6ee89d8fbecc)` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:43:01.278519 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c1cb56-63d3-43fb-8bc2-e73ccb4fd2cb admin admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:43:01.279481 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b888d95-7652-4fc5-a6eb-f28a15c654df admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:43:01.288691 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1328/2616] 10.222.0.23 () {60 vars in 1482 bytes} [Tue May 10 05:43:01 2022] PUT /identity/v3/projects/1c5e8c70c61d476789a1653d30611573/users/e4d1c9e066c1420181fc89a4a60e5624/roles/199ac1dd842441d7913c6ee89d8fbecc => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 05:43:01.297511 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b888d95-7652-4fc5-a6eb-f28a15c654df admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:43:01.299470 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c90b42-cc4e-4689-a790-9ee48f02410d None None] REQUEST_METHOD: `POST` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:43:01.299849 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c90b42-cc4e-4689-a790-9ee48f02410d None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:43:01.300137 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c90b42-cc4e-4689-a790-9ee48f02410d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:43:01.325758 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.auth.core [None req-b6c90b42-cc4e-4689-a790-9ee48f02410d None None] MFA Rules not processed for user `e4d1c9e066c1420181fc89a4a60e5624`. Rule list: `[]` (Enabled: `True`). {{(pid=79879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:43:01.326960 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-b6c90b42-cc4e-4689-a790-9ee48f02410d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:43:01.342154 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3b0ce5-d4f1-42b6-a040-eb44944c0a91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:43:01.343049 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3b0ce5-d4f1-42b6-a040-eb44944c0a91 admin admin] REQUEST_METHOD: `PUT` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:43:01.343390 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3b0ce5-d4f1-42b6-a040-eb44944c0a91 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:43:01.343692 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3b0ce5-d4f1-42b6-a040-eb44944c0a91 admin admin] PATH_INFO: `/v3/projects/1c6e4683051842798624a52e835b42ca/users/f5a4e03ce6fc4c5c905255375c4ef3e9/roles/199ac1dd842441d7913c6ee89d8fbecc` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:43:01.345659 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3b0ce5-d4f1-42b6-a040-eb44944c0a91 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c6e4683051842798624a52e835b42ca, user_id=f5a4e03ce6fc4c5c905255375c4ef3e9, role_id=199ac1dd842441d7913c6ee89d8fbecc)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:43:01.348362 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3b0ce5-d4f1-42b6-a040-eb44944c0a91 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:43:01.360749 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1289/2617] 10.222.0.23 () {60 vars in 1482 bytes} [Tue May 10 05:43:01 2022] PUT /identity/v3/projects/1c6e4683051842798624a52e835b42ca/users/f5a4e03ce6fc4c5c905255375c4ef3e9/roles/199ac1dd842441d7913c6ee89d8fbecc => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 05:43:01.370958 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d58c339-0a96-4669-bc30-5b5294ddc688 None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:43:01.371364 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d58c339-0a96-4669-bc30-5b5294ddc688 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:43:01.371558 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d58c339-0a96-4669-bc30-5b5294ddc688 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:43:01.392990 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1329/2618] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 10 05:43:01 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 05:43:01.398595 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-5d58c339-0a96-4669-bc30-5b5294ddc688 None None] MFA Rules not processed for user `f5a4e03ce6fc4c5c905255375c4ef3e9`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:43:01.399845 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-5d58c339-0a96-4669-bc30-5b5294ddc688 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:43:01.404346 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c90b42-cc4e-4689-a790-9ee48f02410d None None] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:43:01.405763 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-b6c90b42-cc4e-4689-a790-9ee48f02410d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:43:01.460857 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c90b42-cc4e-4689-a790-9ee48f02410d None None] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:43:01.478386 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1290/2619] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 10 05:43:01 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 05:43:01.486120 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d58c339-0a96-4669-bc30-5b5294ddc688 None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:43:01.487541 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-5d58c339-0a96-4669-bc30-5b5294ddc688 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:43:01.510245 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b48051-6395-4983-adcd-18dea1995bc9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355be413675540a39ccb00e1a0722316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f23435f783540199d6dcfd0417c090e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:43:01.511014 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b48051-6395-4983-adcd-18dea1995bc9 service cinder] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:43:01.511294 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b48051-6395-4983-adcd-18dea1995bc9 service cinder] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:43:01.511562 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b48051-6395-4983-adcd-18dea1995bc9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:43:01.542160 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d58c339-0a96-4669-bc30-5b5294ddc688 None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:43:01.545907 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df181d76-a647-4f8d-9a59-191b8007ddea service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355be413675540a39ccb00e1a0722316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f23435f783540199d6dcfd0417c090e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:43:01.547912 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df181d76-a647-4f8d-9a59-191b8007ddea service cinder] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:43:01.547912 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df181d76-a647-4f8d-9a59-191b8007ddea service cinder] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:43:01.547912 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df181d76-a647-4f8d-9a59-191b8007ddea service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:43:01.557298 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df181d76-a647-4f8d-9a59-191b8007ddea service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:43:01.558732 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df181d76-a647-4f8d-9a59-191b8007ddea service cinder] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:43:01.570125 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1291/2620] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 10 05:43:01 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 05:43:01.572434 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b48051-6395-4983-adcd-18dea1995bc9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:43:01.574194 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b48051-6395-4983-adcd-18dea1995bc9 service cinder] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:43:01.585143 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1330/2621] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 10 05:43:01 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 05:43:01.623461 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df181d76-a647-4f8d-9a59-191b8007ddea service cinder] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:43:01.657620 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b48051-6395-4983-adcd-18dea1995bc9 service cinder] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:43:01.666111 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b48051-6395-4983-adcd-18dea1995bc9 service cinder] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:43:01.669936 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772c9ae3-927e-4448-9e1d-28ecde5007af service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355be413675540a39ccb00e1a0722316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f23435f783540199d6dcfd0417c090e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:43:01.670638 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772c9ae3-927e-4448-9e1d-28ecde5007af service cinder] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:43:01.670981 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772c9ae3-927e-4448-9e1d-28ecde5007af service cinder] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:43:01.671317 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772c9ae3-927e-4448-9e1d-28ecde5007af service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:43:01.688186 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df181d76-a647-4f8d-9a59-191b8007ddea service cinder] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:43:01.693116 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8e773f-032e-4bea-99c5-3c5c989ec3fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:43:01.694087 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8e773f-032e-4bea-99c5-3c5c989ec3fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:43:01.694428 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8e773f-032e-4bea-99c5-3c5c989ec3fe admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:43:01.694759 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8e773f-032e-4bea-99c5-3c5c989ec3fe admin admin] PATH_INFO: `/v3/users/1f095d6cc57b478e9e01830e27f8a38b` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:43:01.696040 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8e773f-032e-4bea-99c5-3c5c989ec3fe admin admin] RBAC: Authorizing `identity:delete_user(user_id=1f095d6cc57b478e9e01830e27f8a38b)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:43:01.698010 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8e773f-032e-4bea-99c5-3c5c989ec3fe admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:43:01.726557 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772c9ae3-927e-4448-9e1d-28ecde5007af service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:43:01.728037 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772c9ae3-927e-4448-9e1d-28ecde5007af service cinder] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:43:01.739126 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1331/2622] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 10 05:43:01 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 05:43:01.744105 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-5e8e773f-032e-4bea-99c5-3c5c989ec3fe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1f095d6cc57b478e9e01830e27f8a38b'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:43:01.757672 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-5e8e773f-032e-4bea-99c5-3c5c989ec3fe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1f095d6cc57b478e9e01830e27f8a38b'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:43:01.758543 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-5e8e773f-032e-4bea-99c5-3c5c989ec3fe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1f095d6cc57b478e9e01830e27f8a38b'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:43:01.765730 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-5e8e773f-032e-4bea-99c5-3c5c989ec3fe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1f095d6cc57b478e9e01830e27f8a38b'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:43:01.766612 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-5e8e773f-032e-4bea-99c5-3c5c989ec3fe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1f095d6cc57b478e9e01830e27f8a38b'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:43:01.782594 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1292/2623] 10.222.0.23 () {58 vars in 1223 bytes} [Tue May 10 05:43:01 2022] DELETE /identity/v3/users/1f095d6cc57b478e9e01830e27f8a38b => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 05:43:01.788377 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7628660-3b08-41c2-b51f-927e87b2ef3c None None] REQUEST_METHOD: `POST` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:43:01.788671 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7628660-3b08-41c2-b51f-927e87b2ef3c None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:43:01.789081 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7628660-3b08-41c2-b51f-927e87b2ef3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:43:01.807201 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.auth.core [None req-c7628660-3b08-41c2-b51f-927e87b2ef3c None None] MFA Rules not processed for user `44883b22532e44049d846938dc2cf423`. Rule list: `[]` (Enabled: `True`). {{(pid=79879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:43:01.808456 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-c7628660-3b08-41c2-b51f-927e87b2ef3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:43:01.875717 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1332/2624] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 10 05:43:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 05:43:01.890025 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8e773f-032e-4bea-99c5-3c5c989ec3fe admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:43:01.890025 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-5e8e773f-032e-4bea-99c5-3c5c989ec3fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:43:01.987510 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8e773f-032e-4bea-99c5-3c5c989ec3fe admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:43:01.991625 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0411c235-7076-486c-bd1e-0787a83a7c46 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c8461cfdd9648b8abcaf8d34b7a102a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f23435f783540199d6dcfd0417c090e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:43:01.992227 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0411c235-7076-486c-bd1e-0787a83a7c46 service neutron] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:43:01.992509 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0411c235-7076-486c-bd1e-0787a83a7c46 service neutron] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:43:01.992784 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0411c235-7076-486c-bd1e-0787a83a7c46 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:43:02.003251 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0411c235-7076-486c-bd1e-0787a83a7c46 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:43:02.004749 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0411c235-7076-486c-bd1e-0787a83a7c46 service neutron] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:43:02.016783 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1293/2625] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 10 05:43:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 05:43:02.294209 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7628660-3b08-41c2-b51f-927e87b2ef3c None None] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:43:02.295851 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-c7628660-3b08-41c2-b51f-927e87b2ef3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:43:02.310361 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7628660-3b08-41c2-b51f-927e87b2ef3c None None] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:43:02.322033 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c8865b-87a1-4c2e-ba71-50010d8d20b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:43:02.322979 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c8865b-87a1-4c2e-ba71-50010d8d20b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:43:02.323271 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c8865b-87a1-4c2e-ba71-50010d8d20b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:43:02.323550 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c8865b-87a1-4c2e-ba71-50010d8d20b6 admin admin] PATH_INFO: `/v3/projects/998793d838b64c7b988baedafa4301b8` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:43:02.325521 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c8865b-87a1-4c2e-ba71-50010d8d20b6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=998793d838b64c7b988baedafa4301b8)` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:43:02.327566 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c8865b-87a1-4c2e-ba71-50010d8d20b6 admin admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:43:02.379812 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-40c8865b-87a1-4c2e-ba71-50010d8d20b6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '998793d838b64c7b988baedafa4301b8', 'request_id': 'req-40c8865b-87a1-4c2e-ba71-50010d8d20b6'} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:43:02.385977 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-40c8865b-87a1-4c2e-ba71-50010d8d20b6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '998793d838b64c7b988baedafa4301b8', 'request_id': 'req-40c8865b-87a1-4c2e-ba71-50010d8d20b6'} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:43:02.393903 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-40c8865b-87a1-4c2e-ba71-50010d8d20b6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '998793d838b64c7b988baedafa4301b8', 'request_id': 'req-40c8865b-87a1-4c2e-ba71-50010d8d20b6'} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:43:02.404898 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-40c8865b-87a1-4c2e-ba71-50010d8d20b6 admin admin] The token cache is being invalidate because project 998793d838b64c7b988baedafa4301b8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79879) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 05:43:02.405262 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-40c8865b-87a1-4c2e-ba71-50010d8d20b6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:43:02.405844 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-40c8865b-87a1-4c2e-ba71-50010d8d20b6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:43:02.407900 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1333/2626] 10.222.0.23 () {58 vars in 1232 bytes} [Tue May 10 05:43:02 2022] DELETE /identity/v3/projects/998793d838b64c7b988baedafa4301b8 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 05:43:02.411810 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0411c235-7076-486c-bd1e-0787a83a7c46 service neutron] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:43:02.426571 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0411c235-7076-486c-bd1e-0787a83a7c46 service neutron] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:43:02.500629 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2a885e-dbfe-4394-9bdd-843e84fa4794 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:43:02.501599 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2a885e-dbfe-4394-9bdd-843e84fa4794 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:43:02.502192 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2a885e-dbfe-4394-9bdd-843e84fa4794 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:43:02.502470 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2a885e-dbfe-4394-9bdd-843e84fa4794 admin admin] PATH_INFO: `/v3/users/e4d1c9e066c1420181fc89a4a60e5624` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:43:02.504674 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2a885e-dbfe-4394-9bdd-843e84fa4794 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e4d1c9e066c1420181fc89a4a60e5624)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:43:02.506946 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2a885e-dbfe-4394-9bdd-843e84fa4794 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:43:02.557405 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-eb2a885e-dbfe-4394-9bdd-843e84fa4794 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e4d1c9e066c1420181fc89a4a60e5624'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:43:02.569642 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-eb2a885e-dbfe-4394-9bdd-843e84fa4794 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e4d1c9e066c1420181fc89a4a60e5624'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:43:02.570394 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-eb2a885e-dbfe-4394-9bdd-843e84fa4794 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e4d1c9e066c1420181fc89a4a60e5624'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:43:02.577244 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-eb2a885e-dbfe-4394-9bdd-843e84fa4794 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e4d1c9e066c1420181fc89a4a60e5624'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:43:02.577957 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-eb2a885e-dbfe-4394-9bdd-843e84fa4794 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e4d1c9e066c1420181fc89a4a60e5624'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:43:02.592375 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1294/2627] 10.222.0.23 () {58 vars in 1223 bytes} [Tue May 10 05:43:02 2022] DELETE /identity/v3/users/e4d1c9e066c1420181fc89a4a60e5624 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 05:43:02.866813 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c8865b-87a1-4c2e-ba71-50010d8d20b6 admin admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:43:02.868407 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-40c8865b-87a1-4c2e-ba71-50010d8d20b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:43:02.883147 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c8865b-87a1-4c2e-ba71-50010d8d20b6 admin admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:43:02.980687 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29211509-fe90-4488-a783-e1c95d69ed40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:43:02.980687 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29211509-fe90-4488-a783-e1c95d69ed40 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:43:02.980687 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29211509-fe90-4488-a783-e1c95d69ed40 admin admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:43:02.980687 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29211509-fe90-4488-a783-e1c95d69ed40 admin admin] PATH_INFO: `/v3/projects/1c5e8c70c61d476789a1653d30611573` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:43:02.981025 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29211509-fe90-4488-a783-e1c95d69ed40 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1c5e8c70c61d476789a1653d30611573)` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:43:02.981611 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29211509-fe90-4488-a783-e1c95d69ed40 admin admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:43:03.043077 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-29211509-fe90-4488-a783-e1c95d69ed40 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1c5e8c70c61d476789a1653d30611573', 'request_id': 'req-29211509-fe90-4488-a783-e1c95d69ed40'} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:43:03.051017 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-29211509-fe90-4488-a783-e1c95d69ed40 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1c5e8c70c61d476789a1653d30611573', 'request_id': 'req-29211509-fe90-4488-a783-e1c95d69ed40'} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:43:03.062321 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-29211509-fe90-4488-a783-e1c95d69ed40 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1c5e8c70c61d476789a1653d30611573', 'request_id': 'req-29211509-fe90-4488-a783-e1c95d69ed40'} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:43:03.079431 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-29211509-fe90-4488-a783-e1c95d69ed40 admin admin] The token cache is being invalidate because project 1c5e8c70c61d476789a1653d30611573 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79879) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 05:43:03.079824 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-29211509-fe90-4488-a783-e1c95d69ed40 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:43:03.080864 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-29211509-fe90-4488-a783-e1c95d69ed40 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:43:03.082960 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1334/2628] 10.222.0.23 () {58 vars in 1232 bytes} [Tue May 10 05:43:02 2022] DELETE /identity/v3/projects/1c5e8c70c61d476789a1653d30611573 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 05:43:03.087975 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6013760-594a-431d-9bca-0f65f50b29d7 None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:43:03.088300 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6013760-594a-431d-9bca-0f65f50b29d7 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:43:03.088633 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6013760-594a-431d-9bca-0f65f50b29d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:43:03.113633 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-a6013760-594a-431d-9bca-0f65f50b29d7 None None] MFA Rules not processed for user `44883b22532e44049d846938dc2cf423`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:43:03.114849 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-a6013760-594a-431d-9bca-0f65f50b29d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:43:03.178303 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1295/2629] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 10 05:43:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 05:43:03.187346 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913096f7-8838-4f01-b8c6-14a56f8958e1 None None] REQUEST_METHOD: `POST` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:43:03.187667 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913096f7-8838-4f01-b8c6-14a56f8958e1 None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:43:03.187997 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913096f7-8838-4f01-b8c6-14a56f8958e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:43:03.213247 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.auth.core [None req-913096f7-8838-4f01-b8c6-14a56f8958e1 None None] MFA Rules not processed for user `44883b22532e44049d846938dc2cf423`. Rule list: `[]` (Enabled: `True`). {{(pid=79879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:43:03.214982 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-913096f7-8838-4f01-b8c6-14a56f8958e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:43:03.227636 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1335/2630] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 10 05:43:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 05:43:03.229858 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6013760-594a-431d-9bca-0f65f50b29d7 None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:43:03.240888 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6013760-594a-431d-9bca-0f65f50b29d7 None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:43:03.245696 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6aca25a-a0e8-46bc-8500-3c870e4ab292 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:43:03.246366 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6aca25a-a0e8-46bc-8500-3c870e4ab292 admin admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:43:03.246719 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6aca25a-a0e8-46bc-8500-3c870e4ab292 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:43:03.246915 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6aca25a-a0e8-46bc-8500-3c870e4ab292 admin admin] PATH_INFO: `/v3/domains` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:43:03.247673 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6aca25a-a0e8-46bc-8500-3c870e4ab292 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:43:03.248023 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6aca25a-a0e8-46bc-8500-3c870e4ab292 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:43:03.249615 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6aca25a-a0e8-46bc-8500-3c870e4ab292 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:43:03.265977 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1296/2631] 10.222.0.23 () {58 vars in 1152 bytes} [Tue May 10 05:43:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:43:03.266941 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913096f7-8838-4f01-b8c6-14a56f8958e1 None None] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:43:03.276447 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913096f7-8838-4f01-b8c6-14a56f8958e1 None None] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:43:03.281886 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0008172d-30d7-4712-9f2a-60b64f6af0cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:43:03.282748 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0008172d-30d7-4712-9f2a-60b64f6af0cb admin admin] REQUEST_METHOD: `POST` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:43:03.283059 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0008172d-30d7-4712-9f2a-60b64f6af0cb admin admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:43:03.283338 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0008172d-30d7-4712-9f2a-60b64f6af0cb admin admin] PATH_INFO: `/v3/projects` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:43:03.284080 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0008172d-30d7-4712-9f2a-60b64f6af0cb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:43:03.286083 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0008172d-30d7-4712-9f2a-60b64f6af0cb admin admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:43:03.324318 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1336/2632] 10.222.0.23 () {60 vars in 1152 bytes} [Tue May 10 05:43:03 2022] POST /identity/v3/projects => generated 391 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 05:43:03.328493 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6aca25a-a0e8-46bc-8500-3c870e4ab292 admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:43:03.341037 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6aca25a-a0e8-46bc-8500-3c870e4ab292 admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:43:03.434138 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ea3988-28dc-4473-a087-48625acf3343 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:43:03.434820 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ea3988-28dc-4473-a087-48625acf3343 admin admin] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:43:03.435101 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ea3988-28dc-4473-a087-48625acf3343 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:43:03.435432 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ea3988-28dc-4473-a087-48625acf3343 admin admin] PATH_INFO: `/v3/users` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:43:03.436172 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ea3988-28dc-4473-a087-48625acf3343 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:43:03.438073 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ea3988-28dc-4473-a087-48625acf3343 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:43:03.461901 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1297/2633] 10.222.0.23 () {60 vars in 1143 bytes} [Tue May 10 05:43:03 2022] POST /identity/v3/users => generated 296 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 05:43:03.463597 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0008172d-30d7-4712-9f2a-60b64f6af0cb admin admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:43:03.474973 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0008172d-30d7-4712-9f2a-60b64f6af0cb admin admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:43:03.480234 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843bbc3a-66b5-42b3-be00-005e4a3439d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:43:03.480909 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843bbc3a-66b5-42b3-be00-005e4a3439d6 admin admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:43:03.481187 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843bbc3a-66b5-42b3-be00-005e4a3439d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:43:03.481459 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843bbc3a-66b5-42b3-be00-005e4a3439d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:43:03.482232 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843bbc3a-66b5-42b3-be00-005e4a3439d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:43:03.483852 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843bbc3a-66b5-42b3-be00-005e4a3439d6 admin admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:43:03.495282 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1337/2634] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 10 05:43:03 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 05:43:03.499542 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ea3988-28dc-4473-a087-48625acf3343 admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:43:03.510060 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ea3988-28dc-4473-a087-48625acf3343 admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:43:03.514878 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa0ce00-6539-4bfe-8c6a-1af8af9e2868 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:43:03.515595 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa0ce00-6539-4bfe-8c6a-1af8af9e2868 admin admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:43:03.515871 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa0ce00-6539-4bfe-8c6a-1af8af9e2868 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:43:03.516149 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa0ce00-6539-4bfe-8c6a-1af8af9e2868 admin admin] PATH_INFO: `/v3/roles` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:43:03.516889 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa0ce00-6539-4bfe-8c6a-1af8af9e2868 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:43:03.518525 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa0ce00-6539-4bfe-8c6a-1af8af9e2868 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:43:03.531763 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1298/2635] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 10 05:43:03 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 05:43:03.533603 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843bbc3a-66b5-42b3-be00-005e4a3439d6 admin admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:43:03.543657 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843bbc3a-66b5-42b3-be00-005e4a3439d6 admin admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:43:03.548361 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd79c44-640e-42b1-984b-96df57bb23c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:43:03.549424 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd79c44-640e-42b1-984b-96df57bb23c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:43:03.549768 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd79c44-640e-42b1-984b-96df57bb23c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:43:03.550108 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd79c44-640e-42b1-984b-96df57bb23c1 admin admin] PATH_INFO: `/v3/projects/ce088da1d4a445ee8a0c91f1b2c576f6/users/945f83903a2b49918f2bae9e33d46f73/roles/382636e67fc142a2b2f486340d959e11` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:43:03.564539 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd79c44-640e-42b1-984b-96df57bb23c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce088da1d4a445ee8a0c91f1b2c576f6, user_id=945f83903a2b49918f2bae9e33d46f73, role_id=382636e67fc142a2b2f486340d959e11)` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:43:03.567378 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd79c44-640e-42b1-984b-96df57bb23c1 admin admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:43:03.580990 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1338/2636] 10.222.0.23 () {60 vars in 1482 bytes} [Tue May 10 05:43:03 2022] PUT /identity/v3/projects/ce088da1d4a445ee8a0c91f1b2c576f6/users/945f83903a2b49918f2bae9e33d46f73/roles/382636e67fc142a2b2f486340d959e11 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 05:43:03.591939 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37afc89f-008d-4676-9361-2e78644e7d42 None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:43:03.592513 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37afc89f-008d-4676-9361-2e78644e7d42 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:43:03.592513 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37afc89f-008d-4676-9361-2e78644e7d42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:43:03.620033 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-37afc89f-008d-4676-9361-2e78644e7d42 None None] MFA Rules not processed for user `945f83903a2b49918f2bae9e33d46f73`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:43:03.621249 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-37afc89f-008d-4676-9361-2e78644e7d42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:43:03.694227 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1299/2637] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 10 05:43:03 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 05:43:03.698960 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd79c44-640e-42b1-984b-96df57bb23c1 admin admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:43:03.759749 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd79c44-640e-42b1-984b-96df57bb23c1 admin admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:43:03.764960 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da11849-0737-4e55-98d9-4867600aaaf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:43:03.765633 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da11849-0737-4e55-98d9-4867600aaaf4 admin admin] REQUEST_METHOD: `POST` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:43:03.765907 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da11849-0737-4e55-98d9-4867600aaaf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:43:03.766180 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da11849-0737-4e55-98d9-4867600aaaf4 admin admin] PATH_INFO: `/v3/projects` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:43:03.766884 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da11849-0737-4e55-98d9-4867600aaaf4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:43:03.768829 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da11849-0737-4e55-98d9-4867600aaaf4 admin admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:43:03.799093 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1339/2638] 10.222.0.23 () {60 vars in 1152 bytes} [Tue May 10 05:43:03 2022] POST /identity/v3/projects => generated 393 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 05:43:03.800203 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37afc89f-008d-4676-9361-2e78644e7d42 None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:43:03.813101 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37afc89f-008d-4676-9361-2e78644e7d42 None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:43:03.885596 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e15a5d-344f-4e69-bdb9-356c67ff3d48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:43:03.886120 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e15a5d-344f-4e69-bdb9-356c67ff3d48 admin admin] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:43:03.886497 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e15a5d-344f-4e69-bdb9-356c67ff3d48 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:43:03.886840 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e15a5d-344f-4e69-bdb9-356c67ff3d48 admin admin] PATH_INFO: `/v3/users` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:43:03.887916 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e15a5d-344f-4e69-bdb9-356c67ff3d48 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:43:03.890310 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e15a5d-344f-4e69-bdb9-356c67ff3d48 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:43:03.918748 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1300/2639] 10.222.0.23 () {60 vars in 1143 bytes} [Tue May 10 05:43:03 2022] POST /identity/v3/users => generated 303 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 05:43:03.920324 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da11849-0737-4e55-98d9-4867600aaaf4 admin admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:43:03.933302 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da11849-0737-4e55-98d9-4867600aaaf4 admin admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:43:03.938949 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496050a7-85da-4637-b18d-b3ce02fcf1f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:43:03.939962 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496050a7-85da-4637-b18d-b3ce02fcf1f2 admin admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:43:03.940422 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496050a7-85da-4637-b18d-b3ce02fcf1f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:43:03.940874 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496050a7-85da-4637-b18d-b3ce02fcf1f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:43:03.941842 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496050a7-85da-4637-b18d-b3ce02fcf1f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:43:03.943843 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496050a7-85da-4637-b18d-b3ce02fcf1f2 admin admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:43:03.960234 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1340/2640] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 10 05:43:03 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 05:43:03.962070 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e15a5d-344f-4e69-bdb9-356c67ff3d48 admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:43:03.972854 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e15a5d-344f-4e69-bdb9-356c67ff3d48 admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:43:03.979356 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c741001a-28b1-419f-97e0-d0561970702f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:43:03.981009 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c741001a-28b1-419f-97e0-d0561970702f admin admin] REQUEST_METHOD: `PUT` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:43:03.981660 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c741001a-28b1-419f-97e0-d0561970702f admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:43:03.982681 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c741001a-28b1-419f-97e0-d0561970702f admin admin] PATH_INFO: `/v3/projects/c5ede6554e2345dca7f16e7e5a28c1e8/users/c7685050a6cc4a8dbf2da3039d99a6f5/roles/199ac1dd842441d7913c6ee89d8fbecc` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:43:04.000691 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c741001a-28b1-419f-97e0-d0561970702f admin admin] RBAC: Authorizing `identity:create_grant(project_id=c5ede6554e2345dca7f16e7e5a28c1e8, user_id=c7685050a6cc4a8dbf2da3039d99a6f5, role_id=199ac1dd842441d7913c6ee89d8fbecc)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:43:04.003968 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c741001a-28b1-419f-97e0-d0561970702f admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:43:04.020072 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1301/2641] 10.222.0.23 () {60 vars in 1482 bytes} [Tue May 10 05:43:03 2022] PUT /identity/v3/projects/c5ede6554e2345dca7f16e7e5a28c1e8/users/c7685050a6cc4a8dbf2da3039d99a6f5/roles/199ac1dd842441d7913c6ee89d8fbecc => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 05:43:04.023993 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496050a7-85da-4637-b18d-b3ce02fcf1f2 admin admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:43:04.034671 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496050a7-85da-4637-b18d-b3ce02fcf1f2 admin admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:43:04.091184 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4091448-5389-4d44-8d91-1f0d804589d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:43:04.091958 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4091448-5389-4d44-8d91-1f0d804589d0 admin admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:43:04.092248 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4091448-5389-4d44-8d91-1f0d804589d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:43:04.092524 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4091448-5389-4d44-8d91-1f0d804589d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:43:04.093310 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4091448-5389-4d44-8d91-1f0d804589d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:43:04.095042 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4091448-5389-4d44-8d91-1f0d804589d0 admin admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:43:04.106807 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1341/2642] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 10 05:43:04 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 05:43:04.109982 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c741001a-28b1-419f-97e0-d0561970702f admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:43:04.120966 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c741001a-28b1-419f-97e0-d0561970702f admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:43:04.133765 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdf0304-a38e-4752-8620-59913aad31ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:43:04.133765 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdf0304-a38e-4752-8620-59913aad31ee admin admin] REQUEST_METHOD: `PUT` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:43:04.133765 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdf0304-a38e-4752-8620-59913aad31ee admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:43:04.133765 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdf0304-a38e-4752-8620-59913aad31ee admin admin] PATH_INFO: `/v3/projects/c5ede6554e2345dca7f16e7e5a28c1e8/users/c7685050a6cc4a8dbf2da3039d99a6f5/roles/199ac1dd842441d7913c6ee89d8fbecc` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:43:04.142566 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cdf0304-a38e-4752-8620-59913aad31ee admin admin] RBAC: Authorizing `identity:create_grant(project_id=c5ede6554e2345dca7f16e7e5a28c1e8, user_id=c7685050a6cc4a8dbf2da3039d99a6f5, role_id=199ac1dd842441d7913c6ee89d8fbecc)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:43:04.145665 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cdf0304-a38e-4752-8620-59913aad31ee admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:43:04.164769 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1302/2643] 10.222.0.23 () {60 vars in 1482 bytes} [Tue May 10 05:43:04 2022] PUT /identity/v3/projects/c5ede6554e2345dca7f16e7e5a28c1e8/users/c7685050a6cc4a8dbf2da3039d99a6f5/roles/199ac1dd842441d7913c6ee89d8fbecc => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 05:43:04.175457 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6be92a-55c7-43cf-88b3-b8a7cec73038 None None] REQUEST_METHOD: `POST` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:43:04.175640 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6be92a-55c7-43cf-88b3-b8a7cec73038 None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:43:04.175819 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6be92a-55c7-43cf-88b3-b8a7cec73038 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:43:04.206087 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.auth.core [None req-cf6be92a-55c7-43cf-88b3-b8a7cec73038 None None] MFA Rules not processed for user `c7685050a6cc4a8dbf2da3039d99a6f5`. Rule list: `[]` (Enabled: `True`). {{(pid=79879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:43:04.207509 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-cf6be92a-55c7-43cf-88b3-b8a7cec73038 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:43:04.280836 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1342/2644] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 10 05:43:04 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 05:43:04.292069 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdf0304-a38e-4752-8620-59913aad31ee admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:43:04.293811 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-8cdf0304-a38e-4752-8620-59913aad31ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:43:04.348595 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdf0304-a38e-4752-8620-59913aad31ee admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:43:04.352394 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ff990b-ff20-456c-bae1-d67a5cf682d6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355be413675540a39ccb00e1a0722316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f23435f783540199d6dcfd0417c090e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:43:04.353031 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ff990b-ff20-456c-bae1-d67a5cf682d6 service cinder] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:43:04.353311 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ff990b-ff20-456c-bae1-d67a5cf682d6 service cinder] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:43:04.353593 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ff990b-ff20-456c-bae1-d67a5cf682d6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:43:04.363274 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ff990b-ff20-456c-bae1-d67a5cf682d6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:43:04.364808 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ff990b-ff20-456c-bae1-d67a5cf682d6 service cinder] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:43:04.374874 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1303/2645] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 10 05:43:04 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 05:43:04.423188 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6be92a-55c7-43cf-88b3-b8a7cec73038 None None] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:43:04.424543 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-cf6be92a-55c7-43cf-88b3-b8a7cec73038 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:43:04.437237 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6be92a-55c7-43cf-88b3-b8a7cec73038 None None] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:43:04.440972 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efeb8c9-342e-41db-81a1-2d819b5a0626 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355be413675540a39ccb00e1a0722316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f23435f783540199d6dcfd0417c090e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:43:04.441809 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efeb8c9-342e-41db-81a1-2d819b5a0626 service cinder] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:43:04.442270 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efeb8c9-342e-41db-81a1-2d819b5a0626 service cinder] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:43:04.442551 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efeb8c9-342e-41db-81a1-2d819b5a0626 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:43:04.513757 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9efeb8c9-342e-41db-81a1-2d819b5a0626 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:43:04.515228 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9efeb8c9-342e-41db-81a1-2d819b5a0626 service cinder] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:43:04.525937 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1343/2646] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 10 05:43:04 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 05:43:09.421857 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc3f7b0-be2a-47b0-be11-db26694acded None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:43:09.422362 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc3f7b0-be2a-47b0-be11-db26694acded None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:43:09.422473 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc3f7b0-be2a-47b0-be11-db26694acded None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:43:09.443534 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-ffc3f7b0-be2a-47b0-be11-db26694acded None None] MFA Rules not processed for user `44ea420780af4d95aa7f2ae86ca31ef1`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:43:09.444819 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-ffc3f7b0-be2a-47b0-be11-db26694acded None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:43:09.508816 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1304/2647] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 10 05:43:09 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 05:43:10.926253 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efeb8c9-342e-41db-81a1-2d819b5a0626 service cinder] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:43:10.927793 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-9efeb8c9-342e-41db-81a1-2d819b5a0626 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:43:11.003596 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efeb8c9-342e-41db-81a1-2d819b5a0626 service cinder] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:43:11.008538 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b7e59a-d665-4f32-82ae-f4bac76ff13b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:43:11.009516 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b7e59a-d665-4f32-82ae-f4bac76ff13b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:43:11.009801 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b7e59a-d665-4f32-82ae-f4bac76ff13b admin admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:43:11.010078 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b7e59a-d665-4f32-82ae-f4bac76ff13b admin admin] PATH_INFO: `/v3/users/719be0a945844a43a5aad021a010e64a` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:43:11.011295 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b7e59a-d665-4f32-82ae-f4bac76ff13b admin admin] RBAC: Authorizing `identity:delete_user(user_id=719be0a945844a43a5aad021a010e64a)` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:43:11.013298 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b7e59a-d665-4f32-82ae-f4bac76ff13b admin admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:43:11.063287 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-e9b7e59a-d665-4f32-82ae-f4bac76ff13b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '719be0a945844a43a5aad021a010e64a'} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:43:11.073373 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-e9b7e59a-d665-4f32-82ae-f4bac76ff13b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '719be0a945844a43a5aad021a010e64a'} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:43:11.074133 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-e9b7e59a-d665-4f32-82ae-f4bac76ff13b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '719be0a945844a43a5aad021a010e64a'} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:43:11.088482 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-e9b7e59a-d665-4f32-82ae-f4bac76ff13b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '719be0a945844a43a5aad021a010e64a'} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:43:11.096180 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-e9b7e59a-d665-4f32-82ae-f4bac76ff13b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '719be0a945844a43a5aad021a010e64a'} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:43:11.102859 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1344/2648] 10.222.0.23 () {58 vars in 1223 bytes} [Tue May 10 05:43:10 2022] DELETE /identity/v3/users/719be0a945844a43a5aad021a010e64a => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 05:43:11.107673 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b51fae4-0b19-4ee5-ac74-3f62bae77512 None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:43:11.108211 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b51fae4-0b19-4ee5-ac74-3f62bae77512 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:43:11.108314 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b51fae4-0b19-4ee5-ac74-3f62bae77512 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:43:11.128790 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-0b51fae4-0b19-4ee5-ac74-3f62bae77512 None None] MFA Rules not processed for user `44883b22532e44049d846938dc2cf423`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:43:11.130089 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-0b51fae4-0b19-4ee5-ac74-3f62bae77512 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:43:11.157692 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b7e59a-d665-4f32-82ae-f4bac76ff13b admin admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:43:11.159210 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-e9b7e59a-d665-4f32-82ae-f4bac76ff13b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:43:11.195266 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1305/2649] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 10 05:43:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 05:43:11.205597 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b51fae4-0b19-4ee5-ac74-3f62bae77512 None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:43:11.207478 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-0b51fae4-0b19-4ee5-ac74-3f62bae77512 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:43:11.230409 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b7e59a-d665-4f32-82ae-f4bac76ff13b admin admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:43:11.236827 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c97c3f9-f2e6-46f7-b947-9527f75bad76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:43:11.237710 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c97c3f9-f2e6-46f7-b947-9527f75bad76 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:43:11.238004 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c97c3f9-f2e6-46f7-b947-9527f75bad76 admin admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:43:11.238339 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c97c3f9-f2e6-46f7-b947-9527f75bad76 admin admin] PATH_INFO: `/v3/users/945f83903a2b49918f2bae9e33d46f73` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:43:11.239484 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c97c3f9-f2e6-46f7-b947-9527f75bad76 admin admin] RBAC: Authorizing `identity:delete_user(user_id=945f83903a2b49918f2bae9e33d46f73)` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:43:11.242205 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c97c3f9-f2e6-46f7-b947-9527f75bad76 admin admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:43:11.290743 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b51fae4-0b19-4ee5-ac74-3f62bae77512 None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:43:11.295104 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2971cb9b-157d-4c21-8d6a-1ca87d2cce74 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c8461cfdd9648b8abcaf8d34b7a102a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f23435f783540199d6dcfd0417c090e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:43:11.296325 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2971cb9b-157d-4c21-8d6a-1ca87d2cce74 service neutron] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:43:11.296886 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2971cb9b-157d-4c21-8d6a-1ca87d2cce74 service neutron] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:43:11.297400 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2971cb9b-157d-4c21-8d6a-1ca87d2cce74 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:43:11.300897 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-4c97c3f9-f2e6-46f7-b947-9527f75bad76 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '945f83903a2b49918f2bae9e33d46f73'} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:43:11.309239 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-4c97c3f9-f2e6-46f7-b947-9527f75bad76 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '945f83903a2b49918f2bae9e33d46f73'} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:43:11.310061 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-4c97c3f9-f2e6-46f7-b947-9527f75bad76 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '945f83903a2b49918f2bae9e33d46f73'} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:43:11.310444 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2971cb9b-157d-4c21-8d6a-1ca87d2cce74 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:43:11.312265 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2971cb9b-157d-4c21-8d6a-1ca87d2cce74 service neutron] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:43:11.324146 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1306/2650] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 10 05:43:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 05:43:11.331084 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-4c97c3f9-f2e6-46f7-b947-9527f75bad76 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '945f83903a2b49918f2bae9e33d46f73'} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:43:11.338735 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-4c97c3f9-f2e6-46f7-b947-9527f75bad76 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '945f83903a2b49918f2bae9e33d46f73'} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:43:11.348475 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1345/2651] 10.222.0.23 () {58 vars in 1223 bytes} [Tue May 10 05:43:11 2022] DELETE /identity/v3/users/945f83903a2b49918f2bae9e33d46f73 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 05:43:11.350296 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0428d017-7454-46ca-a3f8-b6c6fd7baef5 None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:43:11.350593 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0428d017-7454-46ca-a3f8-b6c6fd7baef5 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:43:11.350919 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0428d017-7454-46ca-a3f8-b6c6fd7baef5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:43:11.374466 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-0428d017-7454-46ca-a3f8-b6c6fd7baef5 None None] MFA Rules not processed for user `44883b22532e44049d846938dc2cf423`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:43:11.375836 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-0428d017-7454-46ca-a3f8-b6c6fd7baef5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:43:11.445015 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1307/2652] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 10 05:43:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 05:43:11.454645 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c97c3f9-f2e6-46f7-b947-9527f75bad76 admin admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:43:11.456257 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-4c97c3f9-f2e6-46f7-b947-9527f75bad76 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:43:11.526746 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c97c3f9-f2e6-46f7-b947-9527f75bad76 admin admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:43:11.530657 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0132d4e2-20e7-4c89-a17a-912532077aa9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c8461cfdd9648b8abcaf8d34b7a102a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f23435f783540199d6dcfd0417c090e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:43:11.531486 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0132d4e2-20e7-4c89-a17a-912532077aa9 service neutron] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:43:11.531823 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0132d4e2-20e7-4c89-a17a-912532077aa9 service neutron] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:43:11.532164 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0132d4e2-20e7-4c89-a17a-912532077aa9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:43:11.542240 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0132d4e2-20e7-4c89-a17a-912532077aa9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:43:11.543872 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0132d4e2-20e7-4c89-a17a-912532077aa9 service neutron] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:43:11.554844 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1346/2653] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 10 05:43:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 05:43:11.668891 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0428d017-7454-46ca-a3f8-b6c6fd7baef5 None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:43:11.670296 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-0428d017-7454-46ca-a3f8-b6c6fd7baef5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:43:11.682290 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0428d017-7454-46ca-a3f8-b6c6fd7baef5 None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:43:11.698232 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e48c3f-bd3d-433d-a440-a27905a6ae72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:43:11.699180 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e48c3f-bd3d-433d-a440-a27905a6ae72 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:43:11.699526 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e48c3f-bd3d-433d-a440-a27905a6ae72 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:43:11.699922 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e48c3f-bd3d-433d-a440-a27905a6ae72 admin admin] PATH_INFO: `/v3/projects/cb1c9178f1e9469d9ac9ea1ffedc3d86` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:43:11.701308 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e48c3f-bd3d-433d-a440-a27905a6ae72 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cb1c9178f1e9469d9ac9ea1ffedc3d86)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:43:11.703134 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e48c3f-bd3d-433d-a440-a27905a6ae72 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:43:11.754044 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-f9e48c3f-bd3d-433d-a440-a27905a6ae72 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cb1c9178f1e9469d9ac9ea1ffedc3d86', 'request_id': 'req-f9e48c3f-bd3d-433d-a440-a27905a6ae72'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:43:11.761073 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-f9e48c3f-bd3d-433d-a440-a27905a6ae72 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cb1c9178f1e9469d9ac9ea1ffedc3d86', 'request_id': 'req-f9e48c3f-bd3d-433d-a440-a27905a6ae72'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:43:11.770261 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-f9e48c3f-bd3d-433d-a440-a27905a6ae72 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cb1c9178f1e9469d9ac9ea1ffedc3d86', 'request_id': 'req-f9e48c3f-bd3d-433d-a440-a27905a6ae72'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:43:11.782924 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-f9e48c3f-bd3d-433d-a440-a27905a6ae72 admin admin] The token cache is being invalidate because project cb1c9178f1e9469d9ac9ea1ffedc3d86 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79880) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 05:43:11.783209 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-f9e48c3f-bd3d-433d-a440-a27905a6ae72 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:43:11.784146 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-f9e48c3f-bd3d-433d-a440-a27905a6ae72 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:43:11.786247 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1308/2654] 10.222.0.23 () {58 vars in 1232 bytes} [Tue May 10 05:43:11 2022] DELETE /identity/v3/projects/cb1c9178f1e9469d9ac9ea1ffedc3d86 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 05:43:11.789965 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0132d4e2-20e7-4c89-a17a-912532077aa9 service neutron] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:43:11.799969 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0132d4e2-20e7-4c89-a17a-912532077aa9 service neutron] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:43:11.866473 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedc6dfe-10f5-4d93-b40e-0bedb5c523fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:43:11.867479 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedc6dfe-10f5-4d93-b40e-0bedb5c523fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:43:11.867914 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedc6dfe-10f5-4d93-b40e-0bedb5c523fc admin admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:43:11.868205 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedc6dfe-10f5-4d93-b40e-0bedb5c523fc admin admin] PATH_INFO: `/v3/users/f5a4e03ce6fc4c5c905255375c4ef3e9` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:43:11.869598 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eedc6dfe-10f5-4d93-b40e-0bedb5c523fc admin admin] RBAC: Authorizing `identity:delete_user(user_id=f5a4e03ce6fc4c5c905255375c4ef3e9)` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:43:11.871708 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eedc6dfe-10f5-4d93-b40e-0bedb5c523fc admin admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:43:11.886479 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e48c3f-bd3d-433d-a440-a27905a6ae72 admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:43:11.888604 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-f9e48c3f-bd3d-433d-a440-a27905a6ae72 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:43:11.906874 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e48c3f-bd3d-433d-a440-a27905a6ae72 admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:43:11.912833 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4a5ab0-45ef-405b-ad79-89a578db45af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:43:11.913870 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4a5ab0-45ef-405b-ad79-89a578db45af admin admin] REQUEST_METHOD: `DELETE` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:43:11.914213 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4a5ab0-45ef-405b-ad79-89a578db45af admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:43:11.914576 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4a5ab0-45ef-405b-ad79-89a578db45af admin admin] PATH_INFO: `/v3/projects/ce088da1d4a445ee8a0c91f1b2c576f6` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:43:11.915911 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4a5ab0-45ef-405b-ad79-89a578db45af admin admin] RBAC: Authorizing `identity:delete_project(project_id=ce088da1d4a445ee8a0c91f1b2c576f6)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:43:11.918536 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4a5ab0-45ef-405b-ad79-89a578db45af admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:43:11.928792 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-eedc6dfe-10f5-4d93-b40e-0bedb5c523fc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f5a4e03ce6fc4c5c905255375c4ef3e9'} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:43:11.939509 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-eedc6dfe-10f5-4d93-b40e-0bedb5c523fc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f5a4e03ce6fc4c5c905255375c4ef3e9'} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:43:11.940460 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-eedc6dfe-10f5-4d93-b40e-0bedb5c523fc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f5a4e03ce6fc4c5c905255375c4ef3e9'} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:43:11.954451 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-eedc6dfe-10f5-4d93-b40e-0bedb5c523fc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f5a4e03ce6fc4c5c905255375c4ef3e9'} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:43:11.962375 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-eedc6dfe-10f5-4d93-b40e-0bedb5c523fc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f5a4e03ce6fc4c5c905255375c4ef3e9'} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:43:11.968959 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1347/2655] 10.222.0.23 () {58 vars in 1223 bytes} [Tue May 10 05:43:11 2022] DELETE /identity/v3/users/f5a4e03ce6fc4c5c905255375c4ef3e9 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 05:43:11.975002 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-2b4a5ab0-45ef-405b-ad79-89a578db45af admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ce088da1d4a445ee8a0c91f1b2c576f6', 'request_id': 'req-2b4a5ab0-45ef-405b-ad79-89a578db45af'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:43:11.981888 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-2b4a5ab0-45ef-405b-ad79-89a578db45af admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ce088da1d4a445ee8a0c91f1b2c576f6', 'request_id': 'req-2b4a5ab0-45ef-405b-ad79-89a578db45af'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:43:11.990617 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-2b4a5ab0-45ef-405b-ad79-89a578db45af admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ce088da1d4a445ee8a0c91f1b2c576f6', 'request_id': 'req-2b4a5ab0-45ef-405b-ad79-89a578db45af'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:43:12.004303 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-2b4a5ab0-45ef-405b-ad79-89a578db45af admin admin] The token cache is being invalidate because project ce088da1d4a445ee8a0c91f1b2c576f6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79880) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 05:43:12.004625 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-2b4a5ab0-45ef-405b-ad79-89a578db45af admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:43:12.005284 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-2b4a5ab0-45ef-405b-ad79-89a578db45af admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:43:12.010647 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1309/2656] 10.222.0.23 () {58 vars in 1232 bytes} [Tue May 10 05:43:11 2022] DELETE /identity/v3/projects/ce088da1d4a445ee8a0c91f1b2c576f6 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 05:43:12.012327 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedc6dfe-10f5-4d93-b40e-0bedb5c523fc admin admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:43:12.014217 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-eedc6dfe-10f5-4d93-b40e-0bedb5c523fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:43:12.088030 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedc6dfe-10f5-4d93-b40e-0bedb5c523fc admin admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:43:12.092810 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4046023a-7035-41db-b662-113678ccd038 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:43:12.093696 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4046023a-7035-41db-b662-113678ccd038 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:43:12.093970 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4046023a-7035-41db-b662-113678ccd038 admin admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:43:12.094642 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4046023a-7035-41db-b662-113678ccd038 admin admin] PATH_INFO: `/v3/users/c7685050a6cc4a8dbf2da3039d99a6f5` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:43:12.095423 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4046023a-7035-41db-b662-113678ccd038 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c7685050a6cc4a8dbf2da3039d99a6f5)` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:43:12.097494 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4046023a-7035-41db-b662-113678ccd038 admin admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:43:12.154941 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-4046023a-7035-41db-b662-113678ccd038 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c7685050a6cc4a8dbf2da3039d99a6f5'} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:43:12.165850 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-4046023a-7035-41db-b662-113678ccd038 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c7685050a6cc4a8dbf2da3039d99a6f5'} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:43:12.166617 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-4046023a-7035-41db-b662-113678ccd038 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c7685050a6cc4a8dbf2da3039d99a6f5'} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:43:12.181148 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-4046023a-7035-41db-b662-113678ccd038 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c7685050a6cc4a8dbf2da3039d99a6f5'} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:43:12.188383 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-4046023a-7035-41db-b662-113678ccd038 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c7685050a6cc4a8dbf2da3039d99a6f5'} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:43:12.199703 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1348/2657] 10.222.0.23 () {58 vars in 1223 bytes} [Tue May 10 05:43:12 2022] DELETE /identity/v3/users/c7685050a6cc4a8dbf2da3039d99a6f5 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 05:43:12.281669 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4a5ab0-45ef-405b-ad79-89a578db45af admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:43:12.283127 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-2b4a5ab0-45ef-405b-ad79-89a578db45af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:43:12.360472 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4a5ab0-45ef-405b-ad79-89a578db45af admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:43:12.425383 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5ddc72-0c52-4489-8a8b-d926118490e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:43:12.426860 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5ddc72-0c52-4489-8a8b-d926118490e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:43:12.427367 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5ddc72-0c52-4489-8a8b-d926118490e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:43:12.427726 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5ddc72-0c52-4489-8a8b-d926118490e5 admin admin] PATH_INFO: `/v3/projects/1c6e4683051842798624a52e835b42ca` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:43:12.429429 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5ddc72-0c52-4489-8a8b-d926118490e5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1c6e4683051842798624a52e835b42ca)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:43:12.433130 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5ddc72-0c52-4489-8a8b-d926118490e5 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:43:12.492314 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-ef5ddc72-0c52-4489-8a8b-d926118490e5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1c6e4683051842798624a52e835b42ca', 'request_id': 'req-ef5ddc72-0c52-4489-8a8b-d926118490e5'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:43:12.498885 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-ef5ddc72-0c52-4489-8a8b-d926118490e5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1c6e4683051842798624a52e835b42ca', 'request_id': 'req-ef5ddc72-0c52-4489-8a8b-d926118490e5'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:43:12.508897 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-ef5ddc72-0c52-4489-8a8b-d926118490e5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1c6e4683051842798624a52e835b42ca', 'request_id': 'req-ef5ddc72-0c52-4489-8a8b-d926118490e5'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:43:12.522213 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-ef5ddc72-0c52-4489-8a8b-d926118490e5 admin admin] The token cache is being invalidate because project 1c6e4683051842798624a52e835b42ca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79880) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 05:43:12.522993 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-ef5ddc72-0c52-4489-8a8b-d926118490e5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:43:12.523797 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-ef5ddc72-0c52-4489-8a8b-d926118490e5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:43:12.525650 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1310/2658] 10.222.0.23 () {58 vars in 1232 bytes} [Tue May 10 05:43:12 2022] DELETE /identity/v3/projects/1c6e4683051842798624a52e835b42ca => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 05:43:12.530403 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce2131d-54e2-42fe-8cf8-ca45447c5b94 None None] REQUEST_METHOD: `POST` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:43:12.530699 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce2131d-54e2-42fe-8cf8-ca45447c5b94 None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:43:12.531000 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce2131d-54e2-42fe-8cf8-ca45447c5b94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:43:12.550094 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.auth.core [None req-0ce2131d-54e2-42fe-8cf8-ca45447c5b94 None None] MFA Rules not processed for user `44883b22532e44049d846938dc2cf423`. Rule list: `[]` (Enabled: `True`). {{(pid=79879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:43:12.551793 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-0ce2131d-54e2-42fe-8cf8-ca45447c5b94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:43:12.620734 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1349/2659] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 10 05:43:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 05:43:12.629616 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4b52e6-e76b-4331-bc63-aeb620a125ac None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:43:12.629951 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4b52e6-e76b-4331-bc63-aeb620a125ac None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:43:12.630179 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4b52e6-e76b-4331-bc63-aeb620a125ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:43:12.649456 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-9e4b52e6-e76b-4331-bc63-aeb620a125ac None None] MFA Rules not processed for user `44883b22532e44049d846938dc2cf423`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:43:12.650761 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-9e4b52e6-e76b-4331-bc63-aeb620a125ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:43:12.660035 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1311/2660] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 10 05:43:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 05:43:12.664584 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce2131d-54e2-42fe-8cf8-ca45447c5b94 None None] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:43:12.672986 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4b52e6-e76b-4331-bc63-aeb620a125ac None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:43:12.675389 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-9e4b52e6-e76b-4331-bc63-aeb620a125ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:43:12.683656 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce2131d-54e2-42fe-8cf8-ca45447c5b94 None None] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:43:12.687621 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4b52e6-e76b-4331-bc63-aeb620a125ac None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:43:12.691908 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17977a01-3a77-4df4-8706-a3e4803fed1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:43:12.692330 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a29809-51cf-48d1-8e85-377b10e5a73d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:43:12.692812 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17977a01-3a77-4df4-8706-a3e4803fed1d admin admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:43:12.693190 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17977a01-3a77-4df4-8706-a3e4803fed1d admin admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:43:12.693356 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a29809-51cf-48d1-8e85-377b10e5a73d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:43:12.693493 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a29809-51cf-48d1-8e85-377b10e5a73d admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:43:12.693720 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17977a01-3a77-4df4-8706-a3e4803fed1d admin admin] PATH_INFO: `/v3/domains` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:43:12.693941 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a29809-51cf-48d1-8e85-377b10e5a73d admin admin] PATH_INFO: `/v3/projects/c5ede6554e2345dca7f16e7e5a28c1e8` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:43:12.694645 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17977a01-3a77-4df4-8706-a3e4803fed1d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:43:12.695045 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17977a01-3a77-4df4-8706-a3e4803fed1d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:43:12.695182 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a29809-51cf-48d1-8e85-377b10e5a73d admin admin] RBAC: Authorizing `identity:delete_project(project_id=c5ede6554e2345dca7f16e7e5a28c1e8)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:43:12.697108 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17977a01-3a77-4df4-8706-a3e4803fed1d admin admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:43:12.697231 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a29809-51cf-48d1-8e85-377b10e5a73d admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:43:12.710286 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1350/2661] 10.222.0.23 () {58 vars in 1152 bytes} [Tue May 10 05:43:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:43:12.714168 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17977a01-3a77-4df4-8706-a3e4803fed1d admin admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:43:12.726199 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17977a01-3a77-4df4-8706-a3e4803fed1d admin admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:43:12.731884 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7817827-0976-48ab-bdf2-9ba4a64817e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:43:12.733089 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7817827-0976-48ab-bdf2-9ba4a64817e7 admin admin] REQUEST_METHOD: `POST` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:43:12.733089 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7817827-0976-48ab-bdf2-9ba4a64817e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:43:12.733330 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7817827-0976-48ab-bdf2-9ba4a64817e7 admin admin] PATH_INFO: `/v3/projects` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:43:12.734138 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7817827-0976-48ab-bdf2-9ba4a64817e7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:43:12.736335 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7817827-0976-48ab-bdf2-9ba4a64817e7 admin admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:43:12.752721 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-a9a29809-51cf-48d1-8e85-377b10e5a73d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c5ede6554e2345dca7f16e7e5a28c1e8', 'request_id': 'req-a9a29809-51cf-48d1-8e85-377b10e5a73d'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:43:12.766596 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-a9a29809-51cf-48d1-8e85-377b10e5a73d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c5ede6554e2345dca7f16e7e5a28c1e8', 'request_id': 'req-a9a29809-51cf-48d1-8e85-377b10e5a73d'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:43:12.772276 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1351/2662] 10.222.0.23 () {60 vars in 1152 bytes} [Tue May 10 05:43:12 2022] POST /identity/v3/projects => generated 371 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 05:43:12.773652 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7817827-0976-48ab-bdf2-9ba4a64817e7 admin admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:43:12.794473 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-a9a29809-51cf-48d1-8e85-377b10e5a73d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c5ede6554e2345dca7f16e7e5a28c1e8', 'request_id': 'req-a9a29809-51cf-48d1-8e85-377b10e5a73d'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:43:12.806757 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-a9a29809-51cf-48d1-8e85-377b10e5a73d admin admin] The token cache is being invalidate because project c5ede6554e2345dca7f16e7e5a28c1e8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79880) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 05:43:12.807401 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-a9a29809-51cf-48d1-8e85-377b10e5a73d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:43:12.808429 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-a9a29809-51cf-48d1-8e85-377b10e5a73d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:43:12.810338 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1312/2663] 10.222.0.23 () {58 vars in 1232 bytes} [Tue May 10 05:43:12 2022] DELETE /identity/v3/projects/c5ede6554e2345dca7f16e7e5a28c1e8 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 05:43:12.814947 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0da5f5-189a-46ea-a241-ed9dd8294d64 None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:43:12.815256 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0da5f5-189a-46ea-a241-ed9dd8294d64 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:43:12.815499 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0da5f5-189a-46ea-a241-ed9dd8294d64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:43:12.834183 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-2d0da5f5-189a-46ea-a241-ed9dd8294d64 None None] MFA Rules not processed for user `44883b22532e44049d846938dc2cf423`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:43:12.835400 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-2d0da5f5-189a-46ea-a241-ed9dd8294d64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:43:12.846621 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7817827-0976-48ab-bdf2-9ba4a64817e7 admin admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:43:12.851230 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b958657d-6a4d-4255-ad1d-cf2096cce171 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:43:12.851925 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b958657d-6a4d-4255-ad1d-cf2096cce171 admin admin] REQUEST_METHOD: `POST` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:43:12.852208 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b958657d-6a4d-4255-ad1d-cf2096cce171 admin admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:43:12.852487 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b958657d-6a4d-4255-ad1d-cf2096cce171 admin admin] PATH_INFO: `/v3/users` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:43:12.853181 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b958657d-6a4d-4255-ad1d-cf2096cce171 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:43:12.855101 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b958657d-6a4d-4255-ad1d-cf2096cce171 admin admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:43:12.876622 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1352/2664] 10.222.0.23 () {60 vars in 1143 bytes} [Tue May 10 05:43:12 2022] POST /identity/v3/users => generated 286 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 05:43:12.880547 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b958657d-6a4d-4255-ad1d-cf2096cce171 admin admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:43:12.882310 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-b958657d-6a4d-4255-ad1d-cf2096cce171 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:43:12.894666 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b958657d-6a4d-4255-ad1d-cf2096cce171 admin admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:43:12.897850 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1313/2665] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 10 05:43:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 05:43:12.906398 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae83a734-505e-41c6-81bd-49314986aa23 None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:43:12.906931 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae83a734-505e-41c6-81bd-49314986aa23 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:43:12.907230 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bce7159-e348-40b3-9a23-39169949a099 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:43:12.907500 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae83a734-505e-41c6-81bd-49314986aa23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:43:12.908166 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bce7159-e348-40b3-9a23-39169949a099 admin admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:43:12.908657 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bce7159-e348-40b3-9a23-39169949a099 admin admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:43:12.909088 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bce7159-e348-40b3-9a23-39169949a099 admin admin] PATH_INFO: `/v3/roles` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:43:12.909947 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bce7159-e348-40b3-9a23-39169949a099 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:43:12.911790 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bce7159-e348-40b3-9a23-39169949a099 admin admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:43:12.926513 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1353/2666] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 10 05:43:12 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 05:43:12.927451 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bce7159-e348-40b3-9a23-39169949a099 admin admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:43:12.930486 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-ae83a734-505e-41c6-81bd-49314986aa23 None None] MFA Rules not processed for user `44883b22532e44049d846938dc2cf423`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:43:12.931785 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-ae83a734-505e-41c6-81bd-49314986aa23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:43:12.941904 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1314/2667] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 10 05:43:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 05:43:12.942765 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bce7159-e348-40b3-9a23-39169949a099 admin admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:43:12.945922 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae83a734-505e-41c6-81bd-49314986aa23 None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:43:12.948898 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4deeec-9c68-4528-a473-9341c3d0e252 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:43:12.949940 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4deeec-9c68-4528-a473-9341c3d0e252 admin admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:43:12.950222 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4deeec-9c68-4528-a473-9341c3d0e252 admin admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:43:12.950498 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4deeec-9c68-4528-a473-9341c3d0e252 admin admin] PATH_INFO: `/v3/roles` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:43:12.951303 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4deeec-9c68-4528-a473-9341c3d0e252 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:43:12.953649 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4deeec-9c68-4528-a473-9341c3d0e252 admin admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:43:12.955136 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae83a734-505e-41c6-81bd-49314986aa23 None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:43:12.960931 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b26d28-904d-4ec7-bee5-e303ac4785f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:43:12.961675 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b26d28-904d-4ec7-bee5-e303ac4785f7 admin admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:43:12.962024 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b26d28-904d-4ec7-bee5-e303ac4785f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:43:12.962365 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b26d28-904d-4ec7-bee5-e303ac4785f7 admin admin] PATH_INFO: `/v3/domains` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:43:12.963169 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b26d28-904d-4ec7-bee5-e303ac4785f7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:43:12.963542 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b26d28-904d-4ec7-bee5-e303ac4785f7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:43:12.965181 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b26d28-904d-4ec7-bee5-e303ac4785f7 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:43:12.971745 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1354/2668] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 10 05:43:12 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 05:43:12.976499 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4deeec-9c68-4528-a473-9341c3d0e252 admin admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:43:12.977157 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1315/2669] 10.222.0.23 () {58 vars in 1152 bytes} [Tue May 10 05:43:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 05:43:12.981322 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b26d28-904d-4ec7-bee5-e303ac4785f7 admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:43:12.991354 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4deeec-9c68-4528-a473-9341c3d0e252 admin admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:43:12.992835 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b26d28-904d-4ec7-bee5-e303ac4785f7 admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:43:12.996474 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b40868-a172-4af8-a23f-13bc99700972 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:43:12.997376 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b40868-a172-4af8-a23f-13bc99700972 admin admin] REQUEST_METHOD: `PUT` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:43:12.997735 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b40868-a172-4af8-a23f-13bc99700972 admin admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:43:12.998008 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b40868-a172-4af8-a23f-13bc99700972 admin admin] PATH_INFO: `/v3/projects/acee54f44ec6408a9496fcac95f6be8b/users/a6e7712965164f7589b7c074c1310713/roles/382636e67fc142a2b2f486340d959e11` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:43:12.998498 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855e689b-78aa-45b7-96a1-2303344087c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:43:12.999148 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855e689b-78aa-45b7-96a1-2303344087c0 admin admin] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:43:12.999447 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855e689b-78aa-45b7-96a1-2303344087c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:43:12.999792 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855e689b-78aa-45b7-96a1-2303344087c0 admin admin] PATH_INFO: `/v3/projects` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:43:13.000469 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855e689b-78aa-45b7-96a1-2303344087c0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:43:13.002867 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855e689b-78aa-45b7-96a1-2303344087c0 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:43:13.013491 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b40868-a172-4af8-a23f-13bc99700972 admin admin] RBAC: Authorizing `identity:create_grant(project_id=acee54f44ec6408a9496fcac95f6be8b, user_id=a6e7712965164f7589b7c074c1310713, role_id=382636e67fc142a2b2f486340d959e11)` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:43:13.016220 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b40868-a172-4af8-a23f-13bc99700972 admin admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:43:13.034490 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1316/2670] 10.222.0.23 () {60 vars in 1152 bytes} [Tue May 10 05:43:12 2022] POST /identity/v3/projects => generated 375 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 05:43:13.038598 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855e689b-78aa-45b7-96a1-2303344087c0 admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:43:13.039606 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1355/2671] 10.222.0.23 () {60 vars in 1482 bytes} [Tue May 10 05:43:12 2022] PUT /identity/v3/projects/acee54f44ec6408a9496fcac95f6be8b/users/a6e7712965164f7589b7c074c1310713/roles/382636e67fc142a2b2f486340d959e11 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 05:43:13.044445 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5cb418-b9e7-4fa0-b154-cb12224a8767 None None] REQUEST_METHOD: `POST` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:43:13.044801 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5cb418-b9e7-4fa0-b154-cb12224a8767 None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:43:13.045090 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5cb418-b9e7-4fa0-b154-cb12224a8767 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:43:13.070560 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.auth.core [None req-5d5cb418-b9e7-4fa0-b154-cb12224a8767 None None] MFA Rules not processed for user `44883b22532e44049d846938dc2cf423`. Rule list: `[]` (Enabled: `True`). {{(pid=79879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:43:13.071853 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-5d5cb418-b9e7-4fa0-b154-cb12224a8767 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:43:13.118163 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855e689b-78aa-45b7-96a1-2303344087c0 admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:43:13.126217 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2ec876-d310-4f95-9888-4c8989b86454 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:43:13.128470 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2ec876-d310-4f95-9888-4c8989b86454 admin admin] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:43:13.129636 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2ec876-d310-4f95-9888-4c8989b86454 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:43:13.129636 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2ec876-d310-4f95-9888-4c8989b86454 admin admin] PATH_INFO: `/v3/users` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:43:13.130773 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2ec876-d310-4f95-9888-4c8989b86454 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:43:13.134145 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2ec876-d310-4f95-9888-4c8989b86454 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:43:13.155148 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1356/2672] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 10 05:43:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 05:43:13.165167 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1317/2673] 10.222.0.23 () {60 vars in 1143 bytes} [Tue May 10 05:43:13 2022] POST /identity/v3/users => generated 288 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 05:43:13.169825 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5cb418-b9e7-4fa0-b154-cb12224a8767 None None] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:43:13.174037 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2ec876-d310-4f95-9888-4c8989b86454 admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:43:13.176539 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-eb2ec876-d310-4f95-9888-4c8989b86454 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:43:13.182411 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5cb418-b9e7-4fa0-b154-cb12224a8767 None None] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:43:13.189896 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea2aea4-3120-4b65-ae81-34f49d42c2f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:43:13.191093 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea2aea4-3120-4b65-ae81-34f49d42c2f3 admin admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:43:13.191651 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea2aea4-3120-4b65-ae81-34f49d42c2f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:43:13.192084 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea2aea4-3120-4b65-ae81-34f49d42c2f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:43:13.193151 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea2aea4-3120-4b65-ae81-34f49d42c2f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:43:13.196788 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea2aea4-3120-4b65-ae81-34f49d42c2f3 admin admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:43:13.216635 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1357/2674] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 10 05:43:13 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 05:43:13.221371 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea2aea4-3120-4b65-ae81-34f49d42c2f3 admin admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:43:13.231675 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea2aea4-3120-4b65-ae81-34f49d42c2f3 admin admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:43:13.236844 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861b81f8-ce74-4610-bbf5-72086f2f3802 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:43:13.237635 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861b81f8-ce74-4610-bbf5-72086f2f3802 admin admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:43:13.238187 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861b81f8-ce74-4610-bbf5-72086f2f3802 admin admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:43:13.238740 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861b81f8-ce74-4610-bbf5-72086f2f3802 admin admin] PATH_INFO: `/v3/roles` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:43:13.240329 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861b81f8-ce74-4610-bbf5-72086f2f3802 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:43:13.242055 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861b81f8-ce74-4610-bbf5-72086f2f3802 admin admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:43:13.262309 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1358/2675] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 10 05:43:13 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 05:43:13.273598 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861b81f8-ce74-4610-bbf5-72086f2f3802 admin admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:43:13.273796 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2ec876-d310-4f95-9888-4c8989b86454 admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:43:13.284897 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2e388f-ca1e-4f6f-9218-e6b3b90044a0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c8461cfdd9648b8abcaf8d34b7a102a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f23435f783540199d6dcfd0417c090e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:43:13.285853 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2e388f-ca1e-4f6f-9218-e6b3b90044a0 service neutron] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:43:13.286557 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2e388f-ca1e-4f6f-9218-e6b3b90044a0 service neutron] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:43:13.286557 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2e388f-ca1e-4f6f-9218-e6b3b90044a0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:43:13.291853 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861b81f8-ce74-4610-bbf5-72086f2f3802 admin admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:43:13.302572 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2e388f-ca1e-4f6f-9218-e6b3b90044a0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:43:13.304061 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2e388f-ca1e-4f6f-9218-e6b3b90044a0 service neutron] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:43:13.309575 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6aa078c-1225-48c0-a93c-89b57b43b66e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:43:13.310618 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6aa078c-1225-48c0-a93c-89b57b43b66e admin admin] REQUEST_METHOD: `PUT` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:43:13.310901 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6aa078c-1225-48c0-a93c-89b57b43b66e admin admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:43:13.311180 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6aa078c-1225-48c0-a93c-89b57b43b66e admin admin] PATH_INFO: `/v3/projects/9b9017e1ad684d91823ed597b4febd86/users/17f3d1ce41ab4ce4a636b6dde6c7df97/roles/382636e67fc142a2b2f486340d959e11` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:43:13.322564 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1318/2676] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 10 05:43:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 05:43:13.328826 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6aa078c-1225-48c0-a93c-89b57b43b66e admin admin] RBAC: Authorizing `identity:create_grant(project_id=9b9017e1ad684d91823ed597b4febd86, user_id=17f3d1ce41ab4ce4a636b6dde6c7df97, role_id=382636e67fc142a2b2f486340d959e11)` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:43:13.332064 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6aa078c-1225-48c0-a93c-89b57b43b66e admin admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:43:13.351595 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1359/2677] 10.222.0.23 () {60 vars in 1482 bytes} [Tue May 10 05:43:13 2022] PUT /identity/v3/projects/9b9017e1ad684d91823ed597b4febd86/users/17f3d1ce41ab4ce4a636b6dde6c7df97/roles/382636e67fc142a2b2f486340d959e11 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 05:43:13.362993 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a7772e-8fa2-48ab-9dcd-cbc85b8fa9ff None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:43:13.363726 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a7772e-8fa2-48ab-9dcd-cbc85b8fa9ff None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:43:13.364238 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a7772e-8fa2-48ab-9dcd-cbc85b8fa9ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:43:13.396538 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-83a7772e-8fa2-48ab-9dcd-cbc85b8fa9ff None None] MFA Rules not processed for user `17f3d1ce41ab4ce4a636b6dde6c7df97`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:43:13.398155 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-83a7772e-8fa2-48ab-9dcd-cbc85b8fa9ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:43:13.478628 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1319/2678] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 10 05:43:13 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 05:43:13.491444 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6aa078c-1225-48c0-a93c-89b57b43b66e admin admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:43:13.493408 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-e6aa078c-1225-48c0-a93c-89b57b43b66e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:43:13.622227 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6aa078c-1225-48c0-a93c-89b57b43b66e admin admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:43:13.627286 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ee4531-0928-49f6-975f-008620d73460 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5b56aedcfd74914938b0b9cdd102f48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f23435f783540199d6dcfd0417c090e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:43:13.627995 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ee4531-0928-49f6-975f-008620d73460 service glance] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:43:13.628587 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ee4531-0928-49f6-975f-008620d73460 service glance] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:43:13.628587 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ee4531-0928-49f6-975f-008620d73460 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:43:13.639693 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ee4531-0928-49f6-975f-008620d73460 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:43:13.641490 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ee4531-0928-49f6-975f-008620d73460 service glance] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:43:13.664346 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1360/2679] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 10 05:43:13 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 05:43:14.827185 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b26f35-9924-4d91-86d9-11d5413abb7d None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:43:14.827843 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b26f35-9924-4d91-86d9-11d5413abb7d None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:43:14.827843 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b26f35-9924-4d91-86d9-11d5413abb7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:43:14.913819 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-82b26f35-9924-4d91-86d9-11d5413abb7d None None] MFA Rules not processed for user `a6e7712965164f7589b7c074c1310713`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:43:14.915364 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-82b26f35-9924-4d91-86d9-11d5413abb7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:43:15.035996 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1320/2680] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 10 05:43:14 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 05:43:15.040600 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ee4531-0928-49f6-975f-008620d73460 service glance] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:43:15.108293 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ee4531-0928-49f6-975f-008620d73460 service glance] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:43:15.113897 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8de9275-04d5-4370-b86e-bc425b973950 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:43:15.114984 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8de9275-04d5-4370-b86e-bc425b973950 admin admin] REQUEST_METHOD: `POST` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:43:15.116053 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8de9275-04d5-4370-b86e-bc425b973950 admin admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:43:15.116528 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8de9275-04d5-4370-b86e-bc425b973950 admin admin] PATH_INFO: `/v3/projects` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:43:15.117967 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8de9275-04d5-4370-b86e-bc425b973950 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:43:15.120678 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8de9275-04d5-4370-b86e-bc425b973950 admin admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:43:15.151086 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1361/2681] 10.222.0.23 () {60 vars in 1152 bytes} [Tue May 10 05:43:15 2022] POST /identity/v3/projects => generated 367 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 05:43:15.155320 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b26f35-9924-4d91-86d9-11d5413abb7d None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:43:15.187279 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b26f35-9924-4d91-86d9-11d5413abb7d None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:43:15.248800 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c20efe1-5234-4ac8-8dc2-c61a940c7eec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:43:15.249528 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c20efe1-5234-4ac8-8dc2-c61a940c7eec admin admin] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:43:15.249813 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c20efe1-5234-4ac8-8dc2-c61a940c7eec admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:43:15.250092 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c20efe1-5234-4ac8-8dc2-c61a940c7eec admin admin] PATH_INFO: `/v3/users` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:43:15.250840 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c20efe1-5234-4ac8-8dc2-c61a940c7eec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:43:15.253483 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c20efe1-5234-4ac8-8dc2-c61a940c7eec admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:43:15.275780 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1321/2682] 10.222.0.23 () {60 vars in 1143 bytes} [Tue May 10 05:43:15 2022] POST /identity/v3/users => generated 290 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 05:43:15.280005 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8de9275-04d5-4370-b86e-bc425b973950 admin admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:43:15.291029 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8de9275-04d5-4370-b86e-bc425b973950 admin admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:43:15.296000 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501ace8a-9d37-428f-9a54-75807e32a299 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:43:15.296675 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501ace8a-9d37-428f-9a54-75807e32a299 admin admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:43:15.296953 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501ace8a-9d37-428f-9a54-75807e32a299 admin admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:43:15.297275 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501ace8a-9d37-428f-9a54-75807e32a299 admin admin] PATH_INFO: `/v3/roles` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:43:15.298014 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501ace8a-9d37-428f-9a54-75807e32a299 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:43:15.299663 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501ace8a-9d37-428f-9a54-75807e32a299 admin admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:43:15.312962 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1362/2683] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 10 05:43:15 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 05:43:15.316824 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c20efe1-5234-4ac8-8dc2-c61a940c7eec admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:43:15.326880 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c20efe1-5234-4ac8-8dc2-c61a940c7eec admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:43:15.331694 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a5b27c-6ed2-43cf-8c41-fc64b169898b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:43:15.332599 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a5b27c-6ed2-43cf-8c41-fc64b169898b admin admin] REQUEST_METHOD: `PUT` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:43:15.332881 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a5b27c-6ed2-43cf-8c41-fc64b169898b admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:43:15.333155 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a5b27c-6ed2-43cf-8c41-fc64b169898b admin admin] PATH_INFO: `/v3/projects/e6f83ef68b6f4c36979271e85e581753/users/15979d96048041e0a0eec57a2da68c62/roles/199ac1dd842441d7913c6ee89d8fbecc` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:43:15.348907 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a5b27c-6ed2-43cf-8c41-fc64b169898b admin admin] RBAC: Authorizing `identity:create_grant(project_id=e6f83ef68b6f4c36979271e85e581753, user_id=15979d96048041e0a0eec57a2da68c62, role_id=199ac1dd842441d7913c6ee89d8fbecc)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:43:15.351593 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a5b27c-6ed2-43cf-8c41-fc64b169898b admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:43:15.383877 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1322/2684] 10.222.0.23 () {60 vars in 1482 bytes} [Tue May 10 05:43:15 2022] PUT /identity/v3/projects/e6f83ef68b6f4c36979271e85e581753/users/15979d96048041e0a0eec57a2da68c62/roles/199ac1dd842441d7913c6ee89d8fbecc => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 05:43:15.390698 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501ace8a-9d37-428f-9a54-75807e32a299 admin admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:43:15.401610 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501ace8a-9d37-428f-9a54-75807e32a299 admin admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:43:15.479716 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae68966-180b-4bc6-8ae6-ddcf26bec9ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:43:15.480563 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae68966-180b-4bc6-8ae6-ddcf26bec9ba admin admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:43:15.480851 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae68966-180b-4bc6-8ae6-ddcf26bec9ba admin admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:43:15.481116 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae68966-180b-4bc6-8ae6-ddcf26bec9ba admin admin] PATH_INFO: `/v3/roles` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:43:15.481846 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae68966-180b-4bc6-8ae6-ddcf26bec9ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:43:15.483481 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae68966-180b-4bc6-8ae6-ddcf26bec9ba admin admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:43:15.497225 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1363/2685] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 10 05:43:15 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 05:43:15.498540 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a5b27c-6ed2-43cf-8c41-fc64b169898b admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:43:15.509105 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a5b27c-6ed2-43cf-8c41-fc64b169898b admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:43:15.514423 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae88566-d03e-4004-a472-633d72e8b040 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:43:15.515347 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae88566-d03e-4004-a472-633d72e8b040 admin admin] REQUEST_METHOD: `PUT` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:43:15.515673 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae88566-d03e-4004-a472-633d72e8b040 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:43:15.515953 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae88566-d03e-4004-a472-633d72e8b040 admin admin] PATH_INFO: `/v3/projects/e6f83ef68b6f4c36979271e85e581753/users/15979d96048041e0a0eec57a2da68c62/roles/199ac1dd842441d7913c6ee89d8fbecc` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:43:15.517962 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae88566-d03e-4004-a472-633d72e8b040 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e6f83ef68b6f4c36979271e85e581753, user_id=15979d96048041e0a0eec57a2da68c62, role_id=199ac1dd842441d7913c6ee89d8fbecc)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:43:15.520714 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae88566-d03e-4004-a472-633d72e8b040 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:43:15.530965 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1323/2686] 10.222.0.23 () {60 vars in 1482 bytes} [Tue May 10 05:43:15 2022] PUT /identity/v3/projects/e6f83ef68b6f4c36979271e85e581753/users/15979d96048041e0a0eec57a2da68c62/roles/199ac1dd842441d7913c6ee89d8fbecc => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 05:43:16.167108 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdf0abb-3945-4a56-a7e0-7fe6e12d5d54 None None] REQUEST_METHOD: `POST` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:43:16.167660 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdf0abb-3945-4a56-a7e0-7fe6e12d5d54 None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:43:16.167660 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdf0abb-3945-4a56-a7e0-7fe6e12d5d54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:43:16.196743 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.auth.core [None req-2fdf0abb-3945-4a56-a7e0-7fe6e12d5d54 None None] MFA Rules not processed for user `15979d96048041e0a0eec57a2da68c62`. Rule list: `[]` (Enabled: `True`). {{(pid=79879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:43:16.197984 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-2fdf0abb-3945-4a56-a7e0-7fe6e12d5d54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:43:16.271765 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1364/2687] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 10 05:43:16 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 05:43:16.281208 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae88566-d03e-4004-a472-633d72e8b040 admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:43:16.283373 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-1ae88566-d03e-4004-a472-633d72e8b040 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:43:16.338534 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae88566-d03e-4004-a472-633d72e8b040 admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:43:16.342225 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a000cffe-9521-4c7c-90f2-a9907b0abd2f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355be413675540a39ccb00e1a0722316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f23435f783540199d6dcfd0417c090e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:43:16.342875 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a000cffe-9521-4c7c-90f2-a9907b0abd2f service cinder] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:43:16.343162 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a000cffe-9521-4c7c-90f2-a9907b0abd2f service cinder] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:43:16.343471 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a000cffe-9521-4c7c-90f2-a9907b0abd2f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:43:16.400801 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a000cffe-9521-4c7c-90f2-a9907b0abd2f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:43:16.402237 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a000cffe-9521-4c7c-90f2-a9907b0abd2f service cinder] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:43:16.413623 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1324/2688] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 10 05:43:16 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 05:43:18.846179 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdf0abb-3945-4a56-a7e0-7fe6e12d5d54 None None] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:43:18.857128 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdf0abb-3945-4a56-a7e0-7fe6e12d5d54 None None] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:43:18.861362 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5895d6-0ebd-4265-9474-e301818cb9b3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355be413675540a39ccb00e1a0722316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f23435f783540199d6dcfd0417c090e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:43:18.862100 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5895d6-0ebd-4265-9474-e301818cb9b3 service cinder] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:43:18.862380 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5895d6-0ebd-4265-9474-e301818cb9b3 service cinder] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:43:18.862649 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5895d6-0ebd-4265-9474-e301818cb9b3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:43:18.872626 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5895d6-0ebd-4265-9474-e301818cb9b3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:43:18.874064 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5895d6-0ebd-4265-9474-e301818cb9b3 service cinder] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:43:18.885429 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1365/2689] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 10 05:43:18 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 05:43:22.546920 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d214b6-e410-4d7b-93d0-048c862c4a4d None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:43:22.547567 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d214b6-e410-4d7b-93d0-048c862c4a4d None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:43:22.547996 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d214b6-e410-4d7b-93d0-048c862c4a4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:43:22.569230 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-41d214b6-e410-4d7b-93d0-048c862c4a4d None None] MFA Rules not processed for user `40fc391e5388450bb37f541da17e95e0`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:43:22.570970 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-41d214b6-e410-4d7b-93d0-048c862c4a4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:43:22.640584 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1325/2690] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 10 05:43:22 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 05:43:26.302583 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f858e2-6846-420e-9b8a-5fe722ee57ca None None] REQUEST_METHOD: `POST` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:43:26.303088 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f858e2-6846-420e-9b8a-5fe722ee57ca None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:43:26.303185 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f858e2-6846-420e-9b8a-5fe722ee57ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:43:26.321136 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.auth.core [None req-92f858e2-6846-420e-9b8a-5fe722ee57ca None None] MFA Rules not processed for user `971cc0771bf5482095d77c0b471bfdb3`. Rule list: `[]` (Enabled: `True`). {{(pid=79879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:43:26.322368 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-92f858e2-6846-420e-9b8a-5fe722ee57ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:43:26.388010 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1366/2691] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 10 05:43:26 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 05:43:33.460893 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d214b6-e410-4d7b-93d0-048c862c4a4d None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:43:33.463105 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-41d214b6-e410-4d7b-93d0-048c862c4a4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:43:33.525247 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d214b6-e410-4d7b-93d0-048c862c4a4d None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:43:33.528989 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692027f8-1043-465a-86e8-a13e8d049dda service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c8461cfdd9648b8abcaf8d34b7a102a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f23435f783540199d6dcfd0417c090e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:43:33.529646 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692027f8-1043-465a-86e8-a13e8d049dda service neutron] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:43:33.529930 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692027f8-1043-465a-86e8-a13e8d049dda service neutron] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:43:33.530351 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692027f8-1043-465a-86e8-a13e8d049dda service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:43:33.532190 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-692027f8-1043-465a-86e8-a13e8d049dda service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:43:33.594798 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692027f8-1043-465a-86e8-a13e8d049dda service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:43:33.596294 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692027f8-1043-465a-86e8-a13e8d049dda service neutron] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:43:33.605936 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1326/2692] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 10 05:43:33 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 05:43:34.412832 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f858e2-6846-420e-9b8a-5fe722ee57ca None None] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:43:34.510779 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f858e2-6846-420e-9b8a-5fe722ee57ca None None] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:43:34.517453 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05e39a3-c55c-44a8-9dfd-8db9fcaf8264 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:43:34.518676 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05e39a3-c55c-44a8-9dfd-8db9fcaf8264 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:43:34.519144 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05e39a3-c55c-44a8-9dfd-8db9fcaf8264 admin admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:43:34.519611 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05e39a3-c55c-44a8-9dfd-8db9fcaf8264 admin admin] PATH_INFO: `/v3/users/a6e7712965164f7589b7c074c1310713` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:43:34.521020 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05e39a3-c55c-44a8-9dfd-8db9fcaf8264 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a6e7712965164f7589b7c074c1310713)` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:43:34.523123 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05e39a3-c55c-44a8-9dfd-8db9fcaf8264 admin admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:43:34.581196 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-a05e39a3-c55c-44a8-9dfd-8db9fcaf8264 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a6e7712965164f7589b7c074c1310713'} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:43:34.591230 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-a05e39a3-c55c-44a8-9dfd-8db9fcaf8264 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a6e7712965164f7589b7c074c1310713'} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:43:34.591996 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-a05e39a3-c55c-44a8-9dfd-8db9fcaf8264 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a6e7712965164f7589b7c074c1310713'} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:43:34.604502 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-a05e39a3-c55c-44a8-9dfd-8db9fcaf8264 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a6e7712965164f7589b7c074c1310713'} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:43:34.611969 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-a05e39a3-c55c-44a8-9dfd-8db9fcaf8264 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a6e7712965164f7589b7c074c1310713'} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:43:34.619329 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1367/2693] 10.222.0.23 () {58 vars in 1223 bytes} [Tue May 10 05:43:34 2022] DELETE /identity/v3/users/a6e7712965164f7589b7c074c1310713 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 05:43:34.823062 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692027f8-1043-465a-86e8-a13e8d049dda service neutron] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:43:34.838736 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692027f8-1043-465a-86e8-a13e8d049dda service neutron] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:43:34.916199 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ca34d6-072b-4c20-8014-ae0be8630ae9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:43:34.917468 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ca34d6-072b-4c20-8014-ae0be8630ae9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:43:34.917944 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ca34d6-072b-4c20-8014-ae0be8630ae9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:43:34.918281 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ca34d6-072b-4c20-8014-ae0be8630ae9 admin admin] PATH_INFO: `/v3/projects/acee54f44ec6408a9496fcac95f6be8b` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:43:34.919657 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ca34d6-072b-4c20-8014-ae0be8630ae9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=acee54f44ec6408a9496fcac95f6be8b)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:43:34.921629 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ca34d6-072b-4c20-8014-ae0be8630ae9 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:43:34.968110 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-01ca34d6-072b-4c20-8014-ae0be8630ae9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'acee54f44ec6408a9496fcac95f6be8b', 'request_id': 'req-01ca34d6-072b-4c20-8014-ae0be8630ae9'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:43:34.974735 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-01ca34d6-072b-4c20-8014-ae0be8630ae9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'acee54f44ec6408a9496fcac95f6be8b', 'request_id': 'req-01ca34d6-072b-4c20-8014-ae0be8630ae9'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:43:34.983877 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-01ca34d6-072b-4c20-8014-ae0be8630ae9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'acee54f44ec6408a9496fcac95f6be8b', 'request_id': 'req-01ca34d6-072b-4c20-8014-ae0be8630ae9'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:43:35.000095 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-01ca34d6-072b-4c20-8014-ae0be8630ae9 admin admin] The token cache is being invalidate because project acee54f44ec6408a9496fcac95f6be8b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79880) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 05:43:35.000386 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-01ca34d6-072b-4c20-8014-ae0be8630ae9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:43:35.001128 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-01ca34d6-072b-4c20-8014-ae0be8630ae9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:43:35.003844 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1327/2694] 10.222.0.23 () {58 vars in 1232 bytes} [Tue May 10 05:43:34 2022] DELETE /identity/v3/projects/acee54f44ec6408a9496fcac95f6be8b => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 05:43:35.007886 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05e39a3-c55c-44a8-9dfd-8db9fcaf8264 admin admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:43:35.009918 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-a05e39a3-c55c-44a8-9dfd-8db9fcaf8264 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:43:35.023561 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05e39a3-c55c-44a8-9dfd-8db9fcaf8264 admin admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:43:35.082206 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37499033-45be-44b6-af36-5e8ac0253d66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:43:35.083082 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37499033-45be-44b6-af36-5e8ac0253d66 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:43:35.083362 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37499033-45be-44b6-af36-5e8ac0253d66 admin admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:43:35.083660 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37499033-45be-44b6-af36-5e8ac0253d66 admin admin] PATH_INFO: `/v3/users/15979d96048041e0a0eec57a2da68c62` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:43:35.084890 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37499033-45be-44b6-af36-5e8ac0253d66 admin admin] RBAC: Authorizing `identity:delete_user(user_id=15979d96048041e0a0eec57a2da68c62)` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:43:35.086797 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37499033-45be-44b6-af36-5e8ac0253d66 admin admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:43:35.135381 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-37499033-45be-44b6-af36-5e8ac0253d66 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '15979d96048041e0a0eec57a2da68c62'} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:43:35.143412 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-37499033-45be-44b6-af36-5e8ac0253d66 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '15979d96048041e0a0eec57a2da68c62'} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:43:35.144310 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-37499033-45be-44b6-af36-5e8ac0253d66 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '15979d96048041e0a0eec57a2da68c62'} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:43:35.157219 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-37499033-45be-44b6-af36-5e8ac0253d66 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '15979d96048041e0a0eec57a2da68c62'} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:43:35.164858 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-37499033-45be-44b6-af36-5e8ac0253d66 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '15979d96048041e0a0eec57a2da68c62'} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:43:35.171481 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1368/2695] 10.222.0.23 () {58 vars in 1223 bytes} [Tue May 10 05:43:35 2022] DELETE /identity/v3/users/15979d96048041e0a0eec57a2da68c62 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 05:43:35.603836 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ca34d6-072b-4c20-8014-ae0be8630ae9 admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:43:35.605780 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-01ca34d6-072b-4c20-8014-ae0be8630ae9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:43:35.620226 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ca34d6-072b-4c20-8014-ae0be8630ae9 admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:43:35.692870 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af32fd99-002d-4bcd-84d4-ffa38a85f220 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:43:35.694111 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af32fd99-002d-4bcd-84d4-ffa38a85f220 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:43:35.694458 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af32fd99-002d-4bcd-84d4-ffa38a85f220 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:43:35.694797 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af32fd99-002d-4bcd-84d4-ffa38a85f220 admin admin] PATH_INFO: `/v3/projects/e6f83ef68b6f4c36979271e85e581753` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:43:35.696233 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af32fd99-002d-4bcd-84d4-ffa38a85f220 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e6f83ef68b6f4c36979271e85e581753)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:43:35.698262 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af32fd99-002d-4bcd-84d4-ffa38a85f220 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:43:35.756376 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-af32fd99-002d-4bcd-84d4-ffa38a85f220 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e6f83ef68b6f4c36979271e85e581753', 'request_id': 'req-af32fd99-002d-4bcd-84d4-ffa38a85f220'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:43:35.770336 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-af32fd99-002d-4bcd-84d4-ffa38a85f220 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e6f83ef68b6f4c36979271e85e581753', 'request_id': 'req-af32fd99-002d-4bcd-84d4-ffa38a85f220'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:43:35.783049 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-af32fd99-002d-4bcd-84d4-ffa38a85f220 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e6f83ef68b6f4c36979271e85e581753', 'request_id': 'req-af32fd99-002d-4bcd-84d4-ffa38a85f220'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:43:35.793423 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-af32fd99-002d-4bcd-84d4-ffa38a85f220 admin admin] The token cache is being invalidate because project e6f83ef68b6f4c36979271e85e581753 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79880) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 05:43:35.793943 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-af32fd99-002d-4bcd-84d4-ffa38a85f220 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:43:35.795104 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-af32fd99-002d-4bcd-84d4-ffa38a85f220 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:43:35.797755 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1328/2696] 10.222.0.23 () {58 vars in 1232 bytes} [Tue May 10 05:43:35 2022] DELETE /identity/v3/projects/e6f83ef68b6f4c36979271e85e581753 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 05:43:35.803195 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911b35f9-d5c7-4462-a758-9b1689ab51a8 None None] REQUEST_METHOD: `POST` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:43:35.803755 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911b35f9-d5c7-4462-a758-9b1689ab51a8 None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:43:35.803922 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911b35f9-d5c7-4462-a758-9b1689ab51a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:43:35.822313 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.auth.core [None req-911b35f9-d5c7-4462-a758-9b1689ab51a8 None None] MFA Rules not processed for user `44883b22532e44049d846938dc2cf423`. Rule list: `[]` (Enabled: `True`). {{(pid=79879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:43:35.823656 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-911b35f9-d5c7-4462-a758-9b1689ab51a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:43:35.885884 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1369/2697] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 10 05:43:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 05:43:35.895965 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003ecf02-46c8-4657-95a0-cfe095ae70f0 None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:43:35.896435 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003ecf02-46c8-4657-95a0-cfe095ae70f0 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:43:35.897242 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003ecf02-46c8-4657-95a0-cfe095ae70f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:43:35.923791 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-003ecf02-46c8-4657-95a0-cfe095ae70f0 None None] MFA Rules not processed for user `44883b22532e44049d846938dc2cf423`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:43:35.925249 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-003ecf02-46c8-4657-95a0-cfe095ae70f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:43:35.934415 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1329/2698] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 10 05:43:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 05:43:35.939086 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911b35f9-d5c7-4462-a758-9b1689ab51a8 None None] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:43:35.949338 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911b35f9-d5c7-4462-a758-9b1689ab51a8 None None] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:43:35.954368 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3ee917-51ce-415f-9c2b-64f16d2a2393 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:43:35.955140 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3ee917-51ce-415f-9c2b-64f16d2a2393 admin admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:43:35.955524 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3ee917-51ce-415f-9c2b-64f16d2a2393 admin admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:43:35.955915 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3ee917-51ce-415f-9c2b-64f16d2a2393 admin admin] PATH_INFO: `/v3/domains` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:43:35.956768 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3ee917-51ce-415f-9c2b-64f16d2a2393 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:43:35.957162 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3ee917-51ce-415f-9c2b-64f16d2a2393 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:43:35.959135 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3ee917-51ce-415f-9c2b-64f16d2a2393 admin admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:43:35.971845 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1370/2699] 10.222.0.23 () {58 vars in 1152 bytes} [Tue May 10 05:43:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 05:43:35.976054 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003ecf02-46c8-4657-95a0-cfe095ae70f0 None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:43:35.985840 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003ecf02-46c8-4657-95a0-cfe095ae70f0 None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:43:35.990876 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac9c09a-0117-40e9-bfd7-4550cc7f17b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:43:35.991673 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac9c09a-0117-40e9-bfd7-4550cc7f17b5 admin admin] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:43:35.992048 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac9c09a-0117-40e9-bfd7-4550cc7f17b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:43:35.992399 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac9c09a-0117-40e9-bfd7-4550cc7f17b5 admin admin] PATH_INFO: `/v3/projects` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:43:35.993184 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac9c09a-0117-40e9-bfd7-4550cc7f17b5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:43:35.995124 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac9c09a-0117-40e9-bfd7-4550cc7f17b5 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:43:36.031698 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1330/2700] 10.222.0.23 () {60 vars in 1152 bytes} [Tue May 10 05:43:35 2022] POST /identity/v3/projects => generated 383 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 05:43:36.033730 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3ee917-51ce-415f-9c2b-64f16d2a2393 admin admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:43:36.043962 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3ee917-51ce-415f-9c2b-64f16d2a2393 admin admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:43:36.106396 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c458b71b-fceb-4b52-b45e-954bf572484e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:43:36.107163 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c458b71b-fceb-4b52-b45e-954bf572484e admin admin] REQUEST_METHOD: `POST` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:43:36.107438 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c458b71b-fceb-4b52-b45e-954bf572484e admin admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:43:36.107741 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c458b71b-fceb-4b52-b45e-954bf572484e admin admin] PATH_INFO: `/v3/users` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:43:36.108478 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c458b71b-fceb-4b52-b45e-954bf572484e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:43:36.110432 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c458b71b-fceb-4b52-b45e-954bf572484e admin admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:43:36.135783 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1371/2701] 10.222.0.23 () {60 vars in 1143 bytes} [Tue May 10 05:43:36 2022] POST /identity/v3/users => generated 292 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 05:43:36.138240 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac9c09a-0117-40e9-bfd7-4550cc7f17b5 admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:43:36.150782 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac9c09a-0117-40e9-bfd7-4550cc7f17b5 admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:43:36.157261 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9196c74f-ec32-4010-9671-f5412bb8e258 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:43:36.157952 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9196c74f-ec32-4010-9671-f5412bb8e258 admin admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:43:36.158230 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9196c74f-ec32-4010-9671-f5412bb8e258 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:43:36.158503 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9196c74f-ec32-4010-9671-f5412bb8e258 admin admin] PATH_INFO: `/v3/roles` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:43:36.159303 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9196c74f-ec32-4010-9671-f5412bb8e258 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:43:36.161232 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9196c74f-ec32-4010-9671-f5412bb8e258 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:43:36.180925 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c458b71b-fceb-4b52-b45e-954bf572484e admin admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:43:36.181960 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1331/2702] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 10 05:43:36 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 05:43:36.193640 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c458b71b-fceb-4b52-b45e-954bf572484e admin admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:43:36.200767 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5aaa953-19a9-4021-9d2d-bf9524a92028 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:43:36.201597 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5aaa953-19a9-4021-9d2d-bf9524a92028 admin admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:43:36.202695 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5aaa953-19a9-4021-9d2d-bf9524a92028 admin admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:43:36.203755 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5aaa953-19a9-4021-9d2d-bf9524a92028 admin admin] PATH_INFO: `/v3/roles` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:43:36.204692 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5aaa953-19a9-4021-9d2d-bf9524a92028 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:43:36.206412 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5aaa953-19a9-4021-9d2d-bf9524a92028 admin admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:43:36.217991 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1372/2703] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 10 05:43:36 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 05:43:36.222012 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9196c74f-ec32-4010-9671-f5412bb8e258 admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:43:36.232718 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9196c74f-ec32-4010-9671-f5412bb8e258 admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:43:36.239251 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35760bcf-b4df-4859-bf4f-6bf08f227c4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:43:36.240270 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35760bcf-b4df-4859-bf4f-6bf08f227c4e admin admin] REQUEST_METHOD: `PUT` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:43:36.240618 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35760bcf-b4df-4859-bf4f-6bf08f227c4e admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:43:36.240960 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35760bcf-b4df-4859-bf4f-6bf08f227c4e admin admin] PATH_INFO: `/v3/projects/2cc018f8fd2047c8ace099d5cc8768d6/users/6c710a7e635b43398c2a4fc2927ed171/roles/382636e67fc142a2b2f486340d959e11` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:43:36.260354 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35760bcf-b4df-4859-bf4f-6bf08f227c4e admin admin] RBAC: Authorizing `identity:create_grant(project_id=2cc018f8fd2047c8ace099d5cc8768d6, user_id=6c710a7e635b43398c2a4fc2927ed171, role_id=382636e67fc142a2b2f486340d959e11)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:43:36.263969 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35760bcf-b4df-4859-bf4f-6bf08f227c4e admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:43:36.307670 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1332/2704] 10.222.0.23 () {60 vars in 1482 bytes} [Tue May 10 05:43:36 2022] PUT /identity/v3/projects/2cc018f8fd2047c8ace099d5cc8768d6/users/6c710a7e635b43398c2a4fc2927ed171/roles/382636e67fc142a2b2f486340d959e11 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 05:43:36.308089 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9124a3e-7fbc-4ed3-9532-c8171f7114cf None None] REQUEST_METHOD: `POST` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:43:36.308437 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9124a3e-7fbc-4ed3-9532-c8171f7114cf None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:43:36.308715 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9124a3e-7fbc-4ed3-9532-c8171f7114cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:43:36.361204 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.auth.core [None req-f9124a3e-7fbc-4ed3-9532-c8171f7114cf None None] MFA Rules not processed for user `6c710a7e635b43398c2a4fc2927ed171`. Rule list: `[]` (Enabled: `True`). {{(pid=79879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:43:36.362532 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-f9124a3e-7fbc-4ed3-9532-c8171f7114cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:43:36.487847 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1373/2705] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 10 05:43:36 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 05:43:36.501356 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35760bcf-b4df-4859-bf4f-6bf08f227c4e admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:43:36.503483 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-35760bcf-b4df-4859-bf4f-6bf08f227c4e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:43:36.636771 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35760bcf-b4df-4859-bf4f-6bf08f227c4e admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:43:36.645825 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6d2f13-0395-444b-826d-85c710d86d49 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355be413675540a39ccb00e1a0722316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f23435f783540199d6dcfd0417c090e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:43:36.646761 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6d2f13-0395-444b-826d-85c710d86d49 service cinder] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:43:36.647035 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6d2f13-0395-444b-826d-85c710d86d49 service cinder] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:43:36.647286 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6d2f13-0395-444b-826d-85c710d86d49 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:43:36.676670 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6d2f13-0395-444b-826d-85c710d86d49 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:43:36.678188 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6d2f13-0395-444b-826d-85c710d86d49 service cinder] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:43:36.706050 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1333/2706] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 10 05:43:36 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 05:43:36.757048 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9124a3e-7fbc-4ed3-9532-c8171f7114cf None None] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:43:36.813506 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6d2f13-0395-444b-826d-85c710d86d49 service cinder] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:43:36.815709 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-fb6d2f13-0395-444b-826d-85c710d86d49 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:43:36.921273 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9124a3e-7fbc-4ed3-9532-c8171f7114cf None None] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:43:36.923715 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6d2f13-0395-444b-826d-85c710d86d49 service cinder] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:43:36.928587 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e3310c-ea50-4ebc-b82b-76f8fac4bf4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:43:36.929991 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e3310c-ea50-4ebc-b82b-76f8fac4bf4c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:43:36.930358 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e3310c-ea50-4ebc-b82b-76f8fac4bf4c admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:43:36.930921 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e3310c-ea50-4ebc-b82b-76f8fac4bf4c admin admin] PATH_INFO: `/v3/users/17f3d1ce41ab4ce4a636b6dde6c7df97` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:43:36.932358 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e3310c-ea50-4ebc-b82b-76f8fac4bf4c admin admin] RBAC: Authorizing `identity:delete_user(user_id=17f3d1ce41ab4ce4a636b6dde6c7df97)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:43:36.934463 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e3310c-ea50-4ebc-b82b-76f8fac4bf4c admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:43:36.935131 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babb1932-d482-4e98-9057-300b726be01d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:43:36.936181 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babb1932-d482-4e98-9057-300b726be01d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:43:36.936464 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babb1932-d482-4e98-9057-300b726be01d admin admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:43:36.936738 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babb1932-d482-4e98-9057-300b726be01d admin admin] PATH_INFO: `/v3/users/6c710a7e635b43398c2a4fc2927ed171` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:43:36.939890 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babb1932-d482-4e98-9057-300b726be01d admin admin] RBAC: Authorizing `identity:delete_user(user_id=6c710a7e635b43398c2a4fc2927ed171)` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:43:36.947039 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babb1932-d482-4e98-9057-300b726be01d admin admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:43:37.019325 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-60e3310c-ea50-4ebc-b82b-76f8fac4bf4c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '17f3d1ce41ab4ce4a636b6dde6c7df97'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:43:37.026850 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-babb1932-d482-4e98-9057-300b726be01d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6c710a7e635b43398c2a4fc2927ed171'} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:43:37.032263 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-60e3310c-ea50-4ebc-b82b-76f8fac4bf4c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '17f3d1ce41ab4ce4a636b6dde6c7df97'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:43:37.032704 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-60e3310c-ea50-4ebc-b82b-76f8fac4bf4c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '17f3d1ce41ab4ce4a636b6dde6c7df97'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:43:37.039558 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-60e3310c-ea50-4ebc-b82b-76f8fac4bf4c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '17f3d1ce41ab4ce4a636b6dde6c7df97'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:43:37.040333 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-60e3310c-ea50-4ebc-b82b-76f8fac4bf4c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '17f3d1ce41ab4ce4a636b6dde6c7df97'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:43:37.046672 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-babb1932-d482-4e98-9057-300b726be01d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6c710a7e635b43398c2a4fc2927ed171'} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:43:37.047380 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-babb1932-d482-4e98-9057-300b726be01d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6c710a7e635b43398c2a4fc2927ed171'} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:43:37.054518 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1334/2707] 10.222.0.23 () {58 vars in 1223 bytes} [Tue May 10 05:43:36 2022] DELETE /identity/v3/users/17f3d1ce41ab4ce4a636b6dde6c7df97 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 05:43:37.059627 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcb207f-2165-48bc-8715-fe6d0fbce81f None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:43:37.060044 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcb207f-2165-48bc-8715-fe6d0fbce81f None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:43:37.060387 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcb207f-2165-48bc-8715-fe6d0fbce81f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:43:37.063600 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-babb1932-d482-4e98-9057-300b726be01d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6c710a7e635b43398c2a4fc2927ed171'} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:43:37.071731 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-babb1932-d482-4e98-9057-300b726be01d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6c710a7e635b43398c2a4fc2927ed171'} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:43:37.077628 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-fbcb207f-2165-48bc-8715-fe6d0fbce81f None None] MFA Rules not processed for user `44883b22532e44049d846938dc2cf423`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:43:37.078227 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1374/2708] 10.222.0.23 () {58 vars in 1223 bytes} [Tue May 10 05:43:36 2022] DELETE /identity/v3/users/6c710a7e635b43398c2a4fc2927ed171 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 05:43:37.080908 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-fbcb207f-2165-48bc-8715-fe6d0fbce81f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:43:37.082525 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f36223-6367-428e-9599-93d05c529fdf None None] REQUEST_METHOD: `POST` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:43:37.082878 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f36223-6367-428e-9599-93d05c529fdf None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:43:37.083225 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f36223-6367-428e-9599-93d05c529fdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:43:37.102059 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.auth.core [None req-f2f36223-6367-428e-9599-93d05c529fdf None None] MFA Rules not processed for user `44883b22532e44049d846938dc2cf423`. Rule list: `[]` (Enabled: `True`). {{(pid=79879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:43:37.103218 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-f2f36223-6367-428e-9599-93d05c529fdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:43:37.146184 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1335/2709] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 10 05:43:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 05:43:37.156007 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcb207f-2165-48bc-8715-fe6d0fbce81f None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:43:37.157599 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-fbcb207f-2165-48bc-8715-fe6d0fbce81f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:43:37.168661 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1375/2710] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 10 05:43:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 05:43:37.178057 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f36223-6367-428e-9599-93d05c529fdf None None] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:43:37.179544 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-f2f36223-6367-428e-9599-93d05c529fdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:43:37.234911 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcb207f-2165-48bc-8715-fe6d0fbce81f None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:43:37.237952 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f36223-6367-428e-9599-93d05c529fdf None None] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:43:37.240633 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed89c1a-a58f-4d4b-ae83-a712e3ff37ec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c8461cfdd9648b8abcaf8d34b7a102a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f23435f783540199d6dcfd0417c090e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:43:37.241564 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed89c1a-a58f-4d4b-ae83-a712e3ff37ec service neutron] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:43:37.241993 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed89c1a-a58f-4d4b-ae83-a712e3ff37ec service neutron] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:43:37.242348 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed89c1a-a58f-4d4b-ae83-a712e3ff37ec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:43:37.242674 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452e3a5f-6299-498b-ac78-5dea20f7f0da service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c8461cfdd9648b8abcaf8d34b7a102a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f23435f783540199d6dcfd0417c090e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:43:37.243307 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452e3a5f-6299-498b-ac78-5dea20f7f0da service neutron] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:43:37.243889 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452e3a5f-6299-498b-ac78-5dea20f7f0da service neutron] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:43:37.244214 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452e3a5f-6299-498b-ac78-5dea20f7f0da service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:43:37.255245 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed89c1a-a58f-4d4b-ae83-a712e3ff37ec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:43:37.256998 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed89c1a-a58f-4d4b-ae83-a712e3ff37ec service neutron] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:43:37.257126 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452e3a5f-6299-498b-ac78-5dea20f7f0da service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:43:37.258652 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452e3a5f-6299-498b-ac78-5dea20f7f0da service neutron] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:43:37.268415 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1336/2711] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 10 05:43:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 05:43:37.269410 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1376/2712] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 10 05:43:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 05:43:37.666157 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452e3a5f-6299-498b-ac78-5dea20f7f0da service neutron] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:43:37.668738 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-452e3a5f-6299-498b-ac78-5dea20f7f0da service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:43:37.669226 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed89c1a-a58f-4d4b-ae83-a712e3ff37ec service neutron] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:43:37.671065 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-9ed89c1a-a58f-4d4b-ae83-a712e3ff37ec service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:43:37.681588 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452e3a5f-6299-498b-ac78-5dea20f7f0da service neutron] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:43:37.683904 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed89c1a-a58f-4d4b-ae83-a712e3ff37ec service neutron] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:43:37.686368 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d1aabb-8556-44bc-be31-9b0c6941b366 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:43:37.687374 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d1aabb-8556-44bc-be31-9b0c6941b366 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:43:37.687837 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d1aabb-8556-44bc-be31-9b0c6941b366 admin admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:43:37.688271 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d1aabb-8556-44bc-be31-9b0c6941b366 admin admin] PATH_INFO: `/v3/projects/9b9017e1ad684d91823ed597b4febd86` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:43:37.689582 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d1aabb-8556-44bc-be31-9b0c6941b366 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9b9017e1ad684d91823ed597b4febd86)` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:43:37.691143 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5c7c48-6fd4-46f1-8225-00f05bebdfeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:43:37.691507 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d1aabb-8556-44bc-be31-9b0c6941b366 admin admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:43:37.692770 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5c7c48-6fd4-46f1-8225-00f05bebdfeb admin admin] REQUEST_METHOD: `DELETE` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:43:37.693388 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5c7c48-6fd4-46f1-8225-00f05bebdfeb admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:43:37.693887 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5c7c48-6fd4-46f1-8225-00f05bebdfeb admin admin] PATH_INFO: `/v3/projects/2cc018f8fd2047c8ace099d5cc8768d6` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:43:37.695201 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5c7c48-6fd4-46f1-8225-00f05bebdfeb admin admin] RBAC: Authorizing `identity:delete_project(project_id=2cc018f8fd2047c8ace099d5cc8768d6)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:43:37.697496 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5c7c48-6fd4-46f1-8225-00f05bebdfeb admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:43:37.741311 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-71d1aabb-8556-44bc-be31-9b0c6941b366 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9b9017e1ad684d91823ed597b4febd86', 'request_id': 'req-71d1aabb-8556-44bc-be31-9b0c6941b366'} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:43:37.747706 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-71d1aabb-8556-44bc-be31-9b0c6941b366 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9b9017e1ad684d91823ed597b4febd86', 'request_id': 'req-71d1aabb-8556-44bc-be31-9b0c6941b366'} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:43:37.748141 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-9a5c7c48-6fd4-46f1-8225-00f05bebdfeb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2cc018f8fd2047c8ace099d5cc8768d6', 'request_id': 'req-9a5c7c48-6fd4-46f1-8225-00f05bebdfeb'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:43:37.754761 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-9a5c7c48-6fd4-46f1-8225-00f05bebdfeb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2cc018f8fd2047c8ace099d5cc8768d6', 'request_id': 'req-9a5c7c48-6fd4-46f1-8225-00f05bebdfeb'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:43:37.755005 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-71d1aabb-8556-44bc-be31-9b0c6941b366 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9b9017e1ad684d91823ed597b4febd86', 'request_id': 'req-71d1aabb-8556-44bc-be31-9b0c6941b366'} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:43:37.762495 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-9a5c7c48-6fd4-46f1-8225-00f05bebdfeb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2cc018f8fd2047c8ace099d5cc8768d6', 'request_id': 'req-9a5c7c48-6fd4-46f1-8225-00f05bebdfeb'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:43:37.766182 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-71d1aabb-8556-44bc-be31-9b0c6941b366 admin admin] The token cache is being invalidate because project 9b9017e1ad684d91823ed597b4febd86 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79879) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 05:43:37.766553 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-71d1aabb-8556-44bc-be31-9b0c6941b366 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:43:37.767228 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-71d1aabb-8556-44bc-be31-9b0c6941b366 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:43:37.768862 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1377/2713] 10.222.0.23 () {58 vars in 1232 bytes} [Tue May 10 05:43:37 2022] DELETE /identity/v3/projects/9b9017e1ad684d91823ed597b4febd86 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 05:43:37.773662 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64f4c15-5b62-4bcf-abb7-2801d7c5e3ec None None] REQUEST_METHOD: `POST` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:43:37.773951 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64f4c15-5b62-4bcf-abb7-2801d7c5e3ec None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:43:37.774232 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64f4c15-5b62-4bcf-abb7-2801d7c5e3ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:43:37.775907 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-9a5c7c48-6fd4-46f1-8225-00f05bebdfeb admin admin] The token cache is being invalidate because project 2cc018f8fd2047c8ace099d5cc8768d6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79880) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 05:43:37.776300 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-9a5c7c48-6fd4-46f1-8225-00f05bebdfeb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:43:37.776928 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-9a5c7c48-6fd4-46f1-8225-00f05bebdfeb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:43:37.778510 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1337/2714] 10.222.0.23 () {58 vars in 1232 bytes} [Tue May 10 05:43:37 2022] DELETE /identity/v3/projects/2cc018f8fd2047c8ace099d5cc8768d6 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 05:43:37.783503 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f9e44f-d2c0-4d25-ac4a-7a0ca80cd8e3 None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:43:37.783821 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f9e44f-d2c0-4d25-ac4a-7a0ca80cd8e3 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:43:37.784097 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f9e44f-d2c0-4d25-ac4a-7a0ca80cd8e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:43:37.792480 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.auth.core [None req-c64f4c15-5b62-4bcf-abb7-2801d7c5e3ec None None] MFA Rules not processed for user `44883b22532e44049d846938dc2cf423`. Rule list: `[]` (Enabled: `True`). {{(pid=79879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:43:37.793759 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-c64f4c15-5b62-4bcf-abb7-2801d7c5e3ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:43:37.801864 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-d8f9e44f-d2c0-4d25-ac4a-7a0ca80cd8e3 None None] MFA Rules not processed for user `44883b22532e44049d846938dc2cf423`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:43:37.803020 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-d8f9e44f-d2c0-4d25-ac4a-7a0ca80cd8e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:43:37.854357 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1378/2715] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 10 05:43:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 05:43:37.866959 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090bcd81-661a-4f97-95c1-4218492a20b3 None None] REQUEST_METHOD: `POST` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:43:37.867215 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090bcd81-661a-4f97-95c1-4218492a20b3 None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:43:37.867770 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090bcd81-661a-4f97-95c1-4218492a20b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:43:37.876964 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1338/2716] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 10 05:43:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 05:43:37.879196 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2c0e87-184e-4142-a24d-f1a9d6bff526 None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:43:37.879476 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2c0e87-184e-4142-a24d-f1a9d6bff526 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:43:37.879799 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2c0e87-184e-4142-a24d-f1a9d6bff526 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:43:37.891541 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.auth.core [None req-090bcd81-661a-4f97-95c1-4218492a20b3 None None] MFA Rules not processed for user `44883b22532e44049d846938dc2cf423`. Rule list: `[]` (Enabled: `True`). {{(pid=79879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:43:37.892832 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-090bcd81-661a-4f97-95c1-4218492a20b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:43:37.899535 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-cd2c0e87-184e-4142-a24d-f1a9d6bff526 None None] MFA Rules not processed for user `44883b22532e44049d846938dc2cf423`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:43:37.900860 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-cd2c0e87-184e-4142-a24d-f1a9d6bff526 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:43:37.901004 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1379/2717] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 10 05:43:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 05:43:37.904946 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090bcd81-661a-4f97-95c1-4218492a20b3 None None] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:43:37.910038 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1339/2718] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 10 05:43:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 05:43:37.913944 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2c0e87-184e-4142-a24d-f1a9d6bff526 None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:43:37.914459 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090bcd81-661a-4f97-95c1-4218492a20b3 None None] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:43:37.919469 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f704d5ee-a844-4298-8880-da59d0fe2964 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:43:37.919707 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f704d5ee-a844-4298-8880-da59d0fe2964 admin admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:43:37.919975 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f704d5ee-a844-4298-8880-da59d0fe2964 admin admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:43:37.920247 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f704d5ee-a844-4298-8880-da59d0fe2964 admin admin] PATH_INFO: `/v3/domains` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:43:37.920995 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f704d5ee-a844-4298-8880-da59d0fe2964 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:43:37.921350 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f704d5ee-a844-4298-8880-da59d0fe2964 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:43:37.922631 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2c0e87-184e-4142-a24d-f1a9d6bff526 None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:43:37.922950 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f704d5ee-a844-4298-8880-da59d0fe2964 admin admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:43:37.927170 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be616396-102a-429b-93bf-5da5857f10a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:43:37.927838 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be616396-102a-429b-93bf-5da5857f10a4 admin admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:43:37.928116 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be616396-102a-429b-93bf-5da5857f10a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:43:37.928389 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be616396-102a-429b-93bf-5da5857f10a4 admin admin] PATH_INFO: `/v3/domains` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:43:37.929116 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be616396-102a-429b-93bf-5da5857f10a4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:43:37.929420 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be616396-102a-429b-93bf-5da5857f10a4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:43:37.930984 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be616396-102a-429b-93bf-5da5857f10a4 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:43:37.934415 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1380/2719] 10.222.0.23 () {58 vars in 1152 bytes} [Tue May 10 05:43:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 05:43:37.938709 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f704d5ee-a844-4298-8880-da59d0fe2964 admin admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:43:37.942706 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1340/2720] 10.222.0.23 () {58 vars in 1152 bytes} [Tue May 10 05:43:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 05:43:37.946898 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be616396-102a-429b-93bf-5da5857f10a4 admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:43:37.948446 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f704d5ee-a844-4298-8880-da59d0fe2964 admin admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:43:37.953010 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81e3ae9-955b-4e55-a737-95c29f463e4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:43:37.953652 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81e3ae9-955b-4e55-a737-95c29f463e4f admin admin] REQUEST_METHOD: `POST` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:43:37.953937 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81e3ae9-955b-4e55-a737-95c29f463e4f admin admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:43:37.954214 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81e3ae9-955b-4e55-a737-95c29f463e4f admin admin] PATH_INFO: `/v3/projects` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:43:37.954897 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81e3ae9-955b-4e55-a737-95c29f463e4f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:43:37.956184 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be616396-102a-429b-93bf-5da5857f10a4 admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:43:37.957816 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81e3ae9-955b-4e55-a737-95c29f463e4f admin admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:43:37.960691 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9110bbb-73d8-4468-8e47-151611849918 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:43:37.961332 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9110bbb-73d8-4468-8e47-151611849918 admin admin] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:43:37.961608 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9110bbb-73d8-4468-8e47-151611849918 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:43:37.961882 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9110bbb-73d8-4468-8e47-151611849918 admin admin] PATH_INFO: `/v3/projects` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:43:37.962568 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9110bbb-73d8-4468-8e47-151611849918 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:43:37.964493 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9110bbb-73d8-4468-8e47-151611849918 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:43:37.986667 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1381/2721] 10.222.0.23 () {60 vars in 1152 bytes} [Tue May 10 05:43:37 2022] POST /identity/v3/projects => generated 371 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 05:43:37.990642 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81e3ae9-955b-4e55-a737-95c29f463e4f admin admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:43:37.991784 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1341/2722] 10.222.0.23 () {60 vars in 1152 bytes} [Tue May 10 05:43:37 2022] POST /identity/v3/projects => generated 377 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 05:43:37.995474 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9110bbb-73d8-4468-8e47-151611849918 admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:43:38.054024 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81e3ae9-955b-4e55-a737-95c29f463e4f admin admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:43:38.058815 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5d4a80-8fd4-46a9-9ab0-b9f7c464741e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:43:38.059491 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5d4a80-8fd4-46a9-9ab0-b9f7c464741e admin admin] REQUEST_METHOD: `POST` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:43:38.059826 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5d4a80-8fd4-46a9-9ab0-b9f7c464741e admin admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:43:38.060402 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5d4a80-8fd4-46a9-9ab0-b9f7c464741e admin admin] PATH_INFO: `/v3/users` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:43:38.061105 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5d4a80-8fd4-46a9-9ab0-b9f7c464741e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:43:38.062228 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9110bbb-73d8-4468-8e47-151611849918 admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:43:38.063141 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5d4a80-8fd4-46a9-9ab0-b9f7c464741e admin admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:43:38.067129 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86af2af-6bc2-4efb-a929-21764f89ad6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:43:38.067907 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86af2af-6bc2-4efb-a929-21764f89ad6a admin admin] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:43:38.068194 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86af2af-6bc2-4efb-a929-21764f89ad6a admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:43:38.068473 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86af2af-6bc2-4efb-a929-21764f89ad6a admin admin] PATH_INFO: `/v3/users` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:43:38.069530 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86af2af-6bc2-4efb-a929-21764f89ad6a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:43:38.071533 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86af2af-6bc2-4efb-a929-21764f89ad6a admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:43:38.084598 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1382/2723] 10.222.0.23 () {60 vars in 1143 bytes} [Tue May 10 05:43:37 2022] POST /identity/v3/users => generated 286 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 05:43:38.088393 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5d4a80-8fd4-46a9-9ab0-b9f7c464741e admin admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:43:38.098671 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5d4a80-8fd4-46a9-9ab0-b9f7c464741e admin admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:43:38.099752 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1342/2724] 10.222.0.23 () {60 vars in 1143 bytes} [Tue May 10 05:43:37 2022] POST /identity/v3/users => generated 289 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 05:43:38.102122 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86af2af-6bc2-4efb-a929-21764f89ad6a admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:43:38.106327 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05ce578-3a81-4613-ac70-b1432a91b172 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:43:38.106998 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05ce578-3a81-4613-ac70-b1432a91b172 admin admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:43:38.107279 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05ce578-3a81-4613-ac70-b1432a91b172 admin admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:43:38.107554 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05ce578-3a81-4613-ac70-b1432a91b172 admin admin] PATH_INFO: `/v3/roles` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:43:38.108325 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05ce578-3a81-4613-ac70-b1432a91b172 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:43:38.109939 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05ce578-3a81-4613-ac70-b1432a91b172 admin admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:43:38.112412 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86af2af-6bc2-4efb-a929-21764f89ad6a admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:43:38.117209 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4b86e1-b183-4ea7-b66c-10de4a8e83f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:43:38.117790 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4b86e1-b183-4ea7-b66c-10de4a8e83f1 admin admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:43:38.118190 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4b86e1-b183-4ea7-b66c-10de4a8e83f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:43:38.118514 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4b86e1-b183-4ea7-b66c-10de4a8e83f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:43:38.119251 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4b86e1-b183-4ea7-b66c-10de4a8e83f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:43:38.120815 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1383/2725] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 10 05:43:38 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 05:43:38.123821 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4b86e1-b183-4ea7-b66c-10de4a8e83f1 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:43:38.125514 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05ce578-3a81-4613-ac70-b1432a91b172 admin admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:43:38.134425 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1343/2726] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 10 05:43:38 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 05:43:38.137331 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05ce578-3a81-4613-ac70-b1432a91b172 admin admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:43:38.138111 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4b86e1-b183-4ea7-b66c-10de4a8e83f1 admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:43:38.142417 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ca92b7-a6ee-4b93-bf07-ef83d71d36b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:43:38.143273 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ca92b7-a6ee-4b93-bf07-ef83d71d36b6 admin admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:43:38.145604 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ca92b7-a6ee-4b93-bf07-ef83d71d36b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:43:38.145959 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ca92b7-a6ee-4b93-bf07-ef83d71d36b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:43:38.146770 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ca92b7-a6ee-4b93-bf07-ef83d71d36b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:43:38.148490 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ca92b7-a6ee-4b93-bf07-ef83d71d36b6 admin admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:43:38.148643 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4b86e1-b183-4ea7-b66c-10de4a8e83f1 admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:43:38.153775 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f91b17-1e59-43ae-9f9f-4b02e7939880 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:43:38.155043 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f91b17-1e59-43ae-9f9f-4b02e7939880 admin admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:43:38.155043 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f91b17-1e59-43ae-9f9f-4b02e7939880 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:43:38.155385 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f91b17-1e59-43ae-9f9f-4b02e7939880 admin admin] PATH_INFO: `/v3/roles` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:43:38.156199 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f91b17-1e59-43ae-9f9f-4b02e7939880 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:43:38.157804 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f91b17-1e59-43ae-9f9f-4b02e7939880 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:43:38.164090 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1384/2727] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 10 05:43:38 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 05:43:38.164820 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ca92b7-a6ee-4b93-bf07-ef83d71d36b6 admin admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:43:38.170239 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1344/2728] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 10 05:43:38 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 05:43:38.175089 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ca92b7-a6ee-4b93-bf07-ef83d71d36b6 admin admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:43:38.180076 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288ba6ec-b590-420b-abb9-aefcbf113b73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:43:38.180325 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f91b17-1e59-43ae-9f9f-4b02e7939880 admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:43:38.181100 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288ba6ec-b590-420b-abb9-aefcbf113b73 admin admin] REQUEST_METHOD: `PUT` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:43:38.181475 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288ba6ec-b590-420b-abb9-aefcbf113b73 admin admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:43:38.181754 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288ba6ec-b590-420b-abb9-aefcbf113b73 admin admin] PATH_INFO: `/v3/projects/8b55b60f51ec402fb551cc60ee0ae48e/users/aebb07ff7214444a92834a3c1bd50516/roles/382636e67fc142a2b2f486340d959e11` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:43:38.190704 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f91b17-1e59-43ae-9f9f-4b02e7939880 admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:43:38.195752 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3bfc8c-c355-484d-9015-3d2cdf61737c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:43:38.196709 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3bfc8c-c355-484d-9015-3d2cdf61737c admin admin] REQUEST_METHOD: `PUT` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:43:38.197056 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3bfc8c-c355-484d-9015-3d2cdf61737c admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:43:38.197395 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3bfc8c-c355-484d-9015-3d2cdf61737c admin admin] PATH_INFO: `/v3/projects/5702bd0fa01945dcba0c0e766df76133/users/322370a429d64d11a48a08e75babc0d7/roles/382636e67fc142a2b2f486340d959e11` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:43:38.197518 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288ba6ec-b590-420b-abb9-aefcbf113b73 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b55b60f51ec402fb551cc60ee0ae48e, user_id=aebb07ff7214444a92834a3c1bd50516, role_id=382636e67fc142a2b2f486340d959e11)` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:43:38.200158 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288ba6ec-b590-420b-abb9-aefcbf113b73 admin admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:43:38.212875 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3bfc8c-c355-484d-9015-3d2cdf61737c admin admin] RBAC: Authorizing `identity:create_grant(project_id=5702bd0fa01945dcba0c0e766df76133, user_id=322370a429d64d11a48a08e75babc0d7, role_id=382636e67fc142a2b2f486340d959e11)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:43:38.215059 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1385/2729] 10.222.0.23 () {60 vars in 1482 bytes} [Tue May 10 05:43:38 2022] PUT /identity/v3/projects/8b55b60f51ec402fb551cc60ee0ae48e/users/aebb07ff7214444a92834a3c1bd50516/roles/382636e67fc142a2b2f486340d959e11 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 05:43:38.215709 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3bfc8c-c355-484d-9015-3d2cdf61737c admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:43:38.225089 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f0198f-56f5-4954-a7ff-1def7b27b4df None None] REQUEST_METHOD: `POST` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:43:38.225371 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f0198f-56f5-4954-a7ff-1def7b27b4df None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:43:38.225651 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f0198f-56f5-4954-a7ff-1def7b27b4df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:43:38.228792 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1345/2730] 10.222.0.23 () {60 vars in 1482 bytes} [Tue May 10 05:43:38 2022] PUT /identity/v3/projects/5702bd0fa01945dcba0c0e766df76133/users/322370a429d64d11a48a08e75babc0d7/roles/382636e67fc142a2b2f486340d959e11 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 05:43:38.239951 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da02ef7c-75e9-4993-8b27-9c0e1629681e None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:43:38.240242 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da02ef7c-75e9-4993-8b27-9c0e1629681e None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:43:38.240569 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da02ef7c-75e9-4993-8b27-9c0e1629681e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:43:38.254302 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.auth.core [None req-43f0198f-56f5-4954-a7ff-1def7b27b4df None None] MFA Rules not processed for user `aebb07ff7214444a92834a3c1bd50516`. Rule list: `[]` (Enabled: `True`). {{(pid=79879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:43:38.255499 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-43f0198f-56f5-4954-a7ff-1def7b27b4df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:43:38.267046 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-da02ef7c-75e9-4993-8b27-9c0e1629681e None None] MFA Rules not processed for user `322370a429d64d11a48a08e75babc0d7`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:43:38.268247 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-da02ef7c-75e9-4993-8b27-9c0e1629681e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:43:38.317671 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1386/2731] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 10 05:43:38 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 05:43:38.329151 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f0198f-56f5-4954-a7ff-1def7b27b4df None None] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:43:38.330547 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-43f0198f-56f5-4954-a7ff-1def7b27b4df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:43:38.331544 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1346/2732] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 10 05:43:38 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 05:43:38.335880 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da02ef7c-75e9-4993-8b27-9c0e1629681e None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:43:38.386474 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f0198f-56f5-4954-a7ff-1def7b27b4df None None] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:43:38.390617 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c71e406-1610-4597-bd45-47014326bbaa service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5b56aedcfd74914938b0b9cdd102f48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f23435f783540199d6dcfd0417c090e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:43:38.391297 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c71e406-1610-4597-bd45-47014326bbaa service glance] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:43:38.391636 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c71e406-1610-4597-bd45-47014326bbaa service glance] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:43:38.391909 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c71e406-1610-4597-bd45-47014326bbaa service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:43:38.395836 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da02ef7c-75e9-4993-8b27-9c0e1629681e None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:43:38.400334 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75022c8-d19a-409b-b1f0-f1093474d388 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:43:38.400486 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c71e406-1610-4597-bd45-47014326bbaa service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:43:38.400990 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75022c8-d19a-409b-b1f0-f1093474d388 admin admin] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:43:38.401271 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75022c8-d19a-409b-b1f0-f1093474d388 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:43:38.401547 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75022c8-d19a-409b-b1f0-f1093474d388 admin admin] PATH_INFO: `/v3/projects` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:43:38.401925 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c71e406-1610-4597-bd45-47014326bbaa service glance] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:43:38.402243 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75022c8-d19a-409b-b1f0-f1093474d388 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:43:38.404233 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75022c8-d19a-409b-b1f0-f1093474d388 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:43:38.410868 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1387/2733] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 10 05:43:38 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 05:43:38.432039 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1347/2734] 10.222.0.23 () {60 vars in 1152 bytes} [Tue May 10 05:43:38 2022] POST /identity/v3/projects => generated 375 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 05:43:38.433175 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c71e406-1610-4597-bd45-47014326bbaa service glance] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:43:38.444515 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c71e406-1610-4597-bd45-47014326bbaa service glance] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:43:38.524770 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b8a5f5-ee52-4c4e-a4f6-b44922621a96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:43:38.525557 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b8a5f5-ee52-4c4e-a4f6-b44922621a96 admin admin] REQUEST_METHOD: `POST` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:43:38.525903 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b8a5f5-ee52-4c4e-a4f6-b44922621a96 admin admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:43:38.526173 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b8a5f5-ee52-4c4e-a4f6-b44922621a96 admin admin] PATH_INFO: `/v3/users` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:43:38.526866 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b8a5f5-ee52-4c4e-a4f6-b44922621a96 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:43:38.528940 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b8a5f5-ee52-4c4e-a4f6-b44922621a96 admin admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:43:38.552924 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1388/2735] 10.222.0.23 () {60 vars in 1143 bytes} [Tue May 10 05:43:38 2022] POST /identity/v3/users => generated 288 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 05:43:38.556803 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75022c8-d19a-409b-b1f0-f1093474d388 admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:43:38.568908 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75022c8-d19a-409b-b1f0-f1093474d388 admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:43:38.573742 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e48659f-8739-4059-bf5e-2073118c2814 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:43:38.574472 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e48659f-8739-4059-bf5e-2073118c2814 admin admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:43:38.574817 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e48659f-8739-4059-bf5e-2073118c2814 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:43:38.575152 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e48659f-8739-4059-bf5e-2073118c2814 admin admin] PATH_INFO: `/v3/roles` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:43:38.576105 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e48659f-8739-4059-bf5e-2073118c2814 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:43:38.577762 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e48659f-8739-4059-bf5e-2073118c2814 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:43:38.591879 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1348/2736] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 10 05:43:38 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 05:43:38.594487 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b8a5f5-ee52-4c4e-a4f6-b44922621a96 admin admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:43:38.604325 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b8a5f5-ee52-4c4e-a4f6-b44922621a96 admin admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:43:38.609245 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af05b5b-272d-4ffe-964a-fed127a949ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:43:38.609903 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af05b5b-272d-4ffe-964a-fed127a949ba admin admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:43:38.610181 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af05b5b-272d-4ffe-964a-fed127a949ba admin admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:43:38.610452 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af05b5b-272d-4ffe-964a-fed127a949ba admin admin] PATH_INFO: `/v3/roles` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:43:38.611280 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af05b5b-272d-4ffe-964a-fed127a949ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:43:38.612840 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af05b5b-272d-4ffe-964a-fed127a949ba admin admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:43:38.623075 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1389/2737] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 10 05:43:38 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 05:43:38.627554 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e48659f-8739-4059-bf5e-2073118c2814 admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:43:38.637509 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e48659f-8739-4059-bf5e-2073118c2814 admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:43:38.642213 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8115d0f6-d478-4719-b4d2-d9daffa691b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:43:38.643073 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8115d0f6-d478-4719-b4d2-d9daffa691b6 admin admin] REQUEST_METHOD: `PUT` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:43:38.643346 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8115d0f6-d478-4719-b4d2-d9daffa691b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:43:38.643645 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8115d0f6-d478-4719-b4d2-d9daffa691b6 admin admin] PATH_INFO: `/v3/projects/289b894f47694dccb3dbf382a0674b58/users/ced53d47fa8f41c3a8cb3fd16151fd3d/roles/382636e67fc142a2b2f486340d959e11` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:43:38.658156 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8115d0f6-d478-4719-b4d2-d9daffa691b6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=289b894f47694dccb3dbf382a0674b58, user_id=ced53d47fa8f41c3a8cb3fd16151fd3d, role_id=382636e67fc142a2b2f486340d959e11)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:43:38.660854 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8115d0f6-d478-4719-b4d2-d9daffa691b6 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:43:38.675941 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1349/2738] 10.222.0.23 () {60 vars in 1482 bytes} [Tue May 10 05:43:38 2022] PUT /identity/v3/projects/289b894f47694dccb3dbf382a0674b58/users/ced53d47fa8f41c3a8cb3fd16151fd3d/roles/382636e67fc142a2b2f486340d959e11 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 05:43:38.686596 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b022aec-fdef-403f-9510-2b63a3f153c4 None None] REQUEST_METHOD: `POST` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:43:38.686908 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b022aec-fdef-403f-9510-2b63a3f153c4 None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:43:38.687208 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b022aec-fdef-403f-9510-2b63a3f153c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:43:38.713320 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.auth.core [None req-8b022aec-fdef-403f-9510-2b63a3f153c4 None None] MFA Rules not processed for user `ced53d47fa8f41c3a8cb3fd16151fd3d`. Rule list: `[]` (Enabled: `True`). {{(pid=79879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:43:38.714608 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-8b022aec-fdef-403f-9510-2b63a3f153c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:43:38.777869 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1390/2739] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 10 05:43:38 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 05:43:38.782794 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8115d0f6-d478-4719-b4d2-d9daffa691b6 admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:43:38.852839 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8115d0f6-d478-4719-b4d2-d9daffa691b6 admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:43:38.857958 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c77f8e-5099-446d-bdda-a0339b8bd135 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:43:38.858727 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c77f8e-5099-446d-bdda-a0339b8bd135 admin admin] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:43:38.859243 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c77f8e-5099-446d-bdda-a0339b8bd135 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:43:38.859630 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c77f8e-5099-446d-bdda-a0339b8bd135 admin admin] PATH_INFO: `/v3/projects` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:43:38.860712 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c77f8e-5099-446d-bdda-a0339b8bd135 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:43:38.863009 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c77f8e-5099-446d-bdda-a0339b8bd135 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:43:38.895016 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1350/2740] 10.222.0.23 () {60 vars in 1152 bytes} [Tue May 10 05:43:38 2022] POST /identity/v3/projects => generated 375 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 05:43:38.899326 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b022aec-fdef-403f-9510-2b63a3f153c4 None None] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:43:38.914679 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b022aec-fdef-403f-9510-2b63a3f153c4 None None] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:43:38.974417 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360e26b8-6a0e-4cbf-a908-3fec9eae13e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:43:38.975101 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360e26b8-6a0e-4cbf-a908-3fec9eae13e2 admin admin] REQUEST_METHOD: `POST` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:43:38.975357 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360e26b8-6a0e-4cbf-a908-3fec9eae13e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:43:38.975660 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360e26b8-6a0e-4cbf-a908-3fec9eae13e2 admin admin] PATH_INFO: `/v3/users` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:43:38.976361 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360e26b8-6a0e-4cbf-a908-3fec9eae13e2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:43:38.978314 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360e26b8-6a0e-4cbf-a908-3fec9eae13e2 admin admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:43:38.999493 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1391/2741] 10.222.0.23 () {60 vars in 1143 bytes} [Tue May 10 05:43:38 2022] POST /identity/v3/users => generated 294 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 05:43:39.004272 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c77f8e-5099-446d-bdda-a0339b8bd135 admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:43:39.015333 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c77f8e-5099-446d-bdda-a0339b8bd135 admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:43:39.020973 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31485961-d626-429d-87c6-80983169bb9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:43:39.021713 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31485961-d626-429d-87c6-80983169bb9d admin admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:43:39.022058 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31485961-d626-429d-87c6-80983169bb9d admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:43:39.022390 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31485961-d626-429d-87c6-80983169bb9d admin admin] PATH_INFO: `/v3/roles` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:43:39.023220 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31485961-d626-429d-87c6-80983169bb9d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:43:39.024912 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31485961-d626-429d-87c6-80983169bb9d admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:43:39.036360 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1351/2742] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 10 05:43:39 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 05:43:39.041029 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360e26b8-6a0e-4cbf-a908-3fec9eae13e2 admin admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:43:39.051053 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360e26b8-6a0e-4cbf-a908-3fec9eae13e2 admin admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:43:39.056025 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0989826-e2ab-4614-9046-1f3a1cf57b5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:43:39.056908 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0989826-e2ab-4614-9046-1f3a1cf57b5b admin admin] REQUEST_METHOD: `PUT` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:43:39.057192 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0989826-e2ab-4614-9046-1f3a1cf57b5b admin admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:43:39.057483 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0989826-e2ab-4614-9046-1f3a1cf57b5b admin admin] PATH_INFO: `/v3/projects/8a4ae96ebb784efc98b4be3e306d1f0f/users/743e3fbe33ee4205a5bcc76903ced470/roles/199ac1dd842441d7913c6ee89d8fbecc` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:43:39.073161 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0989826-e2ab-4614-9046-1f3a1cf57b5b admin admin] RBAC: Authorizing `identity:create_grant(project_id=8a4ae96ebb784efc98b4be3e306d1f0f, user_id=743e3fbe33ee4205a5bcc76903ced470, role_id=199ac1dd842441d7913c6ee89d8fbecc)` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:43:39.076049 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0989826-e2ab-4614-9046-1f3a1cf57b5b admin admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:43:39.089392 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1392/2743] 10.222.0.23 () {60 vars in 1482 bytes} [Tue May 10 05:43:39 2022] PUT /identity/v3/projects/8a4ae96ebb784efc98b4be3e306d1f0f/users/743e3fbe33ee4205a5bcc76903ced470/roles/199ac1dd842441d7913c6ee89d8fbecc => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 05:43:39.093346 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31485961-d626-429d-87c6-80983169bb9d admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:43:39.103442 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31485961-d626-429d-87c6-80983169bb9d admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:43:39.160909 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e8dbbd-89f1-4b18-b6bf-0ff68729880f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:43:39.161658 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e8dbbd-89f1-4b18-b6bf-0ff68729880f admin admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:43:39.162013 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e8dbbd-89f1-4b18-b6bf-0ff68729880f admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:43:39.162335 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e8dbbd-89f1-4b18-b6bf-0ff68729880f admin admin] PATH_INFO: `/v3/roles` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:43:39.163258 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e8dbbd-89f1-4b18-b6bf-0ff68729880f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:43:39.164936 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e8dbbd-89f1-4b18-b6bf-0ff68729880f admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:43:39.176093 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1352/2744] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 10 05:43:39 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 05:43:39.183057 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0989826-e2ab-4614-9046-1f3a1cf57b5b admin admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:43:39.194243 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0989826-e2ab-4614-9046-1f3a1cf57b5b admin admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:43:39.200151 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a5349c-fe9a-42cd-9ac8-36dfaab6c1ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:43:39.201113 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a5349c-fe9a-42cd-9ac8-36dfaab6c1ab admin admin] REQUEST_METHOD: `PUT` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:43:39.201387 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a5349c-fe9a-42cd-9ac8-36dfaab6c1ab admin admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:43:39.201668 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a5349c-fe9a-42cd-9ac8-36dfaab6c1ab admin admin] PATH_INFO: `/v3/projects/8a4ae96ebb784efc98b4be3e306d1f0f/users/743e3fbe33ee4205a5bcc76903ced470/roles/199ac1dd842441d7913c6ee89d8fbecc` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:43:39.203686 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a5349c-fe9a-42cd-9ac8-36dfaab6c1ab admin admin] RBAC: Authorizing `identity:create_grant(project_id=8a4ae96ebb784efc98b4be3e306d1f0f, user_id=743e3fbe33ee4205a5bcc76903ced470, role_id=199ac1dd842441d7913c6ee89d8fbecc)` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:43:39.206364 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a5349c-fe9a-42cd-9ac8-36dfaab6c1ab admin admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:43:39.219466 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1393/2745] 10.222.0.23 () {60 vars in 1482 bytes} [Tue May 10 05:43:39 2022] PUT /identity/v3/projects/8a4ae96ebb784efc98b4be3e306d1f0f/users/743e3fbe33ee4205a5bcc76903ced470/roles/199ac1dd842441d7913c6ee89d8fbecc => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 05:43:39.230171 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f454dc20-08c1-415d-8a0d-0d85e77573dc None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:43:39.230449 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f454dc20-08c1-415d-8a0d-0d85e77573dc None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:43:39.230735 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f454dc20-08c1-415d-8a0d-0d85e77573dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:43:39.259499 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-f454dc20-08c1-415d-8a0d-0d85e77573dc None None] MFA Rules not processed for user `743e3fbe33ee4205a5bcc76903ced470`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:43:39.260749 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-f454dc20-08c1-415d-8a0d-0d85e77573dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:43:39.334874 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1353/2746] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 10 05:43:39 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 05:43:39.346226 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a5349c-fe9a-42cd-9ac8-36dfaab6c1ab admin admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:43:39.348234 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-60a5349c-fe9a-42cd-9ac8-36dfaab6c1ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:43:39.410475 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a5349c-fe9a-42cd-9ac8-36dfaab6c1ab admin admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:43:39.414253 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa12498-12ef-4608-9200-2202ef26d80a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355be413675540a39ccb00e1a0722316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f23435f783540199d6dcfd0417c090e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:43:39.414903 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa12498-12ef-4608-9200-2202ef26d80a service cinder] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:43:39.415185 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa12498-12ef-4608-9200-2202ef26d80a service cinder] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:43:39.415463 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa12498-12ef-4608-9200-2202ef26d80a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:43:39.477136 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa12498-12ef-4608-9200-2202ef26d80a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:43:39.478599 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa12498-12ef-4608-9200-2202ef26d80a service cinder] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:43:39.487912 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1394/2747] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 10 05:43:39 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 05:43:40.987612 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f454dc20-08c1-415d-8a0d-0d85e77573dc None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:43:40.996981 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f454dc20-08c1-415d-8a0d-0d85e77573dc None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:43:41.000544 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d110a318-e595-4ea3-84ab-a8e2dda9f519 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355be413675540a39ccb00e1a0722316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f23435f783540199d6dcfd0417c090e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:43:41.001185 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d110a318-e595-4ea3-84ab-a8e2dda9f519 service cinder] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:43:41.001466 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d110a318-e595-4ea3-84ab-a8e2dda9f519 service cinder] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:43:41.001747 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d110a318-e595-4ea3-84ab-a8e2dda9f519 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:43:41.059517 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d110a318-e595-4ea3-84ab-a8e2dda9f519 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:43:41.061090 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d110a318-e595-4ea3-84ab-a8e2dda9f519 service cinder] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:43:41.069821 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1354/2748] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 10 05:43:40 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 05:43:41.641404 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa12498-12ef-4608-9200-2202ef26d80a service cinder] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:43:41.649848 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa12498-12ef-4608-9200-2202ef26d80a service cinder] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:43:41.654407 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a40c1b-3d00-4b84-ad68-d5d7b33f15bf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355be413675540a39ccb00e1a0722316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f23435f783540199d6dcfd0417c090e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:43:41.655042 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a40c1b-3d00-4b84-ad68-d5d7b33f15bf service cinder] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:43:41.655318 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a40c1b-3d00-4b84-ad68-d5d7b33f15bf service cinder] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:43:41.655616 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a40c1b-3d00-4b84-ad68-d5d7b33f15bf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:43:41.664925 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a40c1b-3d00-4b84-ad68-d5d7b33f15bf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:43:41.666330 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a40c1b-3d00-4b84-ad68-d5d7b33f15bf service cinder] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:43:41.679666 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1395/2749] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 10 05:43:41 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 05:43:42.143870 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d110a318-e595-4ea3-84ab-a8e2dda9f519 service cinder] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:43:42.145234 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-d110a318-e595-4ea3-84ab-a8e2dda9f519 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:43:42.215969 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d110a318-e595-4ea3-84ab-a8e2dda9f519 service cinder] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:43:42.221759 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27e7345-319d-4f2c-aa4a-477e6382b31d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67321ca3e5624273acd5b06264738000', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f23435f783540199d6dcfd0417c090e', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:43:42.222417 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27e7345-319d-4f2c-aa4a-477e6382b31d service placement] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:43:42.222707 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27e7345-319d-4f2c-aa4a-477e6382b31d service placement] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:43:42.222983 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27e7345-319d-4f2c-aa4a-477e6382b31d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:43:42.224871 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-f27e7345-319d-4f2c-aa4a-477e6382b31d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:43:42.237627 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27e7345-319d-4f2c-aa4a-477e6382b31d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:43:42.239259 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27e7345-319d-4f2c-aa4a-477e6382b31d service placement] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:43:42.250016 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1355/2750] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 10 05:43:42 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 05:43:51.915018 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a40c1b-3d00-4b84-ad68-d5d7b33f15bf service cinder] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:43:51.977064 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a40c1b-3d00-4b84-ad68-d5d7b33f15bf service cinder] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:43:51.982093 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f16655-d8ba-49d7-837b-6fb992af2d1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:43:51.982989 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f16655-d8ba-49d7-837b-6fb992af2d1d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:43:51.983285 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f16655-d8ba-49d7-837b-6fb992af2d1d admin admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:43:51.983562 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f16655-d8ba-49d7-837b-6fb992af2d1d admin admin] PATH_INFO: `/v3/users/322370a429d64d11a48a08e75babc0d7` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:43:51.984883 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f16655-d8ba-49d7-837b-6fb992af2d1d admin admin] RBAC: Authorizing `identity:delete_user(user_id=322370a429d64d11a48a08e75babc0d7)` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:43:51.986805 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f16655-d8ba-49d7-837b-6fb992af2d1d admin admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:43:52.033641 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-f7f16655-d8ba-49d7-837b-6fb992af2d1d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '322370a429d64d11a48a08e75babc0d7'} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:43:52.040475 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-f7f16655-d8ba-49d7-837b-6fb992af2d1d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '322370a429d64d11a48a08e75babc0d7'} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:43:52.041096 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-f7f16655-d8ba-49d7-837b-6fb992af2d1d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '322370a429d64d11a48a08e75babc0d7'} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:43:52.053366 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-f7f16655-d8ba-49d7-837b-6fb992af2d1d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '322370a429d64d11a48a08e75babc0d7'} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:43:52.064933 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-f7f16655-d8ba-49d7-837b-6fb992af2d1d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '322370a429d64d11a48a08e75babc0d7'} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:43:52.071725 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1396/2751] 10.222.0.23 () {58 vars in 1223 bytes} [Tue May 10 05:43:51 2022] DELETE /identity/v3/users/322370a429d64d11a48a08e75babc0d7 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 05:43:52.076929 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43f0506-c0a3-47fa-b6f1-796a9f4aa9fd None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:43:52.077463 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43f0506-c0a3-47fa-b6f1-796a9f4aa9fd None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:43:52.077948 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43f0506-c0a3-47fa-b6f1-796a9f4aa9fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:43:52.097601 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-a43f0506-c0a3-47fa-b6f1-796a9f4aa9fd None None] MFA Rules not processed for user `44883b22532e44049d846938dc2cf423`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:43:52.098803 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-a43f0506-c0a3-47fa-b6f1-796a9f4aa9fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:43:52.114323 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79767790-4c6c-429e-bc6c-1afe84a3ec82 None None] REQUEST_METHOD: `POST` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:43:52.114613 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79767790-4c6c-429e-bc6c-1afe84a3ec82 None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:43:52.114889 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79767790-4c6c-429e-bc6c-1afe84a3ec82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:43:52.134805 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.auth.core [None req-79767790-4c6c-429e-bc6c-1afe84a3ec82 None None] MFA Rules not processed for user `c5281b2a1c9a461995653be826207db4`. Rule list: `[]` (Enabled: `True`). {{(pid=79879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:43:52.136072 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-79767790-4c6c-429e-bc6c-1afe84a3ec82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:43:52.158877 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1356/2752] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 10 05:43:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 05:43:52.168482 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43f0506-c0a3-47fa-b6f1-796a9f4aa9fd None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:43:52.169840 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-a43f0506-c0a3-47fa-b6f1-796a9f4aa9fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:43:52.192102 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1397/2753] 10.222.0.23 () {58 vars in 1009 bytes} [Tue May 10 05:43:52 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 05:43:52.227941 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43f0506-c0a3-47fa-b6f1-796a9f4aa9fd None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:43:52.231943 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4df6303-d624-4b73-af2b-f5566519a992 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c8461cfdd9648b8abcaf8d34b7a102a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f23435f783540199d6dcfd0417c090e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:43:52.232599 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4df6303-d624-4b73-af2b-f5566519a992 service neutron] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:43:52.232882 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4df6303-d624-4b73-af2b-f5566519a992 service neutron] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:43:52.233635 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4df6303-d624-4b73-af2b-f5566519a992 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:43:52.241927 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79767790-4c6c-429e-bc6c-1afe84a3ec82 None None] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:43:52.242624 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4df6303-d624-4b73-af2b-f5566519a992 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:43:52.243277 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-79767790-4c6c-429e-bc6c-1afe84a3ec82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:43:52.244152 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4df6303-d624-4b73-af2b-f5566519a992 service neutron] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:43:52.254237 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1357/2754] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 10 05:43:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 05:43:52.315103 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79767790-4c6c-429e-bc6c-1afe84a3ec82 None None] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:43:52.320614 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80756692-7111-4f4c-9a14-e0b9515ae48e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd31dacf30804395bd029037b407c12a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f23435f783540199d6dcfd0417c090e', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:43:52.321290 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80756692-7111-4f4c-9a14-e0b9515ae48e service swift] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:43:52.321699 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80756692-7111-4f4c-9a14-e0b9515ae48e service swift] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:43:52.321973 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80756692-7111-4f4c-9a14-e0b9515ae48e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:43:52.330848 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80756692-7111-4f4c-9a14-e0b9515ae48e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:43:52.332546 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80756692-7111-4f4c-9a14-e0b9515ae48e service swift] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:43:52.340929 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1398/2755] 10.222.0.23 () {60 vars in 1384 bytes} [Tue May 10 05:43:52 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 10 05:43:52.525905 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4df6303-d624-4b73-af2b-f5566519a992 service neutron] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:43:52.527486 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-a4df6303-d624-4b73-af2b-f5566519a992 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:43:52.540568 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4df6303-d624-4b73-af2b-f5566519a992 service neutron] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:43:52.550595 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd98724-2d1f-4cf1-af5b-2e3a366bfc26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:43:52.551486 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd98724-2d1f-4cf1-af5b-2e3a366bfc26 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:43:52.551800 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd98724-2d1f-4cf1-af5b-2e3a366bfc26 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:43:52.552073 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd98724-2d1f-4cf1-af5b-2e3a366bfc26 admin admin] PATH_INFO: `/v3/projects/5702bd0fa01945dcba0c0e766df76133` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:43:52.553326 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd98724-2d1f-4cf1-af5b-2e3a366bfc26 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5702bd0fa01945dcba0c0e766df76133)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:43:52.555226 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd98724-2d1f-4cf1-af5b-2e3a366bfc26 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:43:52.604954 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-3cd98724-2d1f-4cf1-af5b-2e3a366bfc26 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5702bd0fa01945dcba0c0e766df76133', 'request_id': 'req-3cd98724-2d1f-4cf1-af5b-2e3a366bfc26'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:43:52.611163 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-3cd98724-2d1f-4cf1-af5b-2e3a366bfc26 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5702bd0fa01945dcba0c0e766df76133', 'request_id': 'req-3cd98724-2d1f-4cf1-af5b-2e3a366bfc26'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:43:52.619797 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-3cd98724-2d1f-4cf1-af5b-2e3a366bfc26 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5702bd0fa01945dcba0c0e766df76133', 'request_id': 'req-3cd98724-2d1f-4cf1-af5b-2e3a366bfc26'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:43:52.630176 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-3cd98724-2d1f-4cf1-af5b-2e3a366bfc26 admin admin] The token cache is being invalidate because project 5702bd0fa01945dcba0c0e766df76133 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79880) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 05:43:52.630462 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-3cd98724-2d1f-4cf1-af5b-2e3a366bfc26 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:43:52.631065 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-3cd98724-2d1f-4cf1-af5b-2e3a366bfc26 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:43:52.632661 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1358/2756] 10.222.0.23 () {58 vars in 1232 bytes} [Tue May 10 05:43:52 2022] DELETE /identity/v3/projects/5702bd0fa01945dcba0c0e766df76133 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 05:43:52.636729 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80756692-7111-4f4c-9a14-e0b9515ae48e service swift] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:43:52.647622 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80756692-7111-4f4c-9a14-e0b9515ae48e service swift] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:43:52.712680 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747bcda1-ccf1-4fb6-b077-c0bbfa7f34be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:43:52.713861 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747bcda1-ccf1-4fb6-b077-c0bbfa7f34be admin admin] REQUEST_METHOD: `DELETE` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:43:52.714345 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747bcda1-ccf1-4fb6-b077-c0bbfa7f34be admin admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:43:52.714744 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747bcda1-ccf1-4fb6-b077-c0bbfa7f34be admin admin] PATH_INFO: `/v3/users/ced53d47fa8f41c3a8cb3fd16151fd3d` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:43:52.716065 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747bcda1-ccf1-4fb6-b077-c0bbfa7f34be admin admin] RBAC: Authorizing `identity:delete_user(user_id=ced53d47fa8f41c3a8cb3fd16151fd3d)` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:43:52.718010 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747bcda1-ccf1-4fb6-b077-c0bbfa7f34be admin admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:43:52.778441 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-747bcda1-ccf1-4fb6-b077-c0bbfa7f34be admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ced53d47fa8f41c3a8cb3fd16151fd3d'} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:43:52.788330 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-747bcda1-ccf1-4fb6-b077-c0bbfa7f34be admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ced53d47fa8f41c3a8cb3fd16151fd3d'} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:43:52.789099 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-747bcda1-ccf1-4fb6-b077-c0bbfa7f34be admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ced53d47fa8f41c3a8cb3fd16151fd3d'} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:43:52.802837 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-747bcda1-ccf1-4fb6-b077-c0bbfa7f34be admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ced53d47fa8f41c3a8cb3fd16151fd3d'} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:43:52.811714 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-747bcda1-ccf1-4fb6-b077-c0bbfa7f34be admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ced53d47fa8f41c3a8cb3fd16151fd3d'} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:43:52.818150 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1399/2757] 10.222.0.23 () {58 vars in 1223 bytes} [Tue May 10 05:43:52 2022] DELETE /identity/v3/users/ced53d47fa8f41c3a8cb3fd16151fd3d => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 05:43:53.102806 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd98724-2d1f-4cf1-af5b-2e3a366bfc26 admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:43:53.104370 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-3cd98724-2d1f-4cf1-af5b-2e3a366bfc26 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:43:53.118675 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd98724-2d1f-4cf1-af5b-2e3a366bfc26 admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:43:53.177128 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e8df84-392e-48c9-a57d-a2cb9564dbba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:43:53.177994 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e8df84-392e-48c9-a57d-a2cb9564dbba admin admin] REQUEST_METHOD: `DELETE` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:43:53.178276 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e8df84-392e-48c9-a57d-a2cb9564dbba admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:43:53.178546 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e8df84-392e-48c9-a57d-a2cb9564dbba admin admin] PATH_INFO: `/v3/projects/289b894f47694dccb3dbf382a0674b58` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:43:53.179785 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e8df84-392e-48c9-a57d-a2cb9564dbba admin admin] RBAC: Authorizing `identity:delete_project(project_id=289b894f47694dccb3dbf382a0674b58)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:43:53.181747 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e8df84-392e-48c9-a57d-a2cb9564dbba admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:43:53.231826 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-85e8df84-392e-48c9-a57d-a2cb9564dbba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '289b894f47694dccb3dbf382a0674b58', 'request_id': 'req-85e8df84-392e-48c9-a57d-a2cb9564dbba'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:43:53.237631 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-85e8df84-392e-48c9-a57d-a2cb9564dbba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '289b894f47694dccb3dbf382a0674b58', 'request_id': 'req-85e8df84-392e-48c9-a57d-a2cb9564dbba'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:43:53.247545 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-85e8df84-392e-48c9-a57d-a2cb9564dbba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '289b894f47694dccb3dbf382a0674b58', 'request_id': 'req-85e8df84-392e-48c9-a57d-a2cb9564dbba'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:43:53.263478 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-85e8df84-392e-48c9-a57d-a2cb9564dbba admin admin] The token cache is being invalidate because project 289b894f47694dccb3dbf382a0674b58 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79880) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 05:43:53.263796 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-85e8df84-392e-48c9-a57d-a2cb9564dbba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:43:53.264465 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-85e8df84-392e-48c9-a57d-a2cb9564dbba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:43:53.266054 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1359/2758] 10.222.0.23 () {58 vars in 1232 bytes} [Tue May 10 05:43:53 2022] DELETE /identity/v3/projects/289b894f47694dccb3dbf382a0674b58 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 05:43:53.270342 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747bcda1-ccf1-4fb6-b077-c0bbfa7f34be admin admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:43:53.272574 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-747bcda1-ccf1-4fb6-b077-c0bbfa7f34be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:43:53.292384 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747bcda1-ccf1-4fb6-b077-c0bbfa7f34be admin admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:43:53.348967 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc86ad16-8762-4daa-b37b-78d706fc2bdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:43:53.349848 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc86ad16-8762-4daa-b37b-78d706fc2bdd admin admin] REQUEST_METHOD: `DELETE` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:43:53.350132 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc86ad16-8762-4daa-b37b-78d706fc2bdd admin admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:43:53.350402 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc86ad16-8762-4daa-b37b-78d706fc2bdd admin admin] PATH_INFO: `/v3/users/743e3fbe33ee4205a5bcc76903ced470` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:43:53.351722 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc86ad16-8762-4daa-b37b-78d706fc2bdd admin admin] RBAC: Authorizing `identity:delete_user(user_id=743e3fbe33ee4205a5bcc76903ced470)` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:43:53.353669 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc86ad16-8762-4daa-b37b-78d706fc2bdd admin admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:43:53.404297 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-dc86ad16-8762-4daa-b37b-78d706fc2bdd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '743e3fbe33ee4205a5bcc76903ced470'} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:43:53.412380 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-dc86ad16-8762-4daa-b37b-78d706fc2bdd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '743e3fbe33ee4205a5bcc76903ced470'} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:43:53.413022 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-dc86ad16-8762-4daa-b37b-78d706fc2bdd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '743e3fbe33ee4205a5bcc76903ced470'} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:43:53.426440 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-dc86ad16-8762-4daa-b37b-78d706fc2bdd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '743e3fbe33ee4205a5bcc76903ced470'} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:43:53.436138 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-dc86ad16-8762-4daa-b37b-78d706fc2bdd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '743e3fbe33ee4205a5bcc76903ced470'} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:43:53.444432 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1400/2759] 10.222.0.23 () {58 vars in 1223 bytes} [Tue May 10 05:43:53 2022] DELETE /identity/v3/users/743e3fbe33ee4205a5bcc76903ced470 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 05:43:53.724855 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e8df84-392e-48c9-a57d-a2cb9564dbba admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:43:53.726303 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-85e8df84-392e-48c9-a57d-a2cb9564dbba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:43:53.739956 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e8df84-392e-48c9-a57d-a2cb9564dbba admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:43:53.797865 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25deab45-73de-44a2-81cf-f05ff02935c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:43:53.798674 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25deab45-73de-44a2-81cf-f05ff02935c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:43:53.798958 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25deab45-73de-44a2-81cf-f05ff02935c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:43:53.799232 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25deab45-73de-44a2-81cf-f05ff02935c9 admin admin] PATH_INFO: `/v3/projects/8a4ae96ebb784efc98b4be3e306d1f0f` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:43:53.800566 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25deab45-73de-44a2-81cf-f05ff02935c9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8a4ae96ebb784efc98b4be3e306d1f0f)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:43:53.802532 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25deab45-73de-44a2-81cf-f05ff02935c9 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:43:53.851891 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-25deab45-73de-44a2-81cf-f05ff02935c9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8a4ae96ebb784efc98b4be3e306d1f0f', 'request_id': 'req-25deab45-73de-44a2-81cf-f05ff02935c9'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:43:53.858149 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-25deab45-73de-44a2-81cf-f05ff02935c9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8a4ae96ebb784efc98b4be3e306d1f0f', 'request_id': 'req-25deab45-73de-44a2-81cf-f05ff02935c9'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:43:53.867767 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-25deab45-73de-44a2-81cf-f05ff02935c9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8a4ae96ebb784efc98b4be3e306d1f0f', 'request_id': 'req-25deab45-73de-44a2-81cf-f05ff02935c9'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:43:53.878462 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-25deab45-73de-44a2-81cf-f05ff02935c9 admin admin] The token cache is being invalidate because project 8a4ae96ebb784efc98b4be3e306d1f0f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79880) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 05:43:53.878756 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-25deab45-73de-44a2-81cf-f05ff02935c9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:43:53.879359 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-25deab45-73de-44a2-81cf-f05ff02935c9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:43:53.880941 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1360/2760] 10.222.0.23 () {58 vars in 1232 bytes} [Tue May 10 05:43:53 2022] DELETE /identity/v3/projects/8a4ae96ebb784efc98b4be3e306d1f0f => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 05:43:53.885980 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29aec06e-b566-499d-b654-a50e45f1c04f None None] REQUEST_METHOD: `POST` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:43:53.886265 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29aec06e-b566-499d-b654-a50e45f1c04f None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:43:53.886569 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29aec06e-b566-499d-b654-a50e45f1c04f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:43:53.910059 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.auth.core [None req-29aec06e-b566-499d-b654-a50e45f1c04f None None] MFA Rules not processed for user `44883b22532e44049d846938dc2cf423`. Rule list: `[]` (Enabled: `True`). {{(pid=79879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:43:53.911867 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-29aec06e-b566-499d-b654-a50e45f1c04f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:43:53.972249 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1401/2761] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 10 05:43:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 05:43:53.980270 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31828b6c-2c69-4a0f-ab98-8db78438ada7 None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:43:53.980562 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31828b6c-2c69-4a0f-ab98-8db78438ada7 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:43:53.980842 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31828b6c-2c69-4a0f-ab98-8db78438ada7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:43:53.999435 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-31828b6c-2c69-4a0f-ab98-8db78438ada7 None None] MFA Rules not processed for user `44883b22532e44049d846938dc2cf423`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:43:54.000706 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-31828b6c-2c69-4a0f-ab98-8db78438ada7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:43:54.008982 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1361/2762] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 10 05:43:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 05:43:54.013153 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29aec06e-b566-499d-b654-a50e45f1c04f None None] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:43:54.022552 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29aec06e-b566-499d-b654-a50e45f1c04f None None] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:43:54.027831 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc617541-5015-4497-934c-e90bb6bca650 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:43:54.028479 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc617541-5015-4497-934c-e90bb6bca650 admin admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:43:54.028780 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc617541-5015-4497-934c-e90bb6bca650 admin admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:43:54.029054 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc617541-5015-4497-934c-e90bb6bca650 admin admin] PATH_INFO: `/v3/domains` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:43:54.029777 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc617541-5015-4497-934c-e90bb6bca650 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:43:54.030080 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc617541-5015-4497-934c-e90bb6bca650 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:43:54.031711 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc617541-5015-4497-934c-e90bb6bca650 admin admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:43:54.043050 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1402/2763] 10.222.0.23 () {58 vars in 1152 bytes} [Tue May 10 05:43:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:43:54.047469 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31828b6c-2c69-4a0f-ab98-8db78438ada7 None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:43:54.056988 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31828b6c-2c69-4a0f-ab98-8db78438ada7 None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:43:54.062534 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d31f75-dcc9-4911-ba90-a7b904bc77ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:43:54.063178 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d31f75-dcc9-4911-ba90-a7b904bc77ee admin admin] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:43:54.063460 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d31f75-dcc9-4911-ba90-a7b904bc77ee admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:43:54.063760 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d31f75-dcc9-4911-ba90-a7b904bc77ee admin admin] PATH_INFO: `/v3/projects` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:43:54.064454 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d31f75-dcc9-4911-ba90-a7b904bc77ee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:43:54.066343 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d31f75-dcc9-4911-ba90-a7b904bc77ee admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:43:54.097905 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1362/2764] 10.222.0.23 () {60 vars in 1152 bytes} [Tue May 10 05:43:54 2022] POST /identity/v3/projects => generated 385 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 05:43:54.102422 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc617541-5015-4497-934c-e90bb6bca650 admin admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:43:54.113846 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc617541-5015-4497-934c-e90bb6bca650 admin admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:43:54.181299 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff75b773-298d-4fdc-aed6-e42a951c8c6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:43:54.181975 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff75b773-298d-4fdc-aed6-e42a951c8c6a admin admin] REQUEST_METHOD: `POST` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:43:54.182284 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff75b773-298d-4fdc-aed6-e42a951c8c6a admin admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:43:54.182558 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff75b773-298d-4fdc-aed6-e42a951c8c6a admin admin] PATH_INFO: `/v3/users` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:43:54.183268 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff75b773-298d-4fdc-aed6-e42a951c8c6a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:43:54.185218 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff75b773-298d-4fdc-aed6-e42a951c8c6a admin admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:43:54.206740 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1403/2765] 10.222.0.23 () {60 vars in 1143 bytes} [Tue May 10 05:43:54 2022] POST /identity/v3/users => generated 293 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 05:43:54.210996 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d31f75-dcc9-4911-ba90-a7b904bc77ee admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:43:54.221449 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d31f75-dcc9-4911-ba90-a7b904bc77ee admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:43:54.227458 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f3f464-218d-4ac4-a4e7-876f81484c9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:43:54.228176 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f3f464-218d-4ac4-a4e7-876f81484c9c admin admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:43:54.228453 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f3f464-218d-4ac4-a4e7-876f81484c9c admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:43:54.228705 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f3f464-218d-4ac4-a4e7-876f81484c9c admin admin] PATH_INFO: `/v3/roles` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:43:54.229441 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f3f464-218d-4ac4-a4e7-876f81484c9c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:43:54.231030 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f3f464-218d-4ac4-a4e7-876f81484c9c admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:43:54.241607 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1363/2766] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 10 05:43:54 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 05:43:54.245447 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff75b773-298d-4fdc-aed6-e42a951c8c6a admin admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:43:54.256307 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff75b773-298d-4fdc-aed6-e42a951c8c6a admin admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:43:54.262313 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e6ccf5-342a-4f4d-a416-cac4b19a14ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:43:54.263031 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e6ccf5-342a-4f4d-a416-cac4b19a14ae admin admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:43:54.263313 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e6ccf5-342a-4f4d-a416-cac4b19a14ae admin admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:43:54.263622 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e6ccf5-342a-4f4d-a416-cac4b19a14ae admin admin] PATH_INFO: `/v3/roles` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:43:54.264344 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e6ccf5-342a-4f4d-a416-cac4b19a14ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:43:54.265933 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e6ccf5-342a-4f4d-a416-cac4b19a14ae admin admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:43:54.276056 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1404/2767] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 10 05:43:54 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 05:43:54.280054 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f3f464-218d-4ac4-a4e7-876f81484c9c admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:43:54.289833 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f3f464-218d-4ac4-a4e7-876f81484c9c admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:43:54.295266 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca62cbf2-6b69-40be-9722-0d096336859c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:43:54.296225 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca62cbf2-6b69-40be-9722-0d096336859c admin admin] REQUEST_METHOD: `PUT` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:43:54.296481 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca62cbf2-6b69-40be-9722-0d096336859c admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:43:54.296752 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca62cbf2-6b69-40be-9722-0d096336859c admin admin] PATH_INFO: `/v3/projects/630b213b3c38461cbd841d159d1be6a2/users/1c20534e3dd94990b1342205050ca991/roles/382636e67fc142a2b2f486340d959e11` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:43:54.311852 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca62cbf2-6b69-40be-9722-0d096336859c admin admin] RBAC: Authorizing `identity:create_grant(project_id=630b213b3c38461cbd841d159d1be6a2, user_id=1c20534e3dd94990b1342205050ca991, role_id=382636e67fc142a2b2f486340d959e11)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:43:54.314456 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca62cbf2-6b69-40be-9722-0d096336859c admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:43:54.328332 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1364/2768] 10.222.0.23 () {60 vars in 1482 bytes} [Tue May 10 05:43:54 2022] PUT /identity/v3/projects/630b213b3c38461cbd841d159d1be6a2/users/1c20534e3dd94990b1342205050ca991/roles/382636e67fc142a2b2f486340d959e11 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 05:43:54.338743 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4fdfab-b92e-499b-9dd9-4f5dd1cf59ba None None] REQUEST_METHOD: `POST` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:43:54.339033 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4fdfab-b92e-499b-9dd9-4f5dd1cf59ba None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:43:54.339312 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4fdfab-b92e-499b-9dd9-4f5dd1cf59ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:43:54.364909 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.auth.core [None req-8f4fdfab-b92e-499b-9dd9-4f5dd1cf59ba None None] MFA Rules not processed for user `1c20534e3dd94990b1342205050ca991`. Rule list: `[]` (Enabled: `True`). {{(pid=79879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:43:54.366129 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-8f4fdfab-b92e-499b-9dd9-4f5dd1cf59ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:43:54.431124 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1405/2769] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 10 05:43:54 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 05:43:54.436009 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca62cbf2-6b69-40be-9722-0d096336859c admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:43:54.501687 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca62cbf2-6b69-40be-9722-0d096336859c admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:43:54.509476 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb094f1c-9047-4619-adb7-0061d4cfd833 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:43:54.510321 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb094f1c-9047-4619-adb7-0061d4cfd833 admin admin] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:43:54.510705 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb094f1c-9047-4619-adb7-0061d4cfd833 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:43:54.511172 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb094f1c-9047-4619-adb7-0061d4cfd833 admin admin] PATH_INFO: `/v3/projects` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:43:54.512245 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb094f1c-9047-4619-adb7-0061d4cfd833 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:43:54.515120 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb094f1c-9047-4619-adb7-0061d4cfd833 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:43:54.545795 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1365/2770] 10.222.0.23 () {60 vars in 1152 bytes} [Tue May 10 05:43:54 2022] POST /identity/v3/projects => generated 383 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 05:43:54.547746 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4fdfab-b92e-499b-9dd9-4f5dd1cf59ba None None] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:43:54.563218 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4fdfab-b92e-499b-9dd9-4f5dd1cf59ba None None] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:43:54.626056 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de2ef4f-b520-43e2-a982-95d37afccfb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:43:54.626726 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de2ef4f-b520-43e2-a982-95d37afccfb9 admin admin] REQUEST_METHOD: `POST` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:43:54.627002 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de2ef4f-b520-43e2-a982-95d37afccfb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:43:54.627271 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de2ef4f-b520-43e2-a982-95d37afccfb9 admin admin] PATH_INFO: `/v3/users` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:43:54.628594 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de2ef4f-b520-43e2-a982-95d37afccfb9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:43:54.630513 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de2ef4f-b520-43e2-a982-95d37afccfb9 admin admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:43:54.653250 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1406/2771] 10.222.0.23 () {60 vars in 1143 bytes} [Tue May 10 05:43:54 2022] POST /identity/v3/users => generated 292 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 05:43:54.654957 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb094f1c-9047-4619-adb7-0061d4cfd833 admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:43:54.665094 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb094f1c-9047-4619-adb7-0061d4cfd833 admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:43:54.670234 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cc20b6-cb13-4d95-8c6c-5f24ab976dee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:43:54.671071 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cc20b6-cb13-4d95-8c6c-5f24ab976dee admin admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:43:54.671390 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cc20b6-cb13-4d95-8c6c-5f24ab976dee admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:43:54.671762 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cc20b6-cb13-4d95-8c6c-5f24ab976dee admin admin] PATH_INFO: `/v3/roles` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:43:54.672560 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76cc20b6-cb13-4d95-8c6c-5f24ab976dee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:43:54.674155 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76cc20b6-cb13-4d95-8c6c-5f24ab976dee admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:43:54.685132 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1366/2772] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 10 05:43:54 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 05:43:54.689294 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de2ef4f-b520-43e2-a982-95d37afccfb9 admin admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:43:54.699903 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de2ef4f-b520-43e2-a982-95d37afccfb9 admin admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:43:54.705237 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f746589-678b-4a72-90cb-6070a0bd38c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:43:54.705900 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f746589-678b-4a72-90cb-6070a0bd38c7 admin admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:43:54.706180 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f746589-678b-4a72-90cb-6070a0bd38c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:43:54.706458 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f746589-678b-4a72-90cb-6070a0bd38c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:43:54.707191 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f746589-678b-4a72-90cb-6070a0bd38c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:43:54.708832 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f746589-678b-4a72-90cb-6070a0bd38c7 admin admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:43:54.718833 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1407/2773] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 10 05:43:54 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 05:43:54.723414 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cc20b6-cb13-4d95-8c6c-5f24ab976dee admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:43:54.735698 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cc20b6-cb13-4d95-8c6c-5f24ab976dee admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:43:54.741318 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8886766d-d1c5-4278-9f48-b59ab5ce8220 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:43:54.742210 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8886766d-d1c5-4278-9f48-b59ab5ce8220 admin admin] REQUEST_METHOD: `PUT` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:43:54.742495 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8886766d-d1c5-4278-9f48-b59ab5ce8220 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:43:54.742771 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8886766d-d1c5-4278-9f48-b59ab5ce8220 admin admin] PATH_INFO: `/v3/projects/d1f04e94e8ec47e79a3076aca65d7945/users/579d06b75bc14b8483448c63ec4600ee/roles/382636e67fc142a2b2f486340d959e11` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:43:54.758936 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8886766d-d1c5-4278-9f48-b59ab5ce8220 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d1f04e94e8ec47e79a3076aca65d7945, user_id=579d06b75bc14b8483448c63ec4600ee, role_id=382636e67fc142a2b2f486340d959e11)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:43:54.761662 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8886766d-d1c5-4278-9f48-b59ab5ce8220 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:43:54.777318 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1367/2774] 10.222.0.23 () {60 vars in 1482 bytes} [Tue May 10 05:43:54 2022] PUT /identity/v3/projects/d1f04e94e8ec47e79a3076aca65d7945/users/579d06b75bc14b8483448c63ec4600ee/roles/382636e67fc142a2b2f486340d959e11 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 05:43:54.849535 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa228c5-c1db-4e08-bfa3-a31b8499c641 None None] REQUEST_METHOD: `POST` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:43:54.849825 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa228c5-c1db-4e08-bfa3-a31b8499c641 None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:43:54.850101 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa228c5-c1db-4e08-bfa3-a31b8499c641 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:43:54.888969 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.auth.core [None req-eaa228c5-c1db-4e08-bfa3-a31b8499c641 None None] MFA Rules not processed for user `579d06b75bc14b8483448c63ec4600ee`. Rule list: `[]` (Enabled: `True`). {{(pid=79879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:43:54.890175 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-eaa228c5-c1db-4e08-bfa3-a31b8499c641 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:43:54.956181 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1408/2775] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 10 05:43:54 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 05:43:54.960978 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8886766d-d1c5-4278-9f48-b59ab5ce8220 admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:43:55.028726 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8886766d-d1c5-4278-9f48-b59ab5ce8220 admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:43:55.034459 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00953f96-acdc-4bbe-bfc6-6ffece820e95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:43:55.035236 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00953f96-acdc-4bbe-bfc6-6ffece820e95 admin admin] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:43:55.035715 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00953f96-acdc-4bbe-bfc6-6ffece820e95 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:43:55.036016 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00953f96-acdc-4bbe-bfc6-6ffece820e95 admin admin] PATH_INFO: `/v3/projects` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:43:55.036761 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00953f96-acdc-4bbe-bfc6-6ffece820e95 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:43:55.038900 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00953f96-acdc-4bbe-bfc6-6ffece820e95 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:43:55.068574 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1368/2776] 10.222.0.23 () {60 vars in 1152 bytes} [Tue May 10 05:43:54 2022] POST /identity/v3/projects => generated 381 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 05:43:55.073027 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa228c5-c1db-4e08-bfa3-a31b8499c641 None None] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:43:55.085937 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa228c5-c1db-4e08-bfa3-a31b8499c641 None None] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:43:55.144593 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc71521d-d6e9-4e9e-b0fc-423dc60b0d48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:43:55.145226 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc71521d-d6e9-4e9e-b0fc-423dc60b0d48 admin admin] REQUEST_METHOD: `POST` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:43:55.145523 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc71521d-d6e9-4e9e-b0fc-423dc60b0d48 admin admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:43:55.145845 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc71521d-d6e9-4e9e-b0fc-423dc60b0d48 admin admin] PATH_INFO: `/v3/users` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:43:55.146739 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc71521d-d6e9-4e9e-b0fc-423dc60b0d48 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:43:55.149014 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc71521d-d6e9-4e9e-b0fc-423dc60b0d48 admin admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:43:55.174772 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1409/2777] 10.222.0.23 () {60 vars in 1143 bytes} [Tue May 10 05:43:55 2022] POST /identity/v3/users => generated 297 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 05:43:55.175831 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00953f96-acdc-4bbe-bfc6-6ffece820e95 admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:43:55.187420 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00953f96-acdc-4bbe-bfc6-6ffece820e95 admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:43:55.192704 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760df313-b725-42ff-bc76-b4abc4565910 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:43:55.193840 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760df313-b725-42ff-bc76-b4abc4565910 admin admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:43:55.194119 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760df313-b725-42ff-bc76-b4abc4565910 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:43:55.194932 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760df313-b725-42ff-bc76-b4abc4565910 admin admin] PATH_INFO: `/v3/roles` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:43:55.195950 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760df313-b725-42ff-bc76-b4abc4565910 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:43:55.198630 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760df313-b725-42ff-bc76-b4abc4565910 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:43:55.210955 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1369/2778] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 10 05:43:55 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 05:43:55.215436 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc71521d-d6e9-4e9e-b0fc-423dc60b0d48 admin admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:43:55.227438 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc71521d-d6e9-4e9e-b0fc-423dc60b0d48 admin admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:43:55.233287 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78794c9b-55b7-4fbc-b0b1-63fc1d28769b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:43:55.234327 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78794c9b-55b7-4fbc-b0b1-63fc1d28769b admin admin] REQUEST_METHOD: `PUT` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:43:55.234701 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78794c9b-55b7-4fbc-b0b1-63fc1d28769b admin admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:43:55.235279 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78794c9b-55b7-4fbc-b0b1-63fc1d28769b admin admin] PATH_INFO: `/v3/projects/5e3709c9286d4e6aadcf3fbcb5d6573f/users/92c60cb4b053481e8a9c6472cdec860f/roles/199ac1dd842441d7913c6ee89d8fbecc` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:43:55.254504 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78794c9b-55b7-4fbc-b0b1-63fc1d28769b admin admin] RBAC: Authorizing `identity:create_grant(project_id=5e3709c9286d4e6aadcf3fbcb5d6573f, user_id=92c60cb4b053481e8a9c6472cdec860f, role_id=199ac1dd842441d7913c6ee89d8fbecc)` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:43:55.257320 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78794c9b-55b7-4fbc-b0b1-63fc1d28769b admin admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:43:55.273796 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1410/2779] 10.222.0.23 () {60 vars in 1482 bytes} [Tue May 10 05:43:55 2022] PUT /identity/v3/projects/5e3709c9286d4e6aadcf3fbcb5d6573f/users/92c60cb4b053481e8a9c6472cdec860f/roles/199ac1dd842441d7913c6ee89d8fbecc => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 05:43:55.277791 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760df313-b725-42ff-bc76-b4abc4565910 admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:43:55.287697 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760df313-b725-42ff-bc76-b4abc4565910 admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:43:55.353979 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98f1da3-a03c-46da-9158-b044c695f2dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:43:55.354677 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98f1da3-a03c-46da-9158-b044c695f2dd admin admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:43:55.355070 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98f1da3-a03c-46da-9158-b044c695f2dd admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:43:55.355409 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98f1da3-a03c-46da-9158-b044c695f2dd admin admin] PATH_INFO: `/v3/roles` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:43:55.356493 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98f1da3-a03c-46da-9158-b044c695f2dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:43:55.358793 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98f1da3-a03c-46da-9158-b044c695f2dd admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:43:55.371647 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1370/2780] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 10 05:43:55 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 05:43:55.376301 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78794c9b-55b7-4fbc-b0b1-63fc1d28769b admin admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:43:55.394041 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78794c9b-55b7-4fbc-b0b1-63fc1d28769b admin admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:43:55.399242 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d3b3bb-3ab4-422f-91aa-b135269c042a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:43:55.400121 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d3b3bb-3ab4-422f-91aa-b135269c042a admin admin] REQUEST_METHOD: `PUT` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:43:55.400398 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d3b3bb-3ab4-422f-91aa-b135269c042a admin admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:43:55.400671 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d3b3bb-3ab4-422f-91aa-b135269c042a admin admin] PATH_INFO: `/v3/projects/5e3709c9286d4e6aadcf3fbcb5d6573f/users/92c60cb4b053481e8a9c6472cdec860f/roles/199ac1dd842441d7913c6ee89d8fbecc` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:43:55.402749 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d3b3bb-3ab4-422f-91aa-b135269c042a admin admin] RBAC: Authorizing `identity:create_grant(project_id=5e3709c9286d4e6aadcf3fbcb5d6573f, user_id=92c60cb4b053481e8a9c6472cdec860f, role_id=199ac1dd842441d7913c6ee89d8fbecc)` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:43:55.405760 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d3b3bb-3ab4-422f-91aa-b135269c042a admin admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:43:55.416862 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1411/2781] 10.222.0.23 () {60 vars in 1482 bytes} [Tue May 10 05:43:55 2022] PUT /identity/v3/projects/5e3709c9286d4e6aadcf3fbcb5d6573f/users/92c60cb4b053481e8a9c6472cdec860f/roles/199ac1dd842441d7913c6ee89d8fbecc => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 05:43:55.427846 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b57b5c8-dd61-444f-99f3-5971df06e93c None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:43:55.428220 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b57b5c8-dd61-444f-99f3-5971df06e93c None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:43:55.428625 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b57b5c8-dd61-444f-99f3-5971df06e93c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:43:55.460788 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-2b57b5c8-dd61-444f-99f3-5971df06e93c None None] MFA Rules not processed for user `92c60cb4b053481e8a9c6472cdec860f`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:43:55.462016 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-2b57b5c8-dd61-444f-99f3-5971df06e93c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:43:55.535238 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1371/2782] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 10 05:43:55 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 05:43:55.546428 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d3b3bb-3ab4-422f-91aa-b135269c042a admin admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:43:55.548247 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-18d3b3bb-3ab4-422f-91aa-b135269c042a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:43:55.606022 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d3b3bb-3ab4-422f-91aa-b135269c042a admin admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:43:55.609876 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7856a326-fb3f-485a-aebe-645a3662eae2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355be413675540a39ccb00e1a0722316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f23435f783540199d6dcfd0417c090e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:43:55.610520 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7856a326-fb3f-485a-aebe-645a3662eae2 service cinder] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:43:55.610801 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7856a326-fb3f-485a-aebe-645a3662eae2 service cinder] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:43:55.611103 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7856a326-fb3f-485a-aebe-645a3662eae2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:43:55.669016 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7856a326-fb3f-485a-aebe-645a3662eae2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:43:55.670449 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7856a326-fb3f-485a-aebe-645a3662eae2 service cinder] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:43:55.680820 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1412/2783] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 10 05:43:55 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 05:43:57.300871 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b57b5c8-dd61-444f-99f3-5971df06e93c None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:43:57.311251 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b57b5c8-dd61-444f-99f3-5971df06e93c None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:43:57.315006 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba98df9-2e6f-433e-81a9-b0b9484fa010 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355be413675540a39ccb00e1a0722316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f23435f783540199d6dcfd0417c090e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:43:57.315761 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba98df9-2e6f-433e-81a9-b0b9484fa010 service cinder] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:43:57.316026 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba98df9-2e6f-433e-81a9-b0b9484fa010 service cinder] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:43:57.316417 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba98df9-2e6f-433e-81a9-b0b9484fa010 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:43:57.379763 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba98df9-2e6f-433e-81a9-b0b9484fa010 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:43:57.381290 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba98df9-2e6f-433e-81a9-b0b9484fa010 service cinder] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:43:57.391400 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1372/2784] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 10 05:43:57 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 05:43:58.065293 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7856a326-fb3f-485a-aebe-645a3662eae2 service cinder] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:43:58.074672 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7856a326-fb3f-485a-aebe-645a3662eae2 service cinder] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:43:58.078542 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c752678c-d15f-46b8-9760-8c6c836f376d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355be413675540a39ccb00e1a0722316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f23435f783540199d6dcfd0417c090e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:43:58.079301 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c752678c-d15f-46b8-9760-8c6c836f376d service cinder] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:43:58.079788 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c752678c-d15f-46b8-9760-8c6c836f376d service cinder] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:43:58.080129 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c752678c-d15f-46b8-9760-8c6c836f376d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:43:58.089834 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c752678c-d15f-46b8-9760-8c6c836f376d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:43:58.091441 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c752678c-d15f-46b8-9760-8c6c836f376d service cinder] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:43:58.105670 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1413/2785] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 10 05:43:58 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 05:44:02.201075 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba98df9-2e6f-433e-81a9-b0b9484fa010 service cinder] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:44:02.266756 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba98df9-2e6f-433e-81a9-b0b9484fa010 service cinder] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:44:02.274620 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7823051f-fab4-443d-bbb5-0cfe90d61b6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:44:02.275589 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7823051f-fab4-443d-bbb5-0cfe90d61b6c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:44:02.276159 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7823051f-fab4-443d-bbb5-0cfe90d61b6c admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:44:02.276159 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7823051f-fab4-443d-bbb5-0cfe90d61b6c admin admin] PATH_INFO: `/v3/users/1c20534e3dd94990b1342205050ca991` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:44:02.277549 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7823051f-fab4-443d-bbb5-0cfe90d61b6c admin admin] RBAC: Authorizing `identity:delete_user(user_id=1c20534e3dd94990b1342205050ca991)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:44:02.280323 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7823051f-fab4-443d-bbb5-0cfe90d61b6c admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:44:02.346808 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-7823051f-fab4-443d-bbb5-0cfe90d61b6c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1c20534e3dd94990b1342205050ca991'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:44:02.364425 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-7823051f-fab4-443d-bbb5-0cfe90d61b6c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1c20534e3dd94990b1342205050ca991'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:44:02.365152 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-7823051f-fab4-443d-bbb5-0cfe90d61b6c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1c20534e3dd94990b1342205050ca991'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:44:02.372797 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-7823051f-fab4-443d-bbb5-0cfe90d61b6c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1c20534e3dd94990b1342205050ca991'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:44:02.373467 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-7823051f-fab4-443d-bbb5-0cfe90d61b6c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1c20534e3dd94990b1342205050ca991'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:44:02.406765 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1373/2786] 10.222.0.23 () {58 vars in 1223 bytes} [Tue May 10 05:44:02 2022] DELETE /identity/v3/users/1c20534e3dd94990b1342205050ca991 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 05:44:02.409222 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542ba224-93bf-43e5-96f9-f58431329a84 None None] REQUEST_METHOD: `POST` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:44:02.410418 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542ba224-93bf-43e5-96f9-f58431329a84 None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:44:02.411049 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542ba224-93bf-43e5-96f9-f58431329a84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:44:02.436631 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.auth.core [None req-542ba224-93bf-43e5-96f9-f58431329a84 None None] MFA Rules not processed for user `44883b22532e44049d846938dc2cf423`. Rule list: `[]` (Enabled: `True`). {{(pid=79879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:44:02.438323 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-542ba224-93bf-43e5-96f9-f58431329a84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:44:02.530252 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1414/2787] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 10 05:44:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 05:44:02.540391 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7823051f-fab4-443d-bbb5-0cfe90d61b6c admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:44:02.542321 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-7823051f-fab4-443d-bbb5-0cfe90d61b6c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:44:02.612286 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7823051f-fab4-443d-bbb5-0cfe90d61b6c admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:44:02.617594 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec8b37f-a947-42ee-a574-52300553db9d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c8461cfdd9648b8abcaf8d34b7a102a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f23435f783540199d6dcfd0417c090e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:44:02.618300 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec8b37f-a947-42ee-a574-52300553db9d service neutron] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:44:02.618711 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec8b37f-a947-42ee-a574-52300553db9d service neutron] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:44:02.619090 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec8b37f-a947-42ee-a574-52300553db9d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:44:02.646124 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec8b37f-a947-42ee-a574-52300553db9d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:44:02.648312 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec8b37f-a947-42ee-a574-52300553db9d service neutron] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:44:02.658938 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1374/2788] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 10 05:44:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 05:44:03.151559 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542ba224-93bf-43e5-96f9-f58431329a84 None None] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:44:03.153799 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-542ba224-93bf-43e5-96f9-f58431329a84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:44:03.188720 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542ba224-93bf-43e5-96f9-f58431329a84 None None] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:44:03.208743 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1237dd-1b9c-4885-9e37-84e4042ff628 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:44:03.209682 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1237dd-1b9c-4885-9e37-84e4042ff628 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:44:03.210003 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1237dd-1b9c-4885-9e37-84e4042ff628 admin admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:44:03.210241 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1237dd-1b9c-4885-9e37-84e4042ff628 admin admin] PATH_INFO: `/v3/projects/630b213b3c38461cbd841d159d1be6a2` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:44:03.211611 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1237dd-1b9c-4885-9e37-84e4042ff628 admin admin] RBAC: Authorizing `identity:delete_project(project_id=630b213b3c38461cbd841d159d1be6a2)` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:44:03.213707 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1237dd-1b9c-4885-9e37-84e4042ff628 admin admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:44:03.289345 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-2b1237dd-1b9c-4885-9e37-84e4042ff628 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '630b213b3c38461cbd841d159d1be6a2', 'request_id': 'req-2b1237dd-1b9c-4885-9e37-84e4042ff628'} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:44:03.301829 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-2b1237dd-1b9c-4885-9e37-84e4042ff628 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '630b213b3c38461cbd841d159d1be6a2', 'request_id': 'req-2b1237dd-1b9c-4885-9e37-84e4042ff628'} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:44:03.314057 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-2b1237dd-1b9c-4885-9e37-84e4042ff628 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '630b213b3c38461cbd841d159d1be6a2', 'request_id': 'req-2b1237dd-1b9c-4885-9e37-84e4042ff628'} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:44:03.326256 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-2b1237dd-1b9c-4885-9e37-84e4042ff628 admin admin] The token cache is being invalidate because project 630b213b3c38461cbd841d159d1be6a2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79879) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 05:44:03.326569 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-2b1237dd-1b9c-4885-9e37-84e4042ff628 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:44:03.327184 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-2b1237dd-1b9c-4885-9e37-84e4042ff628 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:44:03.329694 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1415/2789] 10.222.0.23 () {58 vars in 1232 bytes} [Tue May 10 05:44:03 2022] DELETE /identity/v3/projects/630b213b3c38461cbd841d159d1be6a2 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 05:44:03.336279 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec8b37f-a947-42ee-a574-52300553db9d service neutron] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:44:03.347944 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec8b37f-a947-42ee-a574-52300553db9d service neutron] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:44:03.415445 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f479ccfa-c687-4b8e-9489-00537e3c05f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:44:03.416656 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f479ccfa-c687-4b8e-9489-00537e3c05f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:44:03.417110 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f479ccfa-c687-4b8e-9489-00537e3c05f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:44:03.417639 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f479ccfa-c687-4b8e-9489-00537e3c05f2 admin admin] PATH_INFO: `/v3/users/579d06b75bc14b8483448c63ec4600ee` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:44:03.419754 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f479ccfa-c687-4b8e-9489-00537e3c05f2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=579d06b75bc14b8483448c63ec4600ee)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:44:03.421889 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f479ccfa-c687-4b8e-9489-00537e3c05f2 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:44:03.491910 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-f479ccfa-c687-4b8e-9489-00537e3c05f2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '579d06b75bc14b8483448c63ec4600ee'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:44:03.510768 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-f479ccfa-c687-4b8e-9489-00537e3c05f2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '579d06b75bc14b8483448c63ec4600ee'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:44:03.511962 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-f479ccfa-c687-4b8e-9489-00537e3c05f2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '579d06b75bc14b8483448c63ec4600ee'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:44:03.521545 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-f479ccfa-c687-4b8e-9489-00537e3c05f2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '579d06b75bc14b8483448c63ec4600ee'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:44:03.523794 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-f479ccfa-c687-4b8e-9489-00537e3c05f2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '579d06b75bc14b8483448c63ec4600ee'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:44:03.560039 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1375/2790] 10.222.0.23 () {58 vars in 1223 bytes} [Tue May 10 05:44:03 2022] DELETE /identity/v3/users/579d06b75bc14b8483448c63ec4600ee => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 05:44:03.906933 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1237dd-1b9c-4885-9e37-84e4042ff628 admin admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:44:03.909447 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-2b1237dd-1b9c-4885-9e37-84e4042ff628 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:44:03.932573 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1237dd-1b9c-4885-9e37-84e4042ff628 admin admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:44:04.007105 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbe934e-6a16-4716-a23b-c27cb732bb53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:44:04.008138 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbe934e-6a16-4716-a23b-c27cb732bb53 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:44:04.008534 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbe934e-6a16-4716-a23b-c27cb732bb53 admin admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:44:04.009144 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbe934e-6a16-4716-a23b-c27cb732bb53 admin admin] PATH_INFO: `/v3/projects/d1f04e94e8ec47e79a3076aca65d7945` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:44:04.010601 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbe934e-6a16-4716-a23b-c27cb732bb53 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d1f04e94e8ec47e79a3076aca65d7945)` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:44:04.013029 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbe934e-6a16-4716-a23b-c27cb732bb53 admin admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:44:04.088085 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-1fbe934e-6a16-4716-a23b-c27cb732bb53 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd1f04e94e8ec47e79a3076aca65d7945', 'request_id': 'req-1fbe934e-6a16-4716-a23b-c27cb732bb53'} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:44:04.098018 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-1fbe934e-6a16-4716-a23b-c27cb732bb53 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd1f04e94e8ec47e79a3076aca65d7945', 'request_id': 'req-1fbe934e-6a16-4716-a23b-c27cb732bb53'} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:44:04.114128 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-1fbe934e-6a16-4716-a23b-c27cb732bb53 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd1f04e94e8ec47e79a3076aca65d7945', 'request_id': 'req-1fbe934e-6a16-4716-a23b-c27cb732bb53'} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:44:04.129207 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-1fbe934e-6a16-4716-a23b-c27cb732bb53 admin admin] The token cache is being invalidate because project d1f04e94e8ec47e79a3076aca65d7945 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79879) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 05:44:04.129898 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-1fbe934e-6a16-4716-a23b-c27cb732bb53 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:44:04.130787 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-1fbe934e-6a16-4716-a23b-c27cb732bb53 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:44:04.137798 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f479ccfa-c687-4b8e-9489-00537e3c05f2 admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:44:04.139796 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-f479ccfa-c687-4b8e-9489-00537e3c05f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:44:04.141571 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1416/2791] 10.222.0.23 () {58 vars in 1232 bytes} [Tue May 10 05:44:03 2022] DELETE /identity/v3/projects/d1f04e94e8ec47e79a3076aca65d7945 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 05:44:04.175472 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f479ccfa-c687-4b8e-9489-00537e3c05f2 admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:44:04.253852 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ad8821-8c56-4ffa-91fa-a03c9ac38882 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:44:04.254737 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ad8821-8c56-4ffa-91fa-a03c9ac38882 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:44:04.255310 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ad8821-8c56-4ffa-91fa-a03c9ac38882 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:44:04.255310 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ad8821-8c56-4ffa-91fa-a03c9ac38882 admin admin] PATH_INFO: `/v3/users/92c60cb4b053481e8a9c6472cdec860f` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:44:04.256748 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ad8821-8c56-4ffa-91fa-a03c9ac38882 admin admin] RBAC: Authorizing `identity:delete_user(user_id=92c60cb4b053481e8a9c6472cdec860f)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:44:04.259719 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ad8821-8c56-4ffa-91fa-a03c9ac38882 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:44:04.318159 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-a9ad8821-8c56-4ffa-91fa-a03c9ac38882 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '92c60cb4b053481e8a9c6472cdec860f'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:44:04.333192 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-a9ad8821-8c56-4ffa-91fa-a03c9ac38882 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '92c60cb4b053481e8a9c6472cdec860f'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:44:04.334225 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-a9ad8821-8c56-4ffa-91fa-a03c9ac38882 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '92c60cb4b053481e8a9c6472cdec860f'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:44:04.342163 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-a9ad8821-8c56-4ffa-91fa-a03c9ac38882 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '92c60cb4b053481e8a9c6472cdec860f'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:44:04.343537 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-a9ad8821-8c56-4ffa-91fa-a03c9ac38882 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '92c60cb4b053481e8a9c6472cdec860f'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:44:04.359039 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1376/2792] 10.222.0.23 () {58 vars in 1223 bytes} [Tue May 10 05:44:04 2022] DELETE /identity/v3/users/92c60cb4b053481e8a9c6472cdec860f => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 05:44:04.684926 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbe934e-6a16-4716-a23b-c27cb732bb53 admin admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:44:04.686790 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-1fbe934e-6a16-4716-a23b-c27cb732bb53 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:44:04.708524 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbe934e-6a16-4716-a23b-c27cb732bb53 admin admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:44:04.811684 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4469553d-26de-49bc-8026-6a892447736f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:44:04.814070 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4469553d-26de-49bc-8026-6a892447736f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:44:04.814791 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4469553d-26de-49bc-8026-6a892447736f admin admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:44:04.815799 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4469553d-26de-49bc-8026-6a892447736f admin admin] PATH_INFO: `/v3/projects/5e3709c9286d4e6aadcf3fbcb5d6573f` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:44:04.818679 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4469553d-26de-49bc-8026-6a892447736f admin admin] RBAC: Authorizing `identity:delete_project(project_id=5e3709c9286d4e6aadcf3fbcb5d6573f)` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:44:04.821765 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4469553d-26de-49bc-8026-6a892447736f admin admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:44:04.877332 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-4469553d-26de-49bc-8026-6a892447736f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5e3709c9286d4e6aadcf3fbcb5d6573f', 'request_id': 'req-4469553d-26de-49bc-8026-6a892447736f'} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:44:04.886054 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-4469553d-26de-49bc-8026-6a892447736f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5e3709c9286d4e6aadcf3fbcb5d6573f', 'request_id': 'req-4469553d-26de-49bc-8026-6a892447736f'} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:44:04.896244 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-4469553d-26de-49bc-8026-6a892447736f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5e3709c9286d4e6aadcf3fbcb5d6573f', 'request_id': 'req-4469553d-26de-49bc-8026-6a892447736f'} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:44:04.914830 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-4469553d-26de-49bc-8026-6a892447736f admin admin] The token cache is being invalidate because project 5e3709c9286d4e6aadcf3fbcb5d6573f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79879) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 05:44:04.915789 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-4469553d-26de-49bc-8026-6a892447736f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:44:04.916616 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-4469553d-26de-49bc-8026-6a892447736f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:44:04.918401 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1417/2793] 10.222.0.23 () {58 vars in 1232 bytes} [Tue May 10 05:44:04 2022] DELETE /identity/v3/projects/5e3709c9286d4e6aadcf3fbcb5d6573f => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 05:44:04.924258 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67d6315-e183-49e2-8065-5a527b3d33a6 None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:44:04.924620 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67d6315-e183-49e2-8065-5a527b3d33a6 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:44:04.925003 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67d6315-e183-49e2-8065-5a527b3d33a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:44:04.947893 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-e67d6315-e183-49e2-8065-5a527b3d33a6 None None] MFA Rules not processed for user `44883b22532e44049d846938dc2cf423`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:44:04.949226 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-e67d6315-e183-49e2-8065-5a527b3d33a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:44:05.047623 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1377/2794] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 10 05:44:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 05:44:05.053879 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8b27bc-8d8a-4e59-8f9f-2b5b96c3f5ac None None] REQUEST_METHOD: `POST` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:44:05.054363 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8b27bc-8d8a-4e59-8f9f-2b5b96c3f5ac None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:44:05.054929 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8b27bc-8d8a-4e59-8f9f-2b5b96c3f5ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:44:05.079428 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.auth.core [None req-6d8b27bc-8d8a-4e59-8f9f-2b5b96c3f5ac None None] MFA Rules not processed for user `44883b22532e44049d846938dc2cf423`. Rule list: `[]` (Enabled: `True`). {{(pid=79879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:44:05.080861 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-6d8b27bc-8d8a-4e59-8f9f-2b5b96c3f5ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:44:05.103710 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1418/2795] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 10 05:44:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 05:44:05.114340 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67d6315-e183-49e2-8065-5a527b3d33a6 None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:44:05.128952 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67d6315-e183-49e2-8065-5a527b3d33a6 None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:44:05.133705 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d600178-b536-4834-818b-918c09f05070 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:44:05.134468 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d600178-b536-4834-818b-918c09f05070 admin admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:44:05.134845 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d600178-b536-4834-818b-918c09f05070 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:44:05.135196 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d600178-b536-4834-818b-918c09f05070 admin admin] PATH_INFO: `/v3/domains` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:44:05.136043 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d600178-b536-4834-818b-918c09f05070 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:44:05.136419 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d600178-b536-4834-818b-918c09f05070 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:44:05.138664 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d600178-b536-4834-818b-918c09f05070 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:44:05.152306 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1378/2796] 10.222.0.23 () {58 vars in 1152 bytes} [Tue May 10 05:44:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:44:05.156854 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8b27bc-8d8a-4e59-8f9f-2b5b96c3f5ac None None] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:44:05.166486 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8b27bc-8d8a-4e59-8f9f-2b5b96c3f5ac None None] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:44:05.171350 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7b8cfb-e0f8-4b29-aff9-adc162b2c8cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:44:05.172045 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7b8cfb-e0f8-4b29-aff9-adc162b2c8cf admin admin] REQUEST_METHOD: `POST` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:44:05.172323 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7b8cfb-e0f8-4b29-aff9-adc162b2c8cf admin admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:44:05.172592 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7b8cfb-e0f8-4b29-aff9-adc162b2c8cf admin admin] PATH_INFO: `/v3/projects` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:44:05.173293 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7b8cfb-e0f8-4b29-aff9-adc162b2c8cf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:44:05.175367 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7b8cfb-e0f8-4b29-aff9-adc162b2c8cf admin admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:44:05.212297 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1419/2797] 10.222.0.23 () {60 vars in 1152 bytes} [Tue May 10 05:44:05 2022] POST /identity/v3/projects => generated 383 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 05:44:05.221008 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d600178-b536-4834-818b-918c09f05070 admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:44:05.234639 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d600178-b536-4834-818b-918c09f05070 admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:44:05.291051 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94856c66-70c5-4fa8-92f0-baffc34706ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:44:05.291926 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94856c66-70c5-4fa8-92f0-baffc34706ba admin admin] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:44:05.292302 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94856c66-70c5-4fa8-92f0-baffc34706ba admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:44:05.292669 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94856c66-70c5-4fa8-92f0-baffc34706ba admin admin] PATH_INFO: `/v3/users` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:44:05.293477 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94856c66-70c5-4fa8-92f0-baffc34706ba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:44:05.295754 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94856c66-70c5-4fa8-92f0-baffc34706ba admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:44:05.321154 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1379/2798] 10.222.0.23 () {60 vars in 1143 bytes} [Tue May 10 05:44:05 2022] POST /identity/v3/users => generated 292 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 05:44:05.322130 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7b8cfb-e0f8-4b29-aff9-adc162b2c8cf admin admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:44:05.333147 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7b8cfb-e0f8-4b29-aff9-adc162b2c8cf admin admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:44:05.337813 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93cf8dd-4ca4-4660-95c5-6c12748ab7bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:44:05.338485 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93cf8dd-4ca4-4660-95c5-6c12748ab7bf admin admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:44:05.338770 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93cf8dd-4ca4-4660-95c5-6c12748ab7bf admin admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:44:05.339047 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93cf8dd-4ca4-4660-95c5-6c12748ab7bf admin admin] PATH_INFO: `/v3/roles` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:44:05.340536 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93cf8dd-4ca4-4660-95c5-6c12748ab7bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:44:05.342242 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93cf8dd-4ca4-4660-95c5-6c12748ab7bf admin admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:44:05.357764 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94856c66-70c5-4fa8-92f0-baffc34706ba admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:44:05.358647 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1420/2799] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 10 05:44:05 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 05:44:05.367635 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94856c66-70c5-4fa8-92f0-baffc34706ba admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:44:05.373303 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6734051d-c538-4810-9833-528990bb567d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:44:05.374267 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6734051d-c538-4810-9833-528990bb567d admin admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:44:05.374757 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6734051d-c538-4810-9833-528990bb567d admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:44:05.375224 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6734051d-c538-4810-9833-528990bb567d admin admin] PATH_INFO: `/v3/roles` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:44:05.376410 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6734051d-c538-4810-9833-528990bb567d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:44:05.378531 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6734051d-c538-4810-9833-528990bb567d admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:44:05.388852 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1380/2800] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 10 05:44:05 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 05:44:05.393619 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93cf8dd-4ca4-4660-95c5-6c12748ab7bf admin admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:44:05.403847 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93cf8dd-4ca4-4660-95c5-6c12748ab7bf admin admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:44:05.408430 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625e0a07-3920-4e4e-ba7a-8149c50058e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:44:05.409348 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625e0a07-3920-4e4e-ba7a-8149c50058e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:44:05.409625 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625e0a07-3920-4e4e-ba7a-8149c50058e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:44:05.409905 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625e0a07-3920-4e4e-ba7a-8149c50058e8 admin admin] PATH_INFO: `/v3/projects/041e27ac56ba487e881ae80e2669a0d3/users/b2a27b0ac69b4c4fb5394c203b63646d/roles/382636e67fc142a2b2f486340d959e11` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:44:05.424368 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625e0a07-3920-4e4e-ba7a-8149c50058e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=041e27ac56ba487e881ae80e2669a0d3, user_id=b2a27b0ac69b4c4fb5394c203b63646d, role_id=382636e67fc142a2b2f486340d959e11)` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:44:05.427018 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625e0a07-3920-4e4e-ba7a-8149c50058e8 admin admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:44:05.441069 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1421/2801] 10.222.0.23 () {60 vars in 1482 bytes} [Tue May 10 05:44:05 2022] PUT /identity/v3/projects/041e27ac56ba487e881ae80e2669a0d3/users/b2a27b0ac69b4c4fb5394c203b63646d/roles/382636e67fc142a2b2f486340d959e11 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 05:44:05.452534 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6966da-8e9b-47df-97b9-398bc933a537 None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:44:05.452827 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6966da-8e9b-47df-97b9-398bc933a537 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:44:05.453107 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6966da-8e9b-47df-97b9-398bc933a537 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:44:05.480927 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-3e6966da-8e9b-47df-97b9-398bc933a537 None None] MFA Rules not processed for user `b2a27b0ac69b4c4fb5394c203b63646d`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:44:05.482312 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-3e6966da-8e9b-47df-97b9-398bc933a537 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:44:05.554809 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1381/2802] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 10 05:44:05 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 05:44:05.569369 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625e0a07-3920-4e4e-ba7a-8149c50058e8 admin admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:44:05.571162 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-625e0a07-3920-4e4e-ba7a-8149c50058e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:44:05.642134 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625e0a07-3920-4e4e-ba7a-8149c50058e8 admin admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:44:05.648765 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7bdd21-e41e-4ba4-93b7-ec26dec59cd3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355be413675540a39ccb00e1a0722316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f23435f783540199d6dcfd0417c090e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:44:05.649604 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7bdd21-e41e-4ba4-93b7-ec26dec59cd3 service cinder] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:44:05.649945 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7bdd21-e41e-4ba4-93b7-ec26dec59cd3 service cinder] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:44:05.650224 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7bdd21-e41e-4ba4-93b7-ec26dec59cd3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:44:05.660465 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7bdd21-e41e-4ba4-93b7-ec26dec59cd3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:44:05.661900 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7bdd21-e41e-4ba4-93b7-ec26dec59cd3 service cinder] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:44:05.670849 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1422/2803] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 10 05:44:05 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 05:44:09.297726 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6966da-8e9b-47df-97b9-398bc933a537 None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:44:09.370118 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6966da-8e9b-47df-97b9-398bc933a537 None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:44:09.375226 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25148407-2a24-47c8-bede-af598278f6e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:44:09.376267 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25148407-2a24-47c8-bede-af598278f6e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:44:09.376649 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25148407-2a24-47c8-bede-af598278f6e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:44:09.377025 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25148407-2a24-47c8-bede-af598278f6e5 admin admin] PATH_INFO: `/v3/users/b2a27b0ac69b4c4fb5394c203b63646d` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:44:09.378636 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25148407-2a24-47c8-bede-af598278f6e5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b2a27b0ac69b4c4fb5394c203b63646d)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:44:09.380688 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25148407-2a24-47c8-bede-af598278f6e5 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:44:09.444986 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-25148407-2a24-47c8-bede-af598278f6e5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b2a27b0ac69b4c4fb5394c203b63646d'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:44:09.457789 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-25148407-2a24-47c8-bede-af598278f6e5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b2a27b0ac69b4c4fb5394c203b63646d'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:44:09.458498 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-25148407-2a24-47c8-bede-af598278f6e5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b2a27b0ac69b4c4fb5394c203b63646d'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:44:09.468692 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-25148407-2a24-47c8-bede-af598278f6e5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b2a27b0ac69b4c4fb5394c203b63646d'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:44:09.469486 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-25148407-2a24-47c8-bede-af598278f6e5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b2a27b0ac69b4c4fb5394c203b63646d'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:44:09.484768 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1382/2804] 10.222.0.23 () {58 vars in 1223 bytes} [Tue May 10 05:44:09 2022] DELETE /identity/v3/users/b2a27b0ac69b4c4fb5394c203b63646d => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 05:44:09.489152 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99761d48-1286-4fc2-813f-2ab3dee58a32 None None] REQUEST_METHOD: `POST` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:44:09.489633 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99761d48-1286-4fc2-813f-2ab3dee58a32 None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:44:09.489733 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99761d48-1286-4fc2-813f-2ab3dee58a32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:44:09.527219 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.auth.core [None req-99761d48-1286-4fc2-813f-2ab3dee58a32 None None] MFA Rules not processed for user `44883b22532e44049d846938dc2cf423`. Rule list: `[]` (Enabled: `True`). {{(pid=79879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:44:09.530250 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-99761d48-1286-4fc2-813f-2ab3dee58a32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:44:09.621839 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1423/2805] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 10 05:44:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 05:44:09.622748 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25148407-2a24-47c8-bede-af598278f6e5 admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:44:09.624301 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-25148407-2a24-47c8-bede-af598278f6e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:44:09.710226 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25148407-2a24-47c8-bede-af598278f6e5 admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:44:09.713938 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094a2774-591a-4c11-808f-2efa88ddb676 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c8461cfdd9648b8abcaf8d34b7a102a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f23435f783540199d6dcfd0417c090e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:44:09.714619 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094a2774-591a-4c11-808f-2efa88ddb676 service neutron] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:44:09.714949 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094a2774-591a-4c11-808f-2efa88ddb676 service neutron] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:44:09.715221 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094a2774-591a-4c11-808f-2efa88ddb676 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:44:09.729518 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094a2774-591a-4c11-808f-2efa88ddb676 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:44:09.729518 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094a2774-591a-4c11-808f-2efa88ddb676 service neutron] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:44:09.752995 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1383/2806] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 10 05:44:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 05:44:10.017768 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99761d48-1286-4fc2-813f-2ab3dee58a32 None None] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:44:10.021008 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-99761d48-1286-4fc2-813f-2ab3dee58a32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:44:10.053641 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99761d48-1286-4fc2-813f-2ab3dee58a32 None None] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:44:10.066273 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2b1d1f-9cc5-4b82-bae9-b94294459d89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:44:10.067256 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2b1d1f-9cc5-4b82-bae9-b94294459d89 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:44:10.067914 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2b1d1f-9cc5-4b82-bae9-b94294459d89 admin admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:44:10.068139 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2b1d1f-9cc5-4b82-bae9-b94294459d89 admin admin] PATH_INFO: `/v3/projects/041e27ac56ba487e881ae80e2669a0d3` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:44:10.069575 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2b1d1f-9cc5-4b82-bae9-b94294459d89 admin admin] RBAC: Authorizing `identity:delete_project(project_id=041e27ac56ba487e881ae80e2669a0d3)` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:44:10.071421 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2b1d1f-9cc5-4b82-bae9-b94294459d89 admin admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:44:10.134898 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-ac2b1d1f-9cc5-4b82-bae9-b94294459d89 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '041e27ac56ba487e881ae80e2669a0d3', 'request_id': 'req-ac2b1d1f-9cc5-4b82-bae9-b94294459d89'} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:44:10.143548 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-ac2b1d1f-9cc5-4b82-bae9-b94294459d89 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '041e27ac56ba487e881ae80e2669a0d3', 'request_id': 'req-ac2b1d1f-9cc5-4b82-bae9-b94294459d89'} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:44:10.153335 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-ac2b1d1f-9cc5-4b82-bae9-b94294459d89 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '041e27ac56ba487e881ae80e2669a0d3', 'request_id': 'req-ac2b1d1f-9cc5-4b82-bae9-b94294459d89'} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:44:10.169189 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-ac2b1d1f-9cc5-4b82-bae9-b94294459d89 admin admin] The token cache is being invalidate because project 041e27ac56ba487e881ae80e2669a0d3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79879) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 05:44:10.169505 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-ac2b1d1f-9cc5-4b82-bae9-b94294459d89 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:44:10.170219 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-ac2b1d1f-9cc5-4b82-bae9-b94294459d89 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:44:10.172257 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1424/2807] 10.222.0.23 () {58 vars in 1232 bytes} [Tue May 10 05:44:10 2022] DELETE /identity/v3/projects/041e27ac56ba487e881ae80e2669a0d3 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 05:44:10.177292 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159cf991-aa18-4c14-9fa2-059862132ab5 None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:44:10.177686 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159cf991-aa18-4c14-9fa2-059862132ab5 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:44:10.177969 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159cf991-aa18-4c14-9fa2-059862132ab5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:44:10.195860 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-159cf991-aa18-4c14-9fa2-059862132ab5 None None] MFA Rules not processed for user `44883b22532e44049d846938dc2cf423`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:44:10.197057 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-159cf991-aa18-4c14-9fa2-059862132ab5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:44:10.283635 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1384/2808] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 10 05:44:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 05:44:10.286643 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca13d112-25c5-4fd0-ace5-ffd2a1760316 None None] REQUEST_METHOD: `POST` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:44:10.286643 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca13d112-25c5-4fd0-ace5-ffd2a1760316 None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:44:10.286643 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca13d112-25c5-4fd0-ace5-ffd2a1760316 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:44:10.306520 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.auth.core [None req-ca13d112-25c5-4fd0-ace5-ffd2a1760316 None None] MFA Rules not processed for user `44883b22532e44049d846938dc2cf423`. Rule list: `[]` (Enabled: `True`). {{(pid=79879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:44:10.307806 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-ca13d112-25c5-4fd0-ace5-ffd2a1760316 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:44:10.328374 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1425/2809] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 10 05:44:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 05:44:10.329559 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159cf991-aa18-4c14-9fa2-059862132ab5 None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:44:10.342340 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159cf991-aa18-4c14-9fa2-059862132ab5 None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:44:10.348049 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219bff9b-cb54-446b-90e9-d3678d714d5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:44:10.348981 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219bff9b-cb54-446b-90e9-d3678d714d5f admin admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:44:10.349567 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219bff9b-cb54-446b-90e9-d3678d714d5f admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:44:10.349865 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219bff9b-cb54-446b-90e9-d3678d714d5f admin admin] PATH_INFO: `/v3/domains` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:44:10.350659 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219bff9b-cb54-446b-90e9-d3678d714d5f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:44:10.350983 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219bff9b-cb54-446b-90e9-d3678d714d5f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:44:10.355620 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219bff9b-cb54-446b-90e9-d3678d714d5f admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:44:10.367350 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1385/2810] 10.222.0.23 () {58 vars in 1152 bytes} [Tue May 10 05:44:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:44:10.372602 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca13d112-25c5-4fd0-ace5-ffd2a1760316 None None] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:44:10.384820 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca13d112-25c5-4fd0-ace5-ffd2a1760316 None None] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:44:10.390189 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c671985d-3ffd-41d7-8ae0-45fed98fbf70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:44:10.391043 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c671985d-3ffd-41d7-8ae0-45fed98fbf70 admin admin] REQUEST_METHOD: `POST` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:44:10.391304 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c671985d-3ffd-41d7-8ae0-45fed98fbf70 admin admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:44:10.391619 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c671985d-3ffd-41d7-8ae0-45fed98fbf70 admin admin] PATH_INFO: `/v3/projects` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:44:10.392343 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c671985d-3ffd-41d7-8ae0-45fed98fbf70 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:44:10.394373 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c671985d-3ffd-41d7-8ae0-45fed98fbf70 admin admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:44:10.427609 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1426/2811] 10.222.0.23 () {60 vars in 1152 bytes} [Tue May 10 05:44:10 2022] POST /identity/v3/projects => generated 363 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 05:44:10.430035 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219bff9b-cb54-446b-90e9-d3678d714d5f admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:44:10.442639 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219bff9b-cb54-446b-90e9-d3678d714d5f admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:44:10.504796 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73554e8c-fd00-4915-a8b9-5fbd534d5d6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:44:10.508478 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73554e8c-fd00-4915-a8b9-5fbd534d5d6f admin admin] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:44:10.509062 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73554e8c-fd00-4915-a8b9-5fbd534d5d6f admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:44:10.509343 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73554e8c-fd00-4915-a8b9-5fbd534d5d6f admin admin] PATH_INFO: `/v3/users` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:44:10.510061 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73554e8c-fd00-4915-a8b9-5fbd534d5d6f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:44:10.512037 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73554e8c-fd00-4915-a8b9-5fbd534d5d6f admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:44:10.568734 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1386/2812] 10.222.0.23 () {60 vars in 1143 bytes} [Tue May 10 05:44:10 2022] POST /identity/v3/users => generated 282 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 05:44:10.570036 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c671985d-3ffd-41d7-8ae0-45fed98fbf70 admin admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:44:10.581183 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c671985d-3ffd-41d7-8ae0-45fed98fbf70 admin admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:44:10.586168 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6424cd71-b151-4ce5-9575-c0a2abee51cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:44:10.586984 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6424cd71-b151-4ce5-9575-c0a2abee51cc admin admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:44:10.587333 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6424cd71-b151-4ce5-9575-c0a2abee51cc admin admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:44:10.587688 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6424cd71-b151-4ce5-9575-c0a2abee51cc admin admin] PATH_INFO: `/v3/roles` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:44:10.588460 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6424cd71-b151-4ce5-9575-c0a2abee51cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:44:10.590071 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6424cd71-b151-4ce5-9575-c0a2abee51cc admin admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:44:10.602678 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1427/2813] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 10 05:44:10 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 05:44:10.607156 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73554e8c-fd00-4915-a8b9-5fbd534d5d6f admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:44:10.617724 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73554e8c-fd00-4915-a8b9-5fbd534d5d6f admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:44:10.622859 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc3b609-cc52-4acc-82c9-64f03ef006be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:44:10.623620 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc3b609-cc52-4acc-82c9-64f03ef006be admin admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:44:10.623985 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc3b609-cc52-4acc-82c9-64f03ef006be admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:44:10.624446 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc3b609-cc52-4acc-82c9-64f03ef006be admin admin] PATH_INFO: `/v3/roles` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:44:10.625263 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc3b609-cc52-4acc-82c9-64f03ef006be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:44:10.627002 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc3b609-cc52-4acc-82c9-64f03ef006be admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:44:10.638407 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1387/2814] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 10 05:44:10 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 05:44:10.643006 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6424cd71-b151-4ce5-9575-c0a2abee51cc admin admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:44:10.655949 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6424cd71-b151-4ce5-9575-c0a2abee51cc admin admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:44:10.664233 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e9fa2e-fccf-4993-bc9a-736e0e2296d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:44:10.665297 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e9fa2e-fccf-4993-bc9a-736e0e2296d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:44:10.665580 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e9fa2e-fccf-4993-bc9a-736e0e2296d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:44:10.666008 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e9fa2e-fccf-4993-bc9a-736e0e2296d4 admin admin] PATH_INFO: `/v3/projects/bc75f5f893634f65a173acdb12787aab/users/2bf01663795548a683644bcfbf763bc0/roles/382636e67fc142a2b2f486340d959e11` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:44:10.684207 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e9fa2e-fccf-4993-bc9a-736e0e2296d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bc75f5f893634f65a173acdb12787aab, user_id=2bf01663795548a683644bcfbf763bc0, role_id=382636e67fc142a2b2f486340d959e11)` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:44:10.688088 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e9fa2e-fccf-4993-bc9a-736e0e2296d4 admin admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:44:10.703739 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1428/2815] 10.222.0.23 () {60 vars in 1482 bytes} [Tue May 10 05:44:10 2022] PUT /identity/v3/projects/bc75f5f893634f65a173acdb12787aab/users/2bf01663795548a683644bcfbf763bc0/roles/382636e67fc142a2b2f486340d959e11 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 05:44:10.716385 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74b5837-b892-46fc-9224-3ad815b3b791 None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:44:10.716679 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74b5837-b892-46fc-9224-3ad815b3b791 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:44:10.716959 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74b5837-b892-46fc-9224-3ad815b3b791 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:44:10.761778 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-f74b5837-b892-46fc-9224-3ad815b3b791 None None] MFA Rules not processed for user `2bf01663795548a683644bcfbf763bc0`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:44:10.763102 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-f74b5837-b892-46fc-9224-3ad815b3b791 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:44:10.836607 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1388/2816] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 10 05:44:10 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 05:44:10.848510 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e9fa2e-fccf-4993-bc9a-736e0e2296d4 admin admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:44:10.850384 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-95e9fa2e-fccf-4993-bc9a-736e0e2296d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:44:10.924238 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e9fa2e-fccf-4993-bc9a-736e0e2296d4 admin admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:44:10.928474 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80158581-2f4a-4500-aa85-d9811dd8fb6f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355be413675540a39ccb00e1a0722316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f23435f783540199d6dcfd0417c090e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:44:10.929303 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80158581-2f4a-4500-aa85-d9811dd8fb6f service cinder] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:44:10.929895 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80158581-2f4a-4500-aa85-d9811dd8fb6f service cinder] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:44:10.930405 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80158581-2f4a-4500-aa85-d9811dd8fb6f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:44:10.940297 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80158581-2f4a-4500-aa85-d9811dd8fb6f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:44:10.942071 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80158581-2f4a-4500-aa85-d9811dd8fb6f service cinder] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:44:10.952459 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1429/2817] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 10 05:44:10 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 05:44:15.167407 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74b5837-b892-46fc-9224-3ad815b3b791 None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:44:15.169577 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-f74b5837-b892-46fc-9224-3ad815b3b791 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:44:15.238998 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74b5837-b892-46fc-9224-3ad815b3b791 None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:44:15.244603 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73e74d6-c0c4-472d-b10e-a7037fc4d189 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:44:15.245482 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73e74d6-c0c4-472d-b10e-a7037fc4d189 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:44:15.245766 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73e74d6-c0c4-472d-b10e-a7037fc4d189 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:44:15.246041 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73e74d6-c0c4-472d-b10e-a7037fc4d189 admin admin] PATH_INFO: `/v3/users/aebb07ff7214444a92834a3c1bd50516` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:44:15.247386 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73e74d6-c0c4-472d-b10e-a7037fc4d189 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aebb07ff7214444a92834a3c1bd50516)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:44:15.249408 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73e74d6-c0c4-472d-b10e-a7037fc4d189 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:44:15.299321 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-f73e74d6-c0c4-472d-b10e-a7037fc4d189 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aebb07ff7214444a92834a3c1bd50516'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:44:15.312768 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-f73e74d6-c0c4-472d-b10e-a7037fc4d189 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aebb07ff7214444a92834a3c1bd50516'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:44:15.313479 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-f73e74d6-c0c4-472d-b10e-a7037fc4d189 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aebb07ff7214444a92834a3c1bd50516'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:44:15.320871 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-f73e74d6-c0c4-472d-b10e-a7037fc4d189 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aebb07ff7214444a92834a3c1bd50516'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:44:15.321535 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-f73e74d6-c0c4-472d-b10e-a7037fc4d189 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aebb07ff7214444a92834a3c1bd50516'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:44:15.336162 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1389/2818] 10.222.0.23 () {58 vars in 1223 bytes} [Tue May 10 05:44:15 2022] DELETE /identity/v3/users/aebb07ff7214444a92834a3c1bd50516 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 05:44:15.342115 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02cb689-abaa-4b3e-9685-084d61b10a1d None None] REQUEST_METHOD: `POST` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:44:15.342572 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02cb689-abaa-4b3e-9685-084d61b10a1d None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:44:15.342572 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02cb689-abaa-4b3e-9685-084d61b10a1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:44:15.360002 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.auth.core [None req-c02cb689-abaa-4b3e-9685-084d61b10a1d None None] MFA Rules not processed for user `44883b22532e44049d846938dc2cf423`. Rule list: `[]` (Enabled: `True`). {{(pid=79879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:44:15.361445 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-c02cb689-abaa-4b3e-9685-084d61b10a1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:44:15.421126 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1430/2819] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 10 05:44:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 05:44:15.431525 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73e74d6-c0c4-472d-b10e-a7037fc4d189 admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:44:15.433105 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-f73e74d6-c0c4-472d-b10e-a7037fc4d189 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:44:15.494826 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73e74d6-c0c4-472d-b10e-a7037fc4d189 admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:44:15.498982 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbec3133-6062-4ccb-85ba-518cd44181dc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c8461cfdd9648b8abcaf8d34b7a102a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f23435f783540199d6dcfd0417c090e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:44:15.499660 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbec3133-6062-4ccb-85ba-518cd44181dc service neutron] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:44:15.499978 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbec3133-6062-4ccb-85ba-518cd44181dc service neutron] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:44:15.500247 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbec3133-6062-4ccb-85ba-518cd44181dc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:44:15.523213 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbec3133-6062-4ccb-85ba-518cd44181dc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:44:15.524849 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbec3133-6062-4ccb-85ba-518cd44181dc service neutron] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:44:15.535774 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1390/2820] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 10 05:44:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 05:44:15.824447 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02cb689-abaa-4b3e-9685-084d61b10a1d None None] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:44:15.826199 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-c02cb689-abaa-4b3e-9685-084d61b10a1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:44:15.843448 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02cb689-abaa-4b3e-9685-084d61b10a1d None None] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:44:15.848921 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cd6245-7e4e-4653-afa8-a435e3db2019 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:44:15.849771 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cd6245-7e4e-4653-afa8-a435e3db2019 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:44:15.850640 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cd6245-7e4e-4653-afa8-a435e3db2019 admin admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:44:15.850909 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cd6245-7e4e-4653-afa8-a435e3db2019 admin admin] PATH_INFO: `/v3/projects/8b55b60f51ec402fb551cc60ee0ae48e` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:44:15.852131 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61cd6245-7e4e-4653-afa8-a435e3db2019 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8b55b60f51ec402fb551cc60ee0ae48e)` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:44:15.854162 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61cd6245-7e4e-4653-afa8-a435e3db2019 admin admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:44:15.903128 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-61cd6245-7e4e-4653-afa8-a435e3db2019 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8b55b60f51ec402fb551cc60ee0ae48e', 'request_id': 'req-61cd6245-7e4e-4653-afa8-a435e3db2019'} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:44:15.909350 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-61cd6245-7e4e-4653-afa8-a435e3db2019 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8b55b60f51ec402fb551cc60ee0ae48e', 'request_id': 'req-61cd6245-7e4e-4653-afa8-a435e3db2019'} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:44:15.917626 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-61cd6245-7e4e-4653-afa8-a435e3db2019 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8b55b60f51ec402fb551cc60ee0ae48e', 'request_id': 'req-61cd6245-7e4e-4653-afa8-a435e3db2019'} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:44:15.933336 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-61cd6245-7e4e-4653-afa8-a435e3db2019 admin admin] The token cache is being invalidate because project 8b55b60f51ec402fb551cc60ee0ae48e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79879) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 05:44:15.933679 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-61cd6245-7e4e-4653-afa8-a435e3db2019 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:44:15.934610 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-61cd6245-7e4e-4653-afa8-a435e3db2019 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:44:15.937032 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1431/2821] 10.222.0.23 () {58 vars in 1232 bytes} [Tue May 10 05:44:15 2022] DELETE /identity/v3/projects/8b55b60f51ec402fb551cc60ee0ae48e => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 05:44:15.942209 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57e32fc-a9ce-46d9-bac6-33cc82a64756 None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:44:15.942599 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57e32fc-a9ce-46d9-bac6-33cc82a64756 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:44:15.942881 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57e32fc-a9ce-46d9-bac6-33cc82a64756 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:44:15.961652 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-c57e32fc-a9ce-46d9-bac6-33cc82a64756 None None] MFA Rules not processed for user `44883b22532e44049d846938dc2cf423`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:44:15.962868 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-c57e32fc-a9ce-46d9-bac6-33cc82a64756 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:44:16.027097 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1391/2822] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 10 05:44:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 05:44:16.038787 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1a2ef9-0c30-46bc-bac2-dcfecca9641c None None] REQUEST_METHOD: `POST` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:44:16.039159 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1a2ef9-0c30-46bc-bac2-dcfecca9641c None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:44:16.039531 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1a2ef9-0c30-46bc-bac2-dcfecca9641c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:44:16.059528 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.auth.core [None req-4d1a2ef9-0c30-46bc-bac2-dcfecca9641c None None] MFA Rules not processed for user `44883b22532e44049d846938dc2cf423`. Rule list: `[]` (Enabled: `True`). {{(pid=79879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:44:16.061144 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-4d1a2ef9-0c30-46bc-bac2-dcfecca9641c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:44:16.070591 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1432/2823] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 10 05:44:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 05:44:16.074931 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57e32fc-a9ce-46d9-bac6-33cc82a64756 None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:44:16.085340 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57e32fc-a9ce-46d9-bac6-33cc82a64756 None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:44:16.096149 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab78e43-0a01-4450-bf9e-278b5ca391c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:44:16.096898 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab78e43-0a01-4450-bf9e-278b5ca391c4 admin admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:44:16.097185 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab78e43-0a01-4450-bf9e-278b5ca391c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:44:16.097460 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab78e43-0a01-4450-bf9e-278b5ca391c4 admin admin] PATH_INFO: `/v3/domains` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:44:16.098228 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab78e43-0a01-4450-bf9e-278b5ca391c4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:44:16.098503 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab78e43-0a01-4450-bf9e-278b5ca391c4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:44:16.100208 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab78e43-0a01-4450-bf9e-278b5ca391c4 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:44:16.114039 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1392/2824] 10.222.0.23 () {58 vars in 1152 bytes} [Tue May 10 05:44:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:44:16.118623 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1a2ef9-0c30-46bc-bac2-dcfecca9641c None None] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:44:16.129489 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1a2ef9-0c30-46bc-bac2-dcfecca9641c None None] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:44:16.134527 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3731fc3a-6c92-4200-9dd4-e8361e455d68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:44:16.135159 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3731fc3a-6c92-4200-9dd4-e8361e455d68 admin admin] REQUEST_METHOD: `POST` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:44:16.135465 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3731fc3a-6c92-4200-9dd4-e8361e455d68 admin admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:44:16.135900 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3731fc3a-6c92-4200-9dd4-e8361e455d68 admin admin] PATH_INFO: `/v3/projects` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:44:16.136593 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3731fc3a-6c92-4200-9dd4-e8361e455d68 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:44:16.138730 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3731fc3a-6c92-4200-9dd4-e8361e455d68 admin admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:44:16.179499 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1433/2825] 10.222.0.23 () {60 vars in 1152 bytes} [Tue May 10 05:44:16 2022] POST /identity/v3/projects => generated 373 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 05:44:16.179822 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab78e43-0a01-4450-bf9e-278b5ca391c4 admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:44:16.190773 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab78e43-0a01-4450-bf9e-278b5ca391c4 admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:44:16.198466 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3912d5d-4bb9-4d2f-a0fd-22ecb7d62573 None None] REQUEST_METHOD: `POST` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:44:16.198989 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3912d5d-4bb9-4d2f-a0fd-22ecb7d62573 None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:44:16.199780 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3912d5d-4bb9-4d2f-a0fd-22ecb7d62573 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:44:16.220420 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.auth.core [None req-a3912d5d-4bb9-4d2f-a0fd-22ecb7d62573 None None] MFA Rules not processed for user `c5281b2a1c9a461995653be826207db4`. Rule list: `[]` (Enabled: `True`). {{(pid=79879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:44:16.221950 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-a3912d5d-4bb9-4d2f-a0fd-22ecb7d62573 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:44:16.251020 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62c29c1-5cde-4316-8f63-577f56cfb042 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:44:16.251765 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62c29c1-5cde-4316-8f63-577f56cfb042 admin admin] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:44:16.252054 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62c29c1-5cde-4316-8f63-577f56cfb042 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:44:16.252330 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62c29c1-5cde-4316-8f63-577f56cfb042 admin admin] PATH_INFO: `/v3/users` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:44:16.253350 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62c29c1-5cde-4316-8f63-577f56cfb042 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:44:16.255367 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62c29c1-5cde-4316-8f63-577f56cfb042 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:44:16.282553 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1393/2826] 10.222.0.23 () {60 vars in 1143 bytes} [Tue May 10 05:44:16 2022] POST /identity/v3/users => generated 287 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 05:44:16.286425 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62c29c1-5cde-4316-8f63-577f56cfb042 admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:44:16.291475 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1434/2827] 10.222.0.23 () {58 vars in 967 bytes} [Tue May 10 05:44:16 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 05:44:16.296554 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62c29c1-5cde-4316-8f63-577f56cfb042 admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:44:16.301223 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ee79c3-b715-45eb-9ad7-e9c887eca628 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:44:16.301888 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ee79c3-b715-45eb-9ad7-e9c887eca628 admin admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:44:16.302170 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ee79c3-b715-45eb-9ad7-e9c887eca628 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:44:16.302446 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ee79c3-b715-45eb-9ad7-e9c887eca628 admin admin] PATH_INFO: `/v3/roles` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:44:16.303186 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ee79c3-b715-45eb-9ad7-e9c887eca628 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:44:16.304337 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3912d5d-4bb9-4d2f-a0fd-22ecb7d62573 None None] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:44:16.304829 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ee79c3-b715-45eb-9ad7-e9c887eca628 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:44:16.305709 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-a3912d5d-4bb9-4d2f-a0fd-22ecb7d62573 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:44:16.315518 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1394/2828] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 10 05:44:16 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 05:44:16.319360 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ee79c3-b715-45eb-9ad7-e9c887eca628 admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:44:16.329038 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ee79c3-b715-45eb-9ad7-e9c887eca628 admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:44:16.333622 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4d1e9c-5b47-4a2b-9064-3e242c44ced5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:44:16.334259 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4d1e9c-5b47-4a2b-9064-3e242c44ced5 admin admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:44:16.334537 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4d1e9c-5b47-4a2b-9064-3e242c44ced5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:44:16.334809 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4d1e9c-5b47-4a2b-9064-3e242c44ced5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:44:16.335533 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4d1e9c-5b47-4a2b-9064-3e242c44ced5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:44:16.337162 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4d1e9c-5b47-4a2b-9064-3e242c44ced5 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:44:16.347442 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1395/2829] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 10 05:44:16 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 05:44:16.351400 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4d1e9c-5b47-4a2b-9064-3e242c44ced5 admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:44:16.360654 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4d1e9c-5b47-4a2b-9064-3e242c44ced5 admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:44:16.365205 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db842d6c-9ea3-49fa-8a58-e1078d9b6a6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:44:16.366072 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db842d6c-9ea3-49fa-8a58-e1078d9b6a6d admin admin] REQUEST_METHOD: `PUT` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:44:16.366353 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db842d6c-9ea3-49fa-8a58-e1078d9b6a6d admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:44:16.366626 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db842d6c-9ea3-49fa-8a58-e1078d9b6a6d admin admin] PATH_INFO: `/v3/projects/5f0d8248e9fd47349afece1e53a8ca25/users/e69d8cc17683451bb237f324cbd62ff3/roles/382636e67fc142a2b2f486340d959e11` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:44:16.381262 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3912d5d-4bb9-4d2f-a0fd-22ecb7d62573 None None] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:44:16.385359 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db842d6c-9ea3-49fa-8a58-e1078d9b6a6d admin admin] RBAC: Authorizing `identity:create_grant(project_id=5f0d8248e9fd47349afece1e53a8ca25, user_id=e69d8cc17683451bb237f324cbd62ff3, role_id=382636e67fc142a2b2f486340d959e11)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:44:16.387425 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1d2df6-97f0-4ce0-bcd7-b40d70554c32 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd31dacf30804395bd029037b407c12a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f23435f783540199d6dcfd0417c090e', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:44:16.388150 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1d2df6-97f0-4ce0-bcd7-b40d70554c32 service swift] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:44:16.388278 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db842d6c-9ea3-49fa-8a58-e1078d9b6a6d admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:44:16.388429 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1d2df6-97f0-4ce0-bcd7-b40d70554c32 service swift] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:44:16.388705 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1d2df6-97f0-4ce0-bcd7-b40d70554c32 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:44:16.397498 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1d2df6-97f0-4ce0-bcd7-b40d70554c32 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:44:16.399171 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1d2df6-97f0-4ce0-bcd7-b40d70554c32 service swift] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:44:16.403104 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1396/2830] 10.222.0.23 () {60 vars in 1482 bytes} [Tue May 10 05:44:16 2022] PUT /identity/v3/projects/5f0d8248e9fd47349afece1e53a8ca25/users/e69d8cc17683451bb237f324cbd62ff3/roles/382636e67fc142a2b2f486340d959e11 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 05:44:16.408370 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1435/2831] 10.222.0.23 () {60 vars in 1384 bytes} [Tue May 10 05:44:16 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 10 05:44:16.413367 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4af76c4-0a16-4bee-940f-4ffa91c0e343 None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:44:16.413661 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4af76c4-0a16-4bee-940f-4ffa91c0e343 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:44:16.413939 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4af76c4-0a16-4bee-940f-4ffa91c0e343 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:44:16.442465 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-d4af76c4-0a16-4bee-940f-4ffa91c0e343 None None] MFA Rules not processed for user `e69d8cc17683451bb237f324cbd62ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:44:16.443717 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-d4af76c4-0a16-4bee-940f-4ffa91c0e343 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:44:16.517739 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1397/2832] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 10 05:44:16 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 05:44:16.530874 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1d2df6-97f0-4ce0-bcd7-b40d70554c32 service swift] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:44:16.532296 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-2a1d2df6-97f0-4ce0-bcd7-b40d70554c32 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:44:16.600346 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1d2df6-97f0-4ce0-bcd7-b40d70554c32 service swift] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:44:16.653144 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8e4efa-c0c1-41fa-ae72-2cab988edb13 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355be413675540a39ccb00e1a0722316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f23435f783540199d6dcfd0417c090e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:44:16.653817 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8e4efa-c0c1-41fa-ae72-2cab988edb13 service cinder] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:44:16.654101 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8e4efa-c0c1-41fa-ae72-2cab988edb13 service cinder] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:44:16.654373 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8e4efa-c0c1-41fa-ae72-2cab988edb13 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:44:16.664036 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8e4efa-c0c1-41fa-ae72-2cab988edb13 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:44:16.665679 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8e4efa-c0c1-41fa-ae72-2cab988edb13 service cinder] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:44:16.676571 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1436/2833] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 10 05:44:16 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 05:44:21.186147 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93185d8d-bffd-4d6b-9738-061024d681d6 None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:44:21.186727 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93185d8d-bffd-4d6b-9738-061024d681d6 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:44:21.186727 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93185d8d-bffd-4d6b-9738-061024d681d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:44:21.204266 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-93185d8d-bffd-4d6b-9738-061024d681d6 None None] MFA Rules not processed for user `e69d8cc17683451bb237f324cbd62ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:44:21.205476 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-93185d8d-bffd-4d6b-9738-061024d681d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:44:21.213793 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1398/2834] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 10 05:44:21 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 05:44:21.747472 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8e4efa-c0c1-41fa-ae72-2cab988edb13 service cinder] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:44:21.749058 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-fa8e4efa-c0c1-41fa-ae72-2cab988edb13 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:44:21.819988 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8e4efa-c0c1-41fa-ae72-2cab988edb13 service cinder] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:44:21.824657 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44a8049-8212-4e5f-a70d-b4fe8e95aa85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:44:21.825529 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44a8049-8212-4e5f-a70d-b4fe8e95aa85 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:44:21.825805 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44a8049-8212-4e5f-a70d-b4fe8e95aa85 admin admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:44:21.826074 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44a8049-8212-4e5f-a70d-b4fe8e95aa85 admin admin] PATH_INFO: `/v3/users/971cc0771bf5482095d77c0b471bfdb3` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:44:21.827280 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44a8049-8212-4e5f-a70d-b4fe8e95aa85 admin admin] RBAC: Authorizing `identity:delete_user(user_id=971cc0771bf5482095d77c0b471bfdb3)` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:44:21.829237 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44a8049-8212-4e5f-a70d-b4fe8e95aa85 admin admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:44:21.876925 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-d44a8049-8212-4e5f-a70d-b4fe8e95aa85 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '971cc0771bf5482095d77c0b471bfdb3'} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:44:21.885654 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-d44a8049-8212-4e5f-a70d-b4fe8e95aa85 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '971cc0771bf5482095d77c0b471bfdb3'} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:44:21.886593 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-d44a8049-8212-4e5f-a70d-b4fe8e95aa85 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '971cc0771bf5482095d77c0b471bfdb3'} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:44:21.899706 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-d44a8049-8212-4e5f-a70d-b4fe8e95aa85 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '971cc0771bf5482095d77c0b471bfdb3'} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:44:21.907529 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-d44a8049-8212-4e5f-a70d-b4fe8e95aa85 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '971cc0771bf5482095d77c0b471bfdb3'} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:44:21.914354 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1437/2835] 10.222.0.23 () {58 vars in 1223 bytes} [Tue May 10 05:44:21 2022] DELETE /identity/v3/users/971cc0771bf5482095d77c0b471bfdb3 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 05:44:22.089668 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93185d8d-bffd-4d6b-9738-061024d681d6 None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:44:22.102404 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93185d8d-bffd-4d6b-9738-061024d681d6 None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:44:22.169894 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1320fc4-b8b3-4f46-8464-133b2c84ffc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:44:22.170752 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1320fc4-b8b3-4f46-8464-133b2c84ffc9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:44:22.171030 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1320fc4-b8b3-4f46-8464-133b2c84ffc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:44:22.171297 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1320fc4-b8b3-4f46-8464-133b2c84ffc9 admin admin] PATH_INFO: `/v3/projects/699b5cb28dd5440f8daf96b156413623` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:44:22.172555 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1320fc4-b8b3-4f46-8464-133b2c84ffc9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=699b5cb28dd5440f8daf96b156413623)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:44:22.174447 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1320fc4-b8b3-4f46-8464-133b2c84ffc9 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:44:22.220339 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-a1320fc4-b8b3-4f46-8464-133b2c84ffc9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '699b5cb28dd5440f8daf96b156413623', 'request_id': 'req-a1320fc4-b8b3-4f46-8464-133b2c84ffc9'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:44:22.227062 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-a1320fc4-b8b3-4f46-8464-133b2c84ffc9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '699b5cb28dd5440f8daf96b156413623', 'request_id': 'req-a1320fc4-b8b3-4f46-8464-133b2c84ffc9'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:44:22.236688 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-a1320fc4-b8b3-4f46-8464-133b2c84ffc9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '699b5cb28dd5440f8daf96b156413623', 'request_id': 'req-a1320fc4-b8b3-4f46-8464-133b2c84ffc9'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:44:22.248207 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-a1320fc4-b8b3-4f46-8464-133b2c84ffc9 admin admin] The token cache is being invalidate because project 699b5cb28dd5440f8daf96b156413623 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79880) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 05:44:22.248491 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-a1320fc4-b8b3-4f46-8464-133b2c84ffc9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:44:22.249141 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-a1320fc4-b8b3-4f46-8464-133b2c84ffc9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:44:22.250691 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1399/2836] 10.222.0.23 () {58 vars in 1232 bytes} [Tue May 10 05:44:22 2022] DELETE /identity/v3/projects/699b5cb28dd5440f8daf96b156413623 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 05:44:34.245776 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44a8049-8212-4e5f-a70d-b4fe8e95aa85 admin admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:44:34.247218 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-d44a8049-8212-4e5f-a70d-b4fe8e95aa85 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:44:34.264140 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44a8049-8212-4e5f-a70d-b4fe8e95aa85 admin admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:44:34.332962 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7583eb-9375-44e6-bb8f-44fb1124d607 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:44:34.333849 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7583eb-9375-44e6-bb8f-44fb1124d607 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:44:34.334123 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7583eb-9375-44e6-bb8f-44fb1124d607 admin admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:44:34.334576 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7583eb-9375-44e6-bb8f-44fb1124d607 admin admin] PATH_INFO: `/v3/users/40fc391e5388450bb37f541da17e95e0` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:44:34.336021 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7583eb-9375-44e6-bb8f-44fb1124d607 admin admin] RBAC: Authorizing `identity:delete_user(user_id=40fc391e5388450bb37f541da17e95e0)` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:44:34.339981 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7583eb-9375-44e6-bb8f-44fb1124d607 admin admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:44:34.399035 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-0d7583eb-9375-44e6-bb8f-44fb1124d607 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '40fc391e5388450bb37f541da17e95e0'} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:44:34.411619 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-0d7583eb-9375-44e6-bb8f-44fb1124d607 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '40fc391e5388450bb37f541da17e95e0'} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:44:34.416827 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-0d7583eb-9375-44e6-bb8f-44fb1124d607 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '40fc391e5388450bb37f541da17e95e0'} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:44:34.431071 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-0d7583eb-9375-44e6-bb8f-44fb1124d607 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '40fc391e5388450bb37f541da17e95e0'} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:44:34.438857 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-0d7583eb-9375-44e6-bb8f-44fb1124d607 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '40fc391e5388450bb37f541da17e95e0'} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:44:34.449191 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1438/2837] 10.222.0.23 () {58 vars in 1223 bytes} [Tue May 10 05:44:34 2022] DELETE /identity/v3/users/40fc391e5388450bb37f541da17e95e0 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 05:44:34.673826 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1320fc4-b8b3-4f46-8464-133b2c84ffc9 admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:44:34.675515 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-a1320fc4-b8b3-4f46-8464-133b2c84ffc9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:44:34.698830 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1320fc4-b8b3-4f46-8464-133b2c84ffc9 admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:44:34.761909 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10ac8c0-d1af-417b-bf5c-a789c94af11e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:44:34.763103 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10ac8c0-d1af-417b-bf5c-a789c94af11e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:44:34.763755 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10ac8c0-d1af-417b-bf5c-a789c94af11e admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:44:34.764031 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10ac8c0-d1af-417b-bf5c-a789c94af11e admin admin] PATH_INFO: `/v3/projects/93824ac1a89b4d37b29b6dcd0065dac1` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:44:34.765235 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10ac8c0-d1af-417b-bf5c-a789c94af11e admin admin] RBAC: Authorizing `identity:delete_project(project_id=93824ac1a89b4d37b29b6dcd0065dac1)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:44:34.767167 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10ac8c0-d1af-417b-bf5c-a789c94af11e admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:44:34.817734 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-d10ac8c0-d1af-417b-bf5c-a789c94af11e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '93824ac1a89b4d37b29b6dcd0065dac1', 'request_id': 'req-d10ac8c0-d1af-417b-bf5c-a789c94af11e'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:44:34.823818 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-d10ac8c0-d1af-417b-bf5c-a789c94af11e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '93824ac1a89b4d37b29b6dcd0065dac1', 'request_id': 'req-d10ac8c0-d1af-417b-bf5c-a789c94af11e'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:44:34.831823 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-d10ac8c0-d1af-417b-bf5c-a789c94af11e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '93824ac1a89b4d37b29b6dcd0065dac1', 'request_id': 'req-d10ac8c0-d1af-417b-bf5c-a789c94af11e'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:44:34.842416 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-d10ac8c0-d1af-417b-bf5c-a789c94af11e admin admin] The token cache is being invalidate because project 93824ac1a89b4d37b29b6dcd0065dac1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79880) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 05:44:34.842700 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-d10ac8c0-d1af-417b-bf5c-a789c94af11e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:44:34.843309 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-d10ac8c0-d1af-417b-bf5c-a789c94af11e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:44:34.844865 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1400/2838] 10.222.0.23 () {58 vars in 1232 bytes} [Tue May 10 05:44:34 2022] DELETE /identity/v3/projects/93824ac1a89b4d37b29b6dcd0065dac1 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 05:44:38.222147 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d088b680-3b8f-4092-94e8-bdaa571c3bf5 None None] REQUEST_METHOD: `POST` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:44:38.222664 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d088b680-3b8f-4092-94e8-bdaa571c3bf5 None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:44:38.222664 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d088b680-3b8f-4092-94e8-bdaa571c3bf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:44:38.240386 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.auth.core [None req-d088b680-3b8f-4092-94e8-bdaa571c3bf5 None None] MFA Rules not processed for user `c5281b2a1c9a461995653be826207db4`. Rule list: `[]` (Enabled: `True`). {{(pid=79879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:44:38.241555 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-d088b680-3b8f-4092-94e8-bdaa571c3bf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:44:38.299951 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1439/2839] 10.222.0.23 () {58 vars in 1009 bytes} [Tue May 10 05:44:38 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 05:44:38.314366 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10ac8c0-d1af-417b-bf5c-a789c94af11e admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:44:38.315964 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-d10ac8c0-d1af-417b-bf5c-a789c94af11e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:44:38.386951 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10ac8c0-d1af-417b-bf5c-a789c94af11e admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:44:38.392799 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548afb6f-2150-4bfd-8204-5d7ac3a0e314 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd31dacf30804395bd029037b407c12a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f23435f783540199d6dcfd0417c090e', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:44:38.393455 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548afb6f-2150-4bfd-8204-5d7ac3a0e314 service swift] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:44:38.393736 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548afb6f-2150-4bfd-8204-5d7ac3a0e314 service swift] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:44:38.394012 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548afb6f-2150-4bfd-8204-5d7ac3a0e314 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:44:38.404297 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548afb6f-2150-4bfd-8204-5d7ac3a0e314 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:44:38.405928 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548afb6f-2150-4bfd-8204-5d7ac3a0e314 service swift] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:44:38.415158 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1401/2840] 10.222.0.23 () {60 vars in 1384 bytes} [Tue May 10 05:44:38 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 10 05:44:38.926691 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896044dd-b7b2-429a-8096-340566e3cd78 None None] REQUEST_METHOD: `POST` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:44:38.926980 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896044dd-b7b2-429a-8096-340566e3cd78 None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:44:38.927254 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896044dd-b7b2-429a-8096-340566e3cd78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:44:38.945249 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.auth.core [None req-896044dd-b7b2-429a-8096-340566e3cd78 None None] MFA Rules not processed for user `c5281b2a1c9a461995653be826207db4`. Rule list: `[]` (Enabled: `True`). {{(pid=79879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:44:38.946427 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-896044dd-b7b2-429a-8096-340566e3cd78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:44:38.954547 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1440/2841] 10.222.0.23 () {58 vars in 967 bytes} [Tue May 10 05:44:38 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 05:44:38.966894 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548afb6f-2150-4bfd-8204-5d7ac3a0e314 service swift] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:44:38.977504 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548afb6f-2150-4bfd-8204-5d7ac3a0e314 service swift] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:44:38.985560 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e1e956-fb32-49ca-a84e-99d23c27a3bf service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd31dacf30804395bd029037b407c12a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f23435f783540199d6dcfd0417c090e', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:44:38.986289 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e1e956-fb32-49ca-a84e-99d23c27a3bf service swift] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:44:38.986572 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e1e956-fb32-49ca-a84e-99d23c27a3bf service swift] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:44:38.986869 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e1e956-fb32-49ca-a84e-99d23c27a3bf service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:44:38.996664 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e1e956-fb32-49ca-a84e-99d23c27a3bf service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:44:38.998402 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e1e956-fb32-49ca-a84e-99d23c27a3bf service swift] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:44:39.007047 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1402/2842] 10.222.0.23 () {60 vars in 1384 bytes} [Tue May 10 05:44:38 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 10 05:44:39.204769 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0295db-d6ff-4531-ba43-8a01f9b901b1 None None] REQUEST_METHOD: `POST` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:44:39.205056 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0295db-d6ff-4531-ba43-8a01f9b901b1 None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:44:39.205334 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0295db-d6ff-4531-ba43-8a01f9b901b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:44:39.223057 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.auth.core [None req-8e0295db-d6ff-4531-ba43-8a01f9b901b1 None None] MFA Rules not processed for user `c5281b2a1c9a461995653be826207db4`. Rule list: `[]` (Enabled: `True`). {{(pid=79879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:44:39.224320 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-8e0295db-d6ff-4531-ba43-8a01f9b901b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:44:39.232928 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1441/2843] 10.222.0.23 () {58 vars in 1009 bytes} [Tue May 10 05:44:39 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 05:44:39.245008 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e1e956-fb32-49ca-a84e-99d23c27a3bf service swift] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:44:39.256442 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e1e956-fb32-49ca-a84e-99d23c27a3bf service swift] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:44:39.262786 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db23735-6c84-44bc-add0-5daecab8d4ce service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd31dacf30804395bd029037b407c12a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f23435f783540199d6dcfd0417c090e', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:44:39.263561 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db23735-6c84-44bc-add0-5daecab8d4ce service swift] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:44:39.265202 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db23735-6c84-44bc-add0-5daecab8d4ce service swift] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:44:39.265202 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db23735-6c84-44bc-add0-5daecab8d4ce service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:44:39.273542 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db23735-6c84-44bc-add0-5daecab8d4ce service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:44:39.275254 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db23735-6c84-44bc-add0-5daecab8d4ce service swift] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:44:39.283455 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1403/2844] 10.222.0.23 () {60 vars in 1384 bytes} [Tue May 10 05:44:39 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 10 05:44:39.609699 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee39633-91bd-4a3d-ae5c-32d198b96c28 None None] REQUEST_METHOD: `POST` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:44:39.610017 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee39633-91bd-4a3d-ae5c-32d198b96c28 None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:44:39.610274 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee39633-91bd-4a3d-ae5c-32d198b96c28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:44:39.629781 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.auth.core [None req-7ee39633-91bd-4a3d-ae5c-32d198b96c28 None None] MFA Rules not processed for user `c5281b2a1c9a461995653be826207db4`. Rule list: `[]` (Enabled: `True`). {{(pid=79879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:44:39.630992 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-7ee39633-91bd-4a3d-ae5c-32d198b96c28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:44:39.639518 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1442/2845] 10.222.0.23 () {58 vars in 967 bytes} [Tue May 10 05:44:39 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 05:44:39.655320 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db23735-6c84-44bc-add0-5daecab8d4ce service swift] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:44:39.666273 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db23735-6c84-44bc-add0-5daecab8d4ce service swift] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:44:39.672322 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06eb72b6-4079-4f94-a651-f162fc9d08b0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd31dacf30804395bd029037b407c12a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f23435f783540199d6dcfd0417c090e', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:44:39.672979 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06eb72b6-4079-4f94-a651-f162fc9d08b0 service swift] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:44:39.673256 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06eb72b6-4079-4f94-a651-f162fc9d08b0 service swift] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:44:39.673523 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06eb72b6-4079-4f94-a651-f162fc9d08b0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:44:39.681948 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06eb72b6-4079-4f94-a651-f162fc9d08b0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:44:39.683528 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06eb72b6-4079-4f94-a651-f162fc9d08b0 service swift] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:44:39.692626 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1404/2846] 10.222.0.23 () {60 vars in 1384 bytes} [Tue May 10 05:44:39 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 10 05:44:41.761034 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee39633-91bd-4a3d-ae5c-32d198b96c28 None None] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:44:41.762702 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-7ee39633-91bd-4a3d-ae5c-32d198b96c28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:44:41.830621 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee39633-91bd-4a3d-ae5c-32d198b96c28 None None] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:44:41.835929 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80ad4f4-f3c3-4756-a1cc-2626c01c9d6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:44:41.836784 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80ad4f4-f3c3-4756-a1cc-2626c01c9d6d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:44:41.837091 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80ad4f4-f3c3-4756-a1cc-2626c01c9d6d admin admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:44:41.837361 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80ad4f4-f3c3-4756-a1cc-2626c01c9d6d admin admin] PATH_INFO: `/v3/users/e69d8cc17683451bb237f324cbd62ff3` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:44:41.838664 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80ad4f4-f3c3-4756-a1cc-2626c01c9d6d admin admin] RBAC: Authorizing `identity:delete_user(user_id=e69d8cc17683451bb237f324cbd62ff3)` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:44:41.840644 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80ad4f4-f3c3-4756-a1cc-2626c01c9d6d admin admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:44:41.900480 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-d80ad4f4-f3c3-4756-a1cc-2626c01c9d6d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e69d8cc17683451bb237f324cbd62ff3'} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:44:41.911897 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-d80ad4f4-f3c3-4756-a1cc-2626c01c9d6d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e69d8cc17683451bb237f324cbd62ff3'} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:44:41.912530 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-d80ad4f4-f3c3-4756-a1cc-2626c01c9d6d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e69d8cc17683451bb237f324cbd62ff3'} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:44:41.925325 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-d80ad4f4-f3c3-4756-a1cc-2626c01c9d6d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e69d8cc17683451bb237f324cbd62ff3'} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:44:41.932665 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-d80ad4f4-f3c3-4756-a1cc-2626c01c9d6d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e69d8cc17683451bb237f324cbd62ff3'} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:44:41.939461 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1443/2847] 10.222.0.23 () {58 vars in 1223 bytes} [Tue May 10 05:44:41 2022] DELETE /identity/v3/users/e69d8cc17683451bb237f324cbd62ff3 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 05:44:41.944692 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e905f9-6b68-47c9-9126-4fc5350f56b4 None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:44:41.945267 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e905f9-6b68-47c9-9126-4fc5350f56b4 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:44:41.945369 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e905f9-6b68-47c9-9126-4fc5350f56b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:44:41.965444 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-64e905f9-6b68-47c9-9126-4fc5350f56b4 None None] MFA Rules not processed for user `44883b22532e44049d846938dc2cf423`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:44:41.966786 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-64e905f9-6b68-47c9-9126-4fc5350f56b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:44:42.035706 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1405/2848] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 10 05:44:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 05:44:42.048242 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80ad4f4-f3c3-4756-a1cc-2626c01c9d6d admin admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:44:42.049819 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-d80ad4f4-f3c3-4756-a1cc-2626c01c9d6d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:44:42.109094 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80ad4f4-f3c3-4756-a1cc-2626c01c9d6d admin admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:44:42.113555 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3f32d8-2dfe-4bb6-ad5d-c16a6d0c2118 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c8461cfdd9648b8abcaf8d34b7a102a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f23435f783540199d6dcfd0417c090e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:44:42.114201 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3f32d8-2dfe-4bb6-ad5d-c16a6d0c2118 service neutron] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:44:42.114480 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3f32d8-2dfe-4bb6-ad5d-c16a6d0c2118 service neutron] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:44:42.114750 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3f32d8-2dfe-4bb6-ad5d-c16a6d0c2118 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:44:42.124158 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3f32d8-2dfe-4bb6-ad5d-c16a6d0c2118 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:44:42.125760 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3f32d8-2dfe-4bb6-ad5d-c16a6d0c2118 service neutron] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:44:42.136136 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1444/2849] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 10 05:44:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 05:44:42.305228 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e905f9-6b68-47c9-9126-4fc5350f56b4 None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:44:42.306866 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-64e905f9-6b68-47c9-9126-4fc5350f56b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:44:42.319116 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e905f9-6b68-47c9-9126-4fc5350f56b4 None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:44:42.324355 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2571378-f2b3-4da4-8cd9-7696f3f507e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:44:42.325211 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2571378-f2b3-4da4-8cd9-7696f3f507e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:44:42.325488 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2571378-f2b3-4da4-8cd9-7696f3f507e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:44:42.325758 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2571378-f2b3-4da4-8cd9-7696f3f507e3 admin admin] PATH_INFO: `/v3/projects/5f0d8248e9fd47349afece1e53a8ca25` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:44:42.327132 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2571378-f2b3-4da4-8cd9-7696f3f507e3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5f0d8248e9fd47349afece1e53a8ca25)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:44:42.329067 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2571378-f2b3-4da4-8cd9-7696f3f507e3 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:44:42.377187 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-d2571378-f2b3-4da4-8cd9-7696f3f507e3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5f0d8248e9fd47349afece1e53a8ca25', 'request_id': 'req-d2571378-f2b3-4da4-8cd9-7696f3f507e3'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:44:42.387092 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-d2571378-f2b3-4da4-8cd9-7696f3f507e3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5f0d8248e9fd47349afece1e53a8ca25', 'request_id': 'req-d2571378-f2b3-4da4-8cd9-7696f3f507e3'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:44:42.399054 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-d2571378-f2b3-4da4-8cd9-7696f3f507e3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5f0d8248e9fd47349afece1e53a8ca25', 'request_id': 'req-d2571378-f2b3-4da4-8cd9-7696f3f507e3'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:44:42.411089 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-d2571378-f2b3-4da4-8cd9-7696f3f507e3 admin admin] The token cache is being invalidate because project 5f0d8248e9fd47349afece1e53a8ca25 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79880) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 05:44:42.411374 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-d2571378-f2b3-4da4-8cd9-7696f3f507e3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:44:42.412008 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-d2571378-f2b3-4da4-8cd9-7696f3f507e3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:44:42.413613 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1406/2850] 10.222.0.23 () {58 vars in 1232 bytes} [Tue May 10 05:44:42 2022] DELETE /identity/v3/projects/5f0d8248e9fd47349afece1e53a8ca25 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 05:44:42.419291 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2c59b7-5a78-4568-96d7-a8ff0609c95c None None] REQUEST_METHOD: `POST` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:44:42.419791 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2c59b7-5a78-4568-96d7-a8ff0609c95c None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:44:42.420260 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2c59b7-5a78-4568-96d7-a8ff0609c95c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:44:42.439352 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.auth.core [None req-cb2c59b7-5a78-4568-96d7-a8ff0609c95c None None] MFA Rules not processed for user `44883b22532e44049d846938dc2cf423`. Rule list: `[]` (Enabled: `True`). {{(pid=79879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:44:42.440559 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-cb2c59b7-5a78-4568-96d7-a8ff0609c95c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:44:42.500074 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1445/2851] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 10 05:44:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 05:44:42.508182 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3105900b-00fb-4855-9f7d-3f4f79996db4 None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:44:42.508473 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3105900b-00fb-4855-9f7d-3f4f79996db4 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:44:42.508785 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3105900b-00fb-4855-9f7d-3f4f79996db4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:44:42.527015 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-3105900b-00fb-4855-9f7d-3f4f79996db4 None None] MFA Rules not processed for user `44883b22532e44049d846938dc2cf423`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:44:42.528233 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-3105900b-00fb-4855-9f7d-3f4f79996db4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:44:42.538027 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1407/2852] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 10 05:44:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 05:44:42.544251 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2c59b7-5a78-4568-96d7-a8ff0609c95c None None] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:44:42.557137 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2c59b7-5a78-4568-96d7-a8ff0609c95c None None] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:44:42.562683 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a966529a-48f3-42a1-8fd5-c49820527245 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:44:42.563326 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a966529a-48f3-42a1-8fd5-c49820527245 admin admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:44:42.563621 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a966529a-48f3-42a1-8fd5-c49820527245 admin admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:44:42.563908 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a966529a-48f3-42a1-8fd5-c49820527245 admin admin] PATH_INFO: `/v3/domains` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:44:42.564626 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a966529a-48f3-42a1-8fd5-c49820527245 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 05:44:42.564927 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a966529a-48f3-42a1-8fd5-c49820527245 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:44:42.566529 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a966529a-48f3-42a1-8fd5-c49820527245 admin admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:44:42.578066 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1446/2853] 10.222.0.23 () {58 vars in 1152 bytes} [Tue May 10 05:44:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 05:44:42.582491 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3105900b-00fb-4855-9f7d-3f4f79996db4 None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:44:42.592381 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3105900b-00fb-4855-9f7d-3f4f79996db4 None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:44:42.597736 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafae7ca-689b-4798-a9ef-05f0fb51f3b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:44:42.598405 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafae7ca-689b-4798-a9ef-05f0fb51f3b8 admin admin] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:44:42.598687 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafae7ca-689b-4798-a9ef-05f0fb51f3b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:44:42.598960 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafae7ca-689b-4798-a9ef-05f0fb51f3b8 admin admin] PATH_INFO: `/v3/projects` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:44:42.599686 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafae7ca-689b-4798-a9ef-05f0fb51f3b8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:44:42.601625 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafae7ca-689b-4798-a9ef-05f0fb51f3b8 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:44:42.633766 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1408/2854] 10.222.0.23 () {60 vars in 1152 bytes} [Tue May 10 05:44:42 2022] POST /identity/v3/projects => generated 389 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 05:44:42.637928 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a966529a-48f3-42a1-8fd5-c49820527245 admin admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:44:42.647943 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a966529a-48f3-42a1-8fd5-c49820527245 admin admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:44:42.705325 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2e0f10-0163-4aa8-870c-fa62819e3f25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:44:42.705978 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2e0f10-0163-4aa8-870c-fa62819e3f25 admin admin] REQUEST_METHOD: `POST` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:44:42.706259 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2e0f10-0163-4aa8-870c-fa62819e3f25 admin admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:44:42.706528 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2e0f10-0163-4aa8-870c-fa62819e3f25 admin admin] PATH_INFO: `/v3/users` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:44:42.707211 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2e0f10-0163-4aa8-870c-fa62819e3f25 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:44:42.709150 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2e0f10-0163-4aa8-870c-fa62819e3f25 admin admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:44:42.732493 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1447/2855] 10.222.0.23 () {60 vars in 1143 bytes} [Tue May 10 05:44:42 2022] POST /identity/v3/users => generated 295 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 05:44:42.737548 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafae7ca-689b-4798-a9ef-05f0fb51f3b8 admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:44:42.755408 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafae7ca-689b-4798-a9ef-05f0fb51f3b8 admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:44:42.762030 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108c9d73-1658-48c8-8512-51c8d9d602c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:44:42.762908 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108c9d73-1658-48c8-8512-51c8d9d602c1 admin admin] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:44:42.763197 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108c9d73-1658-48c8-8512-51c8d9d602c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:44:42.763555 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108c9d73-1658-48c8-8512-51c8d9d602c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:44:42.764664 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108c9d73-1658-48c8-8512-51c8d9d602c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:44:42.766717 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108c9d73-1658-48c8-8512-51c8d9d602c1 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:44:42.780684 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1409/2856] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 10 05:44:42 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 05:44:42.784993 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2e0f10-0163-4aa8-870c-fa62819e3f25 admin admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:44:42.796343 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2e0f10-0163-4aa8-870c-fa62819e3f25 admin admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:44:42.802363 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e7f90d-93c4-4d45-94c6-389669cb223b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:44:42.803010 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e7f90d-93c4-4d45-94c6-389669cb223b admin admin] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:44:42.803284 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e7f90d-93c4-4d45-94c6-389669cb223b admin admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:44:42.803549 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e7f90d-93c4-4d45-94c6-389669cb223b admin admin] PATH_INFO: `/v3/roles` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:44:42.804313 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e7f90d-93c4-4d45-94c6-389669cb223b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:44:42.805897 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e7f90d-93c4-4d45-94c6-389669cb223b admin admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:44:42.816011 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1448/2857] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 10 05:44:42 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 05:44:42.819959 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108c9d73-1658-48c8-8512-51c8d9d602c1 admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:44:42.830539 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108c9d73-1658-48c8-8512-51c8d9d602c1 admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:44:42.836482 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2ae535-3103-40e5-aef5-82b3a321a8af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:44:42.837406 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2ae535-3103-40e5-aef5-82b3a321a8af admin admin] REQUEST_METHOD: `PUT` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:44:42.837712 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2ae535-3103-40e5-aef5-82b3a321a8af admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:44:42.837992 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2ae535-3103-40e5-aef5-82b3a321a8af admin admin] PATH_INFO: `/v3/projects/1f64f861b8f34de9ba8b8aaa2cb9d668/users/976caf4fbe3c4e4e9044637523a9ce34/roles/382636e67fc142a2b2f486340d959e11` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:44:42.853878 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2ae535-3103-40e5-aef5-82b3a321a8af admin admin] RBAC: Authorizing `identity:create_grant(project_id=1f64f861b8f34de9ba8b8aaa2cb9d668, user_id=976caf4fbe3c4e4e9044637523a9ce34, role_id=382636e67fc142a2b2f486340d959e11)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:44:42.856626 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2ae535-3103-40e5-aef5-82b3a321a8af admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:44:42.871690 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1410/2858] 10.222.0.23 () {60 vars in 1482 bytes} [Tue May 10 05:44:42 2022] PUT /identity/v3/projects/1f64f861b8f34de9ba8b8aaa2cb9d668/users/976caf4fbe3c4e4e9044637523a9ce34/roles/382636e67fc142a2b2f486340d959e11 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 05:44:42.882295 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f77eb7b-7be1-41d8-bafb-8190418a53a1 None None] REQUEST_METHOD: `POST` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:44:42.882599 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f77eb7b-7be1-41d8-bafb-8190418a53a1 None None] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:44:42.882872 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f77eb7b-7be1-41d8-bafb-8190418a53a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:44:42.909355 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.auth.core [None req-1f77eb7b-7be1-41d8-bafb-8190418a53a1 None None] MFA Rules not processed for user `976caf4fbe3c4e4e9044637523a9ce34`. Rule list: `[]` (Enabled: `True`). {{(pid=79879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:44:42.910902 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-1f77eb7b-7be1-41d8-bafb-8190418a53a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:44:42.985588 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1449/2859] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 10 05:44:42 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 05:44:42.996700 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2ae535-3103-40e5-aef5-82b3a321a8af admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:44:42.998745 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-4d2ae535-3103-40e5-aef5-82b3a321a8af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:44:43.064585 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2ae535-3103-40e5-aef5-82b3a321a8af admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:44:43.071620 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c3f15b-0341-4009-9496-bc4860c2dd77 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355be413675540a39ccb00e1a0722316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f23435f783540199d6dcfd0417c090e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:44:43.072409 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c3f15b-0341-4009-9496-bc4860c2dd77 service cinder] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:44:43.072757 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c3f15b-0341-4009-9496-bc4860c2dd77 service cinder] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:44:43.073120 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c3f15b-0341-4009-9496-bc4860c2dd77 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:44:43.083807 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c3f15b-0341-4009-9496-bc4860c2dd77 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:44:43.085247 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c3f15b-0341-4009-9496-bc4860c2dd77 service cinder] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:44:43.094413 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1411/2860] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 10 05:44:42 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 05:44:57.769715 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f77eb7b-7be1-41d8-bafb-8190418a53a1 None None] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:44:57.771286 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-1f77eb7b-7be1-41d8-bafb-8190418a53a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:44:57.837161 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f77eb7b-7be1-41d8-bafb-8190418a53a1 None None] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:44:57.842140 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8feb0812-ff95-4ea3-bcb1-8392e044b5d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:44:57.843006 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8feb0812-ff95-4ea3-bcb1-8392e044b5d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:44:57.843409 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8feb0812-ff95-4ea3-bcb1-8392e044b5d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:44:57.843712 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8feb0812-ff95-4ea3-bcb1-8392e044b5d1 admin admin] PATH_INFO: `/v3/users/2bf01663795548a683644bcfbf763bc0` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:44:57.844987 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8feb0812-ff95-4ea3-bcb1-8392e044b5d1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2bf01663795548a683644bcfbf763bc0)` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:44:57.846922 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8feb0812-ff95-4ea3-bcb1-8392e044b5d1 admin admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:44:57.895250 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-8feb0812-ff95-4ea3-bcb1-8392e044b5d1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2bf01663795548a683644bcfbf763bc0'} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:44:57.903485 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-8feb0812-ff95-4ea3-bcb1-8392e044b5d1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2bf01663795548a683644bcfbf763bc0'} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:44:57.904323 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-8feb0812-ff95-4ea3-bcb1-8392e044b5d1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2bf01663795548a683644bcfbf763bc0'} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:44:57.919715 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-8feb0812-ff95-4ea3-bcb1-8392e044b5d1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2bf01663795548a683644bcfbf763bc0'} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:44:57.927105 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-8feb0812-ff95-4ea3-bcb1-8392e044b5d1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2bf01663795548a683644bcfbf763bc0'} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:44:57.933532 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1450/2861] 10.222.0.23 () {58 vars in 1223 bytes} [Tue May 10 05:44:57 2022] DELETE /identity/v3/users/2bf01663795548a683644bcfbf763bc0 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 05:44:57.938748 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbad799-1505-4d5c-9bf9-705d06bf748e None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:44:57.939311 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbad799-1505-4d5c-9bf9-705d06bf748e None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:44:57.939311 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbad799-1505-4d5c-9bf9-705d06bf748e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:44:57.957452 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-1bbad799-1505-4d5c-9bf9-705d06bf748e None None] MFA Rules not processed for user `44883b22532e44049d846938dc2cf423`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:44:57.958698 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-1bbad799-1505-4d5c-9bf9-705d06bf748e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:44:58.025242 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1412/2862] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 10 05:44:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 05:44:58.038254 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8feb0812-ff95-4ea3-bcb1-8392e044b5d1 admin admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:44:58.040133 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-8feb0812-ff95-4ea3-bcb1-8392e044b5d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:44:58.101881 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8feb0812-ff95-4ea3-bcb1-8392e044b5d1 admin admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:44:58.105745 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7e632c-4c3b-4881-9e13-66ab3ba2a063 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c8461cfdd9648b8abcaf8d34b7a102a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f23435f783540199d6dcfd0417c090e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:44:58.106439 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7e632c-4c3b-4881-9e13-66ab3ba2a063 service neutron] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:44:58.106726 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7e632c-4c3b-4881-9e13-66ab3ba2a063 service neutron] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:44:58.107017 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7e632c-4c3b-4881-9e13-66ab3ba2a063 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:44:58.116951 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7e632c-4c3b-4881-9e13-66ab3ba2a063 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:44:58.118416 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7e632c-4c3b-4881-9e13-66ab3ba2a063 service neutron] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:44:58.128539 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1451/2863] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 10 05:44:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 05:44:58.414313 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbad799-1505-4d5c-9bf9-705d06bf748e None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:44:58.415807 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-1bbad799-1505-4d5c-9bf9-705d06bf748e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:44:58.428179 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbad799-1505-4d5c-9bf9-705d06bf748e None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:44:58.434499 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac25f9d-0f1c-4f92-b4b2-e8e7971afcd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:44:58.435502 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac25f9d-0f1c-4f92-b4b2-e8e7971afcd8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:44:58.435674 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac25f9d-0f1c-4f92-b4b2-e8e7971afcd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:44:58.436014 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac25f9d-0f1c-4f92-b4b2-e8e7971afcd8 admin admin] PATH_INFO: `/v3/projects/bc75f5f893634f65a173acdb12787aab` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:44:58.437844 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac25f9d-0f1c-4f92-b4b2-e8e7971afcd8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bc75f5f893634f65a173acdb12787aab)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:44:58.440143 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac25f9d-0f1c-4f92-b4b2-e8e7971afcd8 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:44:58.490725 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-9ac25f9d-0f1c-4f92-b4b2-e8e7971afcd8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bc75f5f893634f65a173acdb12787aab', 'request_id': 'req-9ac25f9d-0f1c-4f92-b4b2-e8e7971afcd8'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:44:58.498556 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-9ac25f9d-0f1c-4f92-b4b2-e8e7971afcd8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bc75f5f893634f65a173acdb12787aab', 'request_id': 'req-9ac25f9d-0f1c-4f92-b4b2-e8e7971afcd8'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:44:58.511422 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-9ac25f9d-0f1c-4f92-b4b2-e8e7971afcd8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bc75f5f893634f65a173acdb12787aab', 'request_id': 'req-9ac25f9d-0f1c-4f92-b4b2-e8e7971afcd8'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:44:58.522541 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-9ac25f9d-0f1c-4f92-b4b2-e8e7971afcd8 admin admin] The token cache is being invalidate because project bc75f5f893634f65a173acdb12787aab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79880) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 05:44:58.522824 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-9ac25f9d-0f1c-4f92-b4b2-e8e7971afcd8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:44:58.523562 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-9ac25f9d-0f1c-4f92-b4b2-e8e7971afcd8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:44:58.525308 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1413/2864] 10.222.0.23 () {58 vars in 1232 bytes} [Tue May 10 05:44:58 2022] DELETE /identity/v3/projects/bc75f5f893634f65a173acdb12787aab => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 05:45:02.634748 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7e632c-4c3b-4881-9e13-66ab3ba2a063 service neutron] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:45:02.636432 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-ac7e632c-4c3b-4881-9e13-66ab3ba2a063 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:45:02.650054 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7e632c-4c3b-4881-9e13-66ab3ba2a063 service neutron] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:45:02.708314 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5a5ca0-6b68-450d-916a-dc0e7db51fa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:45:02.709215 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5a5ca0-6b68-450d-916a-dc0e7db51fa5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:45:02.709494 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5a5ca0-6b68-450d-916a-dc0e7db51fa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:45:02.709763 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5a5ca0-6b68-450d-916a-dc0e7db51fa5 admin admin] PATH_INFO: `/v3/users/976caf4fbe3c4e4e9044637523a9ce34` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:45:02.711071 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5a5ca0-6b68-450d-916a-dc0e7db51fa5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=976caf4fbe3c4e4e9044637523a9ce34)` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:45:02.713025 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5a5ca0-6b68-450d-916a-dc0e7db51fa5 admin admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:45:02.771846 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-ff5a5ca0-6b68-450d-916a-dc0e7db51fa5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '976caf4fbe3c4e4e9044637523a9ce34'} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:45:02.782954 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-ff5a5ca0-6b68-450d-916a-dc0e7db51fa5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '976caf4fbe3c4e4e9044637523a9ce34'} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:45:02.783687 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-ff5a5ca0-6b68-450d-916a-dc0e7db51fa5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '976caf4fbe3c4e4e9044637523a9ce34'} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:45:02.795234 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-ff5a5ca0-6b68-450d-916a-dc0e7db51fa5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '976caf4fbe3c4e4e9044637523a9ce34'} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:45:02.801907 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-ff5a5ca0-6b68-450d-916a-dc0e7db51fa5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '976caf4fbe3c4e4e9044637523a9ce34'} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:45:02.808030 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1452/2865] 10.222.0.23 () {58 vars in 1223 bytes} [Tue May 10 05:45:02 2022] DELETE /identity/v3/users/976caf4fbe3c4e4e9044637523a9ce34 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 05:45:02.812778 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3ca5c4-6e93-4bed-aa72-7aa9bd5f1f4c None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:45:02.813384 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3ca5c4-6e93-4bed-aa72-7aa9bd5f1f4c None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:45:02.813384 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3ca5c4-6e93-4bed-aa72-7aa9bd5f1f4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:45:02.832305 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-0c3ca5c4-6e93-4bed-aa72-7aa9bd5f1f4c None None] MFA Rules not processed for user `44883b22532e44049d846938dc2cf423`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:45:02.833493 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-0c3ca5c4-6e93-4bed-aa72-7aa9bd5f1f4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:45:02.893831 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1414/2866] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 10 05:45:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 05:45:02.903890 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5a5ca0-6b68-450d-916a-dc0e7db51fa5 admin admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:45:02.905514 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-ff5a5ca0-6b68-450d-916a-dc0e7db51fa5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:45:02.962591 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5a5ca0-6b68-450d-916a-dc0e7db51fa5 admin admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:45:02.966811 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa2a58f-fb1f-4192-84e7-0053b685a925 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c8461cfdd9648b8abcaf8d34b7a102a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f23435f783540199d6dcfd0417c090e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:45:02.967452 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa2a58f-fb1f-4192-84e7-0053b685a925 service neutron] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:45:02.967759 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa2a58f-fb1f-4192-84e7-0053b685a925 service neutron] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:45:02.968028 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa2a58f-fb1f-4192-84e7-0053b685a925 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:45:02.977161 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa2a58f-fb1f-4192-84e7-0053b685a925 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:45:02.978597 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa2a58f-fb1f-4192-84e7-0053b685a925 service neutron] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:45:02.987930 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1453/2867] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 10 05:45:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 05:45:03.258489 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3ca5c4-6e93-4bed-aa72-7aa9bd5f1f4c None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:45:03.259998 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-0c3ca5c4-6e93-4bed-aa72-7aa9bd5f1f4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:45:03.272591 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3ca5c4-6e93-4bed-aa72-7aa9bd5f1f4c None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:45:03.279065 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97598baa-f2e1-43c1-9206-576ff6a8f1fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:45:03.280070 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97598baa-f2e1-43c1-9206-576ff6a8f1fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:45:03.280323 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97598baa-f2e1-43c1-9206-576ff6a8f1fd admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:45:03.280603 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97598baa-f2e1-43c1-9206-576ff6a8f1fd admin admin] PATH_INFO: `/v3/projects/1f64f861b8f34de9ba8b8aaa2cb9d668` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:45:03.281899 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97598baa-f2e1-43c1-9206-576ff6a8f1fd admin admin] RBAC: Authorizing `identity:delete_project(project_id=1f64f861b8f34de9ba8b8aaa2cb9d668)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:45:03.283891 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97598baa-f2e1-43c1-9206-576ff6a8f1fd admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:45:03.329878 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-97598baa-f2e1-43c1-9206-576ff6a8f1fd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1f64f861b8f34de9ba8b8aaa2cb9d668', 'request_id': 'req-97598baa-f2e1-43c1-9206-576ff6a8f1fd'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:45:03.335938 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-97598baa-f2e1-43c1-9206-576ff6a8f1fd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1f64f861b8f34de9ba8b8aaa2cb9d668', 'request_id': 'req-97598baa-f2e1-43c1-9206-576ff6a8f1fd'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:45:03.346852 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-97598baa-f2e1-43c1-9206-576ff6a8f1fd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1f64f861b8f34de9ba8b8aaa2cb9d668', 'request_id': 'req-97598baa-f2e1-43c1-9206-576ff6a8f1fd'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:45:03.365094 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-97598baa-f2e1-43c1-9206-576ff6a8f1fd admin admin] The token cache is being invalidate because project 1f64f861b8f34de9ba8b8aaa2cb9d668 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79880) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 05:45:03.365457 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-97598baa-f2e1-43c1-9206-576ff6a8f1fd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:45:03.366324 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-97598baa-f2e1-43c1-9206-576ff6a8f1fd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:45:03.368740 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1415/2868] 10.222.0.23 () {58 vars in 1232 bytes} [Tue May 10 05:45:03 2022] DELETE /identity/v3/projects/1f64f861b8f34de9ba8b8aaa2cb9d668 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 05:46:08.681939 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa2a58f-fb1f-4192-84e7-0053b685a925 service neutron] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:46:08.694374 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa2a58f-fb1f-4192-84e7-0053b685a925 service neutron] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:46:08.742689 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c7e3e3-9ed3-42c6-aff9-88b8c1aa0cec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c8461cfdd9648b8abcaf8d34b7a102a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f23435f783540199d6dcfd0417c090e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:46:08.743229 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c7e3e3-9ed3-42c6-aff9-88b8c1aa0cec service neutron] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:46:08.743522 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c7e3e3-9ed3-42c6-aff9-88b8c1aa0cec service neutron] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:46:08.743852 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c7e3e3-9ed3-42c6-aff9-88b8c1aa0cec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:46:08.745841 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-62c7e3e3-9ed3-42c6-aff9-88b8c1aa0cec service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:46:08.827487 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c7e3e3-9ed3-42c6-aff9-88b8c1aa0cec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:46:08.828973 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c7e3e3-9ed3-42c6-aff9-88b8c1aa0cec service neutron] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:46:08.840049 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1454/2869] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 10 05:46:08 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 05:46:10.033037 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97598baa-f2e1-43c1-9206-576ff6a8f1fd admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:46:10.034897 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-97598baa-f2e1-43c1-9206-576ff6a8f1fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:46:10.051065 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97598baa-f2e1-43c1-9206-576ff6a8f1fd admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:46:10.056257 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd0ab7b-2aab-46d6-bfd5-c32c28cd9c5f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c8461cfdd9648b8abcaf8d34b7a102a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f23435f783540199d6dcfd0417c090e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:46:10.057004 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd0ab7b-2aab-46d6-bfd5-c32c28cd9c5f service neutron] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:46:10.057287 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd0ab7b-2aab-46d6-bfd5-c32c28cd9c5f service neutron] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:46:10.057533 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd0ab7b-2aab-46d6-bfd5-c32c28cd9c5f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:46:10.061298 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-9fd0ab7b-2aab-46d6-bfd5-c32c28cd9c5f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:46:10.076374 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd0ab7b-2aab-46d6-bfd5-c32c28cd9c5f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:46:10.077829 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd0ab7b-2aab-46d6-bfd5-c32c28cd9c5f service neutron] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:46:10.089298 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1416/2870] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 10 05:46:10 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 05:46:11.326689 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c7e3e3-9ed3-42c6-aff9-88b8c1aa0cec service neutron] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:46:11.328517 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-62c7e3e3-9ed3-42c6-aff9-88b8c1aa0cec service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:46:11.346164 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c7e3e3-9ed3-42c6-aff9-88b8c1aa0cec service neutron] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:46:11.357199 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b73739-c453-4950-9c7b-61e143d220ff service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f50f224ca944983aecfde86375473da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f23435f783540199d6dcfd0417c090e', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:46:11.357963 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b73739-c453-4950-9c7b-61e143d220ff service nova] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:46:11.358250 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b73739-c453-4950-9c7b-61e143d220ff service nova] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:46:11.358530 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b73739-c453-4950-9c7b-61e143d220ff service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:46:11.362565 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-51b73739-c453-4950-9c7b-61e143d220ff service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:46:11.380335 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b73739-c453-4950-9c7b-61e143d220ff service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:46:11.382203 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b73739-c453-4950-9c7b-61e143d220ff service nova] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:46:11.394665 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1455/2871] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 10 05:46:11 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 05:46:12.371825 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd9988c-db1f-430c-896c-1b4b90a823f4 None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:46:12.372324 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd9988c-db1f-430c-896c-1b4b90a823f4 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:46:12.372324 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd9988c-db1f-430c-896c-1b4b90a823f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:46:12.391897 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-fcd9988c-db1f-430c-896c-1b4b90a823f4 None None] MFA Rules not processed for user `44ea420780af4d95aa7f2ae86ca31ef1`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:46:12.393165 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-fcd9988c-db1f-430c-896c-1b4b90a823f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:46:12.448340 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1417/2872] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 10 05:46:12 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 05:46:12.772138 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b73739-c453-4950-9c7b-61e143d220ff service nova] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:46:12.782232 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b73739-c453-4950-9c7b-61e143d220ff service nova] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:46:12.786716 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ce19f0-a26b-466a-8dd3-43b7b7857b5b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c8461cfdd9648b8abcaf8d34b7a102a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f23435f783540199d6dcfd0417c090e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:46:12.787370 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ce19f0-a26b-466a-8dd3-43b7b7857b5b service neutron] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:46:12.787687 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ce19f0-a26b-466a-8dd3-43b7b7857b5b service neutron] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:46:12.787963 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ce19f0-a26b-466a-8dd3-43b7b7857b5b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:46:12.790401 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-79ce19f0-a26b-466a-8dd3-43b7b7857b5b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:46:12.801419 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ce19f0-a26b-466a-8dd3-43b7b7857b5b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:46:12.802869 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ce19f0-a26b-466a-8dd3-43b7b7857b5b service neutron] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:46:12.811465 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1456/2873] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 10 05:46:12 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 05:46:13.317882 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd9988c-db1f-430c-896c-1b4b90a823f4 None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:46:13.319475 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-fcd9988c-db1f-430c-896c-1b4b90a823f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:46:13.392705 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd9988c-db1f-430c-896c-1b4b90a823f4 None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:46:13.398808 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba50a47f-ca76-46b7-b0b8-2fd17f07796d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67321ca3e5624273acd5b06264738000', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f23435f783540199d6dcfd0417c090e', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:46:13.399465 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba50a47f-ca76-46b7-b0b8-2fd17f07796d service placement] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:46:13.399782 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba50a47f-ca76-46b7-b0b8-2fd17f07796d service placement] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:46:13.400055 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba50a47f-ca76-46b7-b0b8-2fd17f07796d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:46:13.402111 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-ba50a47f-ca76-46b7-b0b8-2fd17f07796d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:46:13.414301 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba50a47f-ca76-46b7-b0b8-2fd17f07796d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:46:13.415997 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba50a47f-ca76-46b7-b0b8-2fd17f07796d service placement] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:46:13.426005 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1418/2874] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 10 05:46:13 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 05:46:15.181273 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ce19f0-a26b-466a-8dd3-43b7b7857b5b service neutron] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:46:15.182940 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-79ce19f0-a26b-466a-8dd3-43b7b7857b5b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:46:15.193506 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ce19f0-a26b-466a-8dd3-43b7b7857b5b service neutron] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:46:15.197681 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96ec7ec-689f-49de-90b0-d38be1a06d41 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c8461cfdd9648b8abcaf8d34b7a102a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f23435f783540199d6dcfd0417c090e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:46:15.198327 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96ec7ec-689f-49de-90b0-d38be1a06d41 service neutron] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:46:15.198601 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96ec7ec-689f-49de-90b0-d38be1a06d41 service neutron] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:46:15.198873 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96ec7ec-689f-49de-90b0-d38be1a06d41 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:46:15.200843 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-d96ec7ec-689f-49de-90b0-d38be1a06d41 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:46:15.211534 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96ec7ec-689f-49de-90b0-d38be1a06d41 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:46:15.213135 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96ec7ec-689f-49de-90b0-d38be1a06d41 service neutron] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:46:15.221851 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1457/2875] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 10 05:46:15 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 05:46:27.136807 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba50a47f-ca76-46b7-b0b8-2fd17f07796d service placement] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:46:27.153029 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba50a47f-ca76-46b7-b0b8-2fd17f07796d service placement] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:46:27.159135 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a360de-d285-4f40-8c83-4680acd6097a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f50f224ca944983aecfde86375473da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f23435f783540199d6dcfd0417c090e', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:46:27.159807 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a360de-d285-4f40-8c83-4680acd6097a service nova] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:46:27.160084 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a360de-d285-4f40-8c83-4680acd6097a service nova] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:46:27.160348 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a360de-d285-4f40-8c83-4680acd6097a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:46:27.162181 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-63a360de-d285-4f40-8c83-4680acd6097a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:46:27.174392 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a360de-d285-4f40-8c83-4680acd6097a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:46:27.176022 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a360de-d285-4f40-8c83-4680acd6097a service nova] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:46:27.187011 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1419/2876] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 10 05:46:27 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 05:48:07.180406 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96ec7ec-689f-49de-90b0-d38be1a06d41 service neutron] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:48:07.182043 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-d96ec7ec-689f-49de-90b0-d38be1a06d41 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:48:07.285375 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96ec7ec-689f-49de-90b0-d38be1a06d41 service neutron] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:48:07.290927 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9009cc-b075-4710-a545-b00fc3763210 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355be413675540a39ccb00e1a0722316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f23435f783540199d6dcfd0417c090e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:48:07.291928 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9009cc-b075-4710-a545-b00fc3763210 service cinder] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:48:07.292323 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9009cc-b075-4710-a545-b00fc3763210 service cinder] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:48:07.292715 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9009cc-b075-4710-a545-b00fc3763210 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:48:07.295885 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-1f9009cc-b075-4710-a545-b00fc3763210 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:48:07.330192 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9009cc-b075-4710-a545-b00fc3763210 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:48:07.331692 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9009cc-b075-4710-a545-b00fc3763210 service cinder] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:48:07.340936 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1458/2877] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 10 05:48:07 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 05:48:15.256436 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d317b4-a2ac-4f7e-9b51-aba143341754 None None] REQUEST_METHOD: `POST` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:48:15.256998 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d317b4-a2ac-4f7e-9b51-aba143341754 None None] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:48:15.256998 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d317b4-a2ac-4f7e-9b51-aba143341754 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:48:15.275182 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.auth.core [None req-52d317b4-a2ac-4f7e-9b51-aba143341754 None None] MFA Rules not processed for user `44ea420780af4d95aa7f2ae86ca31ef1`. Rule list: `[]` (Enabled: `True`). {{(pid=79880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 05:48:15.276425 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-52d317b4-a2ac-4f7e-9b51-aba143341754 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:48:15.284975 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1420/2878] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 10 05:48:15 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 05:48:32.058629 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9009cc-b075-4710-a545-b00fc3763210 service cinder] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:48:32.060228 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-1f9009cc-b075-4710-a545-b00fc3763210 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:48:32.111551 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9009cc-b075-4710-a545-b00fc3763210 service cinder] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:48:32.118025 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aaf4954-14ee-41f6-9109-1d4b4a4d87b8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f50f224ca944983aecfde86375473da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f23435f783540199d6dcfd0417c090e', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:48:32.118788 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aaf4954-14ee-41f6-9109-1d4b4a4d87b8 service nova] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:48:32.119140 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aaf4954-14ee-41f6-9109-1d4b4a4d87b8 service nova] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:48:32.119454 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aaf4954-14ee-41f6-9109-1d4b4a4d87b8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:48:32.121358 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-2aaf4954-14ee-41f6-9109-1d4b4a4d87b8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:48:32.134287 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aaf4954-14ee-41f6-9109-1d4b4a4d87b8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:48:32.135961 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aaf4954-14ee-41f6-9109-1d4b4a4d87b8 service nova] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:48:32.146548 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1459/2879] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 10 05:48:32 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 05:49:34.643232 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d317b4-a2ac-4f7e-9b51-aba143341754 None None] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:49:34.644936 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-52d317b4-a2ac-4f7e-9b51-aba143341754 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:49:34.692555 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d317b4-a2ac-4f7e-9b51-aba143341754 None None] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:49:34.698017 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9109b5dd-0916-4bea-ad3b-b4bf834664cc service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67321ca3e5624273acd5b06264738000', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f23435f783540199d6dcfd0417c090e', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:49:34.698722 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9109b5dd-0916-4bea-ad3b-b4bf834664cc service placement] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:49:34.699007 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9109b5dd-0916-4bea-ad3b-b4bf834664cc service placement] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:49:34.699281 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9109b5dd-0916-4bea-ad3b-b4bf834664cc service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:49:34.701368 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-9109b5dd-0916-4bea-ad3b-b4bf834664cc service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:49:34.713263 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9109b5dd-0916-4bea-ad3b-b4bf834664cc service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:49:34.714853 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9109b5dd-0916-4bea-ad3b-b4bf834664cc service placement] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:49:34.727946 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1421/2880] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 10 05:49:34 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 05:50:24.344850 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aaf4954-14ee-41f6-9109-1d4b4a4d87b8 service nova] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:50:24.364330 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aaf4954-14ee-41f6-9109-1d4b4a4d87b8 service nova] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:50:24.369320 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc8b347-c3fc-4596-9228-e17235dfc3c3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c8461cfdd9648b8abcaf8d34b7a102a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f23435f783540199d6dcfd0417c090e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:50:24.369964 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc8b347-c3fc-4596-9228-e17235dfc3c3 service neutron] REQUEST_METHOD: `GET` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:50:24.370281 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc8b347-c3fc-4596-9228-e17235dfc3c3 service neutron] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:50:24.370550 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc8b347-c3fc-4596-9228-e17235dfc3c3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:50:24.372871 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-ccc8b347-c3fc-4596-9228-e17235dfc3c3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:50:24.456019 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc8b347-c3fc-4596-9228-e17235dfc3c3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:50:24.457428 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc8b347-c3fc-4596-9228-e17235dfc3c3 service neutron] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:50:24.477710 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1460/2881] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 10 05:50:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 05:50:30.736273 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9109b5dd-0916-4bea-ad3b-b4bf834664cc service placement] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:50:30.739037 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-9109b5dd-0916-4bea-ad3b-b4bf834664cc service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:50:30.753085 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9109b5dd-0916-4bea-ad3b-b4bf834664cc service placement] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:50:30.759131 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9713bc48-450a-4f0b-b704-c042fa1707ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:50:30.760043 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9713bc48-450a-4f0b-b704-c042fa1707ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:50:30.760322 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9713bc48-450a-4f0b-b704-c042fa1707ed admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:50:30.760594 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9713bc48-450a-4f0b-b704-c042fa1707ed admin admin] PATH_INFO: `/v3/users/44ea420780af4d95aa7f2ae86ca31ef1` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:50:30.761795 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9713bc48-450a-4f0b-b704-c042fa1707ed admin admin] RBAC: Authorizing `identity:delete_user(user_id=44ea420780af4d95aa7f2ae86ca31ef1)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:50:30.763743 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9713bc48-450a-4f0b-b704-c042fa1707ed admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:50:30.813819 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-9713bc48-450a-4f0b-b704-c042fa1707ed admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '44ea420780af4d95aa7f2ae86ca31ef1'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:50:30.826979 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-9713bc48-450a-4f0b-b704-c042fa1707ed admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '44ea420780af4d95aa7f2ae86ca31ef1'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:50:30.827744 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-9713bc48-450a-4f0b-b704-c042fa1707ed admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '44ea420780af4d95aa7f2ae86ca31ef1'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:50:30.834472 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-9713bc48-450a-4f0b-b704-c042fa1707ed admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '44ea420780af4d95aa7f2ae86ca31ef1'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:50:30.835129 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-9713bc48-450a-4f0b-b704-c042fa1707ed admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '44ea420780af4d95aa7f2ae86ca31ef1'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:50:30.850007 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1422/2882] 10.222.0.23 () {58 vars in 1223 bytes} [Tue May 10 05:50:30 2022] DELETE /identity/v3/users/44ea420780af4d95aa7f2ae86ca31ef1 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 05:50:31.032912 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc8b347-c3fc-4596-9228-e17235dfc3c3 service neutron] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:50:31.043660 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc8b347-c3fc-4596-9228-e17235dfc3c3 service neutron] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:50:31.098504 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294f36b8-ff7c-4248-8600-666685f64d83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:50:31.099371 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294f36b8-ff7c-4248-8600-666685f64d83 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:50:31.099688 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294f36b8-ff7c-4248-8600-666685f64d83 admin admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:50:31.099963 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294f36b8-ff7c-4248-8600-666685f64d83 admin admin] PATH_INFO: `/v3/projects/73bfe2432e5a41d8b8611b54849c575f` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:50:31.101219 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294f36b8-ff7c-4248-8600-666685f64d83 admin admin] RBAC: Authorizing `identity:delete_project(project_id=73bfe2432e5a41d8b8611b54849c575f)` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:50:31.103170 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294f36b8-ff7c-4248-8600-666685f64d83 admin admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:50:31.156366 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-294f36b8-ff7c-4248-8600-666685f64d83 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '73bfe2432e5a41d8b8611b54849c575f', 'request_id': 'req-294f36b8-ff7c-4248-8600-666685f64d83'} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:50:31.162532 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-294f36b8-ff7c-4248-8600-666685f64d83 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '73bfe2432e5a41d8b8611b54849c575f', 'request_id': 'req-294f36b8-ff7c-4248-8600-666685f64d83'} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:50:31.171886 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-294f36b8-ff7c-4248-8600-666685f64d83 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '73bfe2432e5a41d8b8611b54849c575f', 'request_id': 'req-294f36b8-ff7c-4248-8600-666685f64d83'} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:50:31.182457 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-294f36b8-ff7c-4248-8600-666685f64d83 admin admin] The token cache is being invalidate because project 73bfe2432e5a41d8b8611b54849c575f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79879) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 05:50:31.182741 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-294f36b8-ff7c-4248-8600-666685f64d83 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:50:31.183443 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-294f36b8-ff7c-4248-8600-666685f64d83 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:50:31.185129 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1461/2883] 10.222.0.23 () {58 vars in 1232 bytes} [Tue May 10 05:50:31 2022] DELETE /identity/v3/projects/73bfe2432e5a41d8b8611b54849c575f => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 05:50:31.189276 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9713bc48-450a-4f0b-b704-c042fa1707ed admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:50:31.190749 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-9713bc48-450a-4f0b-b704-c042fa1707ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:50:31.204521 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9713bc48-450a-4f0b-b704-c042fa1707ed admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:50:31.264347 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa8294c-9710-4b15-aa17-c50123b97ba9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:50:31.265222 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa8294c-9710-4b15-aa17-c50123b97ba9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:50:31.265504 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa8294c-9710-4b15-aa17-c50123b97ba9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:50:31.265774 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa8294c-9710-4b15-aa17-c50123b97ba9 admin admin] PATH_INFO: `/v3/users/84af0b03184944118da5b40bd6d43043` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:50:31.267019 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa8294c-9710-4b15-aa17-c50123b97ba9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=84af0b03184944118da5b40bd6d43043)` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:50:31.269007 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa8294c-9710-4b15-aa17-c50123b97ba9 admin admin] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:50:31.315275 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-4fa8294c-9710-4b15-aa17-c50123b97ba9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '84af0b03184944118da5b40bd6d43043'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:50:31.327156 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-4fa8294c-9710-4b15-aa17-c50123b97ba9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '84af0b03184944118da5b40bd6d43043'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:50:31.327901 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-4fa8294c-9710-4b15-aa17-c50123b97ba9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '84af0b03184944118da5b40bd6d43043'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:50:31.334646 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-4fa8294c-9710-4b15-aa17-c50123b97ba9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '84af0b03184944118da5b40bd6d43043'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:50:31.335311 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.notifications [None req-4fa8294c-9710-4b15-aa17-c50123b97ba9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '84af0b03184944118da5b40bd6d43043'} {{(pid=79880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:50:31.349414 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1423/2884] 10.222.0.23 () {58 vars in 1223 bytes} [Tue May 10 05:50:31 2022] DELETE /identity/v3/users/84af0b03184944118da5b40bd6d43043 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 05:50:31.528539 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294f36b8-ff7c-4248-8600-666685f64d83 admin admin] Authenticating user token {{(pid=79879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:50:31.530175 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.fernet_utils [None req-294f36b8-ff7c-4248-8600-666685f64d83 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:50:31.544455 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294f36b8-ff7c-4248-8600-666685f64d83 admin admin] Validating token access rules against request {{(pid=79879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:50:31.602396 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d53d7e-5579-457d-967b-47ead32f6a03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44883b22532e44049d846938dc2cf423', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8435696f504d709a504bf384af26ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:50:31.603281 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d53d7e-5579-457d-967b-47ead32f6a03 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:50:31.603562 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d53d7e-5579-457d-967b-47ead32f6a03 admin admin] SCRIPT_NAME: `/identity` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:50:31.603866 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d53d7e-5579-457d-967b-47ead32f6a03 admin admin] PATH_INFO: `/v3/projects/2bde4e3eceeb417ba375708268136c7e` {{(pid=79879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:50:31.605111 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d53d7e-5579-457d-967b-47ead32f6a03 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2bde4e3eceeb417ba375708268136c7e)` {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:50:31.607053 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d53d7e-5579-457d-967b-47ead32f6a03 admin admin] RBAC: Authorization granted {{(pid=79879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:50:31.657694 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-24d53d7e-5579-457d-967b-47ead32f6a03 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2bde4e3eceeb417ba375708268136c7e', 'request_id': 'req-24d53d7e-5579-457d-967b-47ead32f6a03'} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:50:31.664304 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-24d53d7e-5579-457d-967b-47ead32f6a03 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2bde4e3eceeb417ba375708268136c7e', 'request_id': 'req-24d53d7e-5579-457d-967b-47ead32f6a03'} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:50:31.673389 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-24d53d7e-5579-457d-967b-47ead32f6a03 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2bde4e3eceeb417ba375708268136c7e', 'request_id': 'req-24d53d7e-5579-457d-967b-47ead32f6a03'} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:50:31.684874 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-24d53d7e-5579-457d-967b-47ead32f6a03 admin admin] The token cache is being invalidate because project 2bde4e3eceeb417ba375708268136c7e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79879) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 05:50:31.685164 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-24d53d7e-5579-457d-967b-47ead32f6a03 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:50:31.685804 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: DEBUG keystone.notifications [None req-24d53d7e-5579-457d-967b-47ead32f6a03 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 05:50:31.687620 dv-cinder-836996-16-iscsi devstack@keystone.service[79879]: [pid: 79879|app: 0|req: 1462/2885] 10.222.0.23 () {58 vars in 1232 bytes} [Tue May 10 05:50:31 2022] DELETE /identity/v3/projects/2bde4e3eceeb417ba375708268136c7e => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 05:54:38.545076 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa8294c-9710-4b15-aa17-c50123b97ba9 admin admin] Authenticating user token {{(pid=79880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 05:54:38.546862 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-4fa8294c-9710-4b15-aa17-c50123b97ba9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:54:38.619363 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa8294c-9710-4b15-aa17-c50123b97ba9 admin admin] Validating token access rules against request {{(pid=79880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 05:54:38.683593 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935ef8e5-3f0d-44a5-8fe8-8f6bb049746c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67321ca3e5624273acd5b06264738000', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f23435f783540199d6dcfd0417c090e', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 05:54:38.684291 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935ef8e5-3f0d-44a5-8fe8-8f6bb049746c service placement] REQUEST_METHOD: `GET` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 05:54:38.684578 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935ef8e5-3f0d-44a5-8fe8-8f6bb049746c service placement] SCRIPT_NAME: `/identity` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 05:54:38.684847 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935ef8e5-3f0d-44a5-8fe8-8f6bb049746c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 05:54:38.686848 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.fernet_utils [None req-935ef8e5-3f0d-44a5-8fe8-8f6bb049746c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 05:54:38.698351 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935ef8e5-3f0d-44a5-8fe8-8f6bb049746c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 05:54:38.699957 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935ef8e5-3f0d-44a5-8fe8-8f6bb049746c service placement] RBAC: Authorization granted {{(pid=79880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 05:54:38.709779 dv-cinder-836996-16-iscsi devstack@keystone.service[79880]: [pid: 79880|app: 0|req: 1424/2886] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 10 05:54:38 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0)